Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York
Date

c. 1900
People

Artist: Wolfson, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.345

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York

People

Artist: Wolfson, American

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 98.9
Human 98.9
Person 98.9
Person 98.7
Person 98.2
Person 98
Room 96.9
Indoors 96.9
Person 96.2
Person 95.1
Person 94.2
Person 94.2
Person 92.3
Person 91.1
Restaurant 90.9
Person 89.5
Person 89.3
Person 87.8
Person 87.7
Person 84.6
Person 80.9
Furniture 80
Cafeteria 77.5
Person 77.1
Person 73.6
Dining Room 71.6
Classroom 69.7
School 69.7
Person 69.2
Chair 68.5
People 65.7
Person 65
Person 64.5
Person 64.1
Dining Table 61.1
Table 61.1
Waiting Room 59.4
Building 59.2
Court 59.2
Cafe 58.9
Housing 56.3

Imagga
created on 2022-06-04

room 67
classroom 45.4
interior 41.5
chair 41
table 30.2
furniture 26.9
home 23.9
stringed instrument 23.3
window 22.3
house 21.7
bowed stringed instrument 21.5
indoor 20.1
modern 19.6
floor 19.5
indoors 19.3
musical instrument 19
design 18.6
inside 16.6
wood 15.8
teacher 15.2
architecture 14.8
seat 14.7
people 14.5
decoration 14.5
decor 14.1
light 13.4
violin 13.2
glass 13.2
restaurant 12.9
empty 12
style 11.9
chairs 11.7
comfortable 11.5
office 11.4
cello 11.1
person 10.7
male 10.6
business 10.3
educator 10.1
man 10.1
desk 10.1
kitchen 9.8
old 9.7
piano 9.7
shop 9.6
barbershop 9.6
living 9.5
luxury 9.4
dinner 9.3
elegance 9.2
vintage 9.1
building 9
lifestyle 8.7
food 8.6
hotel 8.6
dining 8.6
wall 8.5
space 8.5
adult 8.5
night 8
love 7.9
tables 7.9
black 7.8
hall 7.8
elegant 7.7
residential 7.7
relax 7.6
eat 7.5
relaxation 7.5
classic 7.4
cafeteria 7.4
bar 7.4
professional 7.3
domestic 7.2
percussion instrument 7.2
women 7.1
life 7.1
wooden 7
lighting 7

Google
created on 2022-06-04

Chair 85.3
Black-and-white 82.4
Event 73.9
Table 73.5
Vintage clothing 72.4
Art 72
Monochrome photography 71.9
Font 70.4
Monochrome 69.6
History 67.1
Room 66.9
Photo caption 64.9
Stock photography 62.2
Classic 61.2
Suit 60
Sitting 58.9
Picture frame 57.3

Microsoft
created on 2022-06-04

person 99.2
text 98.5
clothing 98.3
man 89.8
woman 78.2
old 58
several 13

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 98.8%
Calm 72%
Surprised 8.8%
Disgusted 7.7%
Fear 7.6%
Confused 4.8%
Angry 3.9%
Sad 2.6%
Happy 1.8%

AWS Rekognition

Age 23-31
Gender Female, 95%
Calm 82.7%
Surprised 8%
Fear 6.4%
Happy 3.3%
Sad 2.9%
Confused 2.7%
Angry 2.3%
Disgusted 2.3%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 97.1%
Surprised 7.1%
Fear 6%
Sad 2.2%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Female, 84.8%
Surprised 36.7%
Calm 33.1%
Sad 24%
Fear 9.7%
Confused 5.8%
Angry 5%
Disgusted 3%
Happy 1.3%

AWS Rekognition

Age 16-22
Gender Male, 92.3%
Calm 96.1%
Surprised 6.4%
Fear 6%
Sad 3%
Happy 0.5%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 33-41
Gender Female, 81.8%
Calm 69.3%
Happy 27%
Surprised 6.9%
Fear 6%
Sad 2.5%
Disgusted 0.4%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Male, 94.4%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Disgusted 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 13-21
Gender Female, 71%
Sad 99.8%
Calm 22.2%
Fear 8.6%
Surprised 6.8%
Angry 0.7%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 98.9%
Calm 82.3%
Sad 6.5%
Surprised 6.4%
Fear 6.2%
Angry 5.2%
Happy 1.5%
Confused 1%
Disgusted 0.9%

AWS Rekognition

Age 30-40
Gender Female, 91.2%
Calm 94.8%
Surprised 6.4%
Fear 6.3%
Sad 2.4%
Happy 2.2%
Confused 0.3%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-36
Gender Male, 100%
Angry 65.2%
Calm 13.5%
Surprised 10.6%
Fear 7%
Confused 4.7%
Sad 4.3%
Happy 1.4%
Disgusted 0.9%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 98.2%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Confused 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 84.6%
Fear 7.5%
Surprised 6.5%
Happy 5.4%
Sad 3.1%
Disgusted 1.8%
Angry 0.8%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Female, 86.4%
Calm 90.6%
Surprised 7.3%
Fear 6.1%
Sad 2.7%
Disgusted 1.8%
Happy 1.4%
Angry 1.3%
Confused 1.1%

AWS Rekognition

Age 19-27
Gender Male, 99%
Disgusted 38.5%
Calm 25.8%
Surprised 11.7%
Sad 11.7%
Angry 9.1%
Fear 6.7%
Confused 3.2%
Happy 1%

AWS Rekognition

Age 22-30
Gender Female, 92.9%
Calm 45.1%
Angry 39.9%
Sad 7.5%
Surprised 6.7%
Fear 6.2%
Happy 2.7%
Disgusted 1.1%
Confused 0.3%

AWS Rekognition

Age 14-22
Gender Female, 72.6%
Sad 84.4%
Calm 33.9%
Surprised 8.7%
Happy 8.3%
Fear 7.1%
Angry 5.5%
Disgusted 3.8%
Confused 2.7%

AWS Rekognition

Age 11-19
Gender Male, 86%
Fear 68.6%
Calm 25.4%
Surprised 8.4%
Happy 8.2%
Sad 3.5%
Angry 3.1%
Disgusted 1.9%
Confused 1.2%

AWS Rekognition

Age 22-30
Gender Male, 97.6%
Sad 67.6%
Calm 45%
Happy 9%
Surprised 8%
Fear 7.9%
Disgusted 3.2%
Confused 1.9%
Angry 1.1%

AWS Rekognition

Age 26-36
Gender Male, 95.9%
Calm 36.5%
Disgusted 35%
Fear 12.3%
Surprised 10.1%
Happy 4.2%
Angry 3.3%
Sad 2.9%
Confused 0.7%

AWS Rekognition

Age 18-26
Gender Male, 74.5%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0.5%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Male, 92.8%
Calm 53%
Surprised 22.8%
Fear 8.6%
Angry 7.4%
Sad 6.9%
Confused 4.1%
Disgusted 2.2%
Happy 1.4%

AWS Rekognition

Age 23-31
Gender Female, 52.6%
Calm 82.7%
Surprised 7.4%
Sad 7.4%
Fear 6%
Angry 4.4%
Disgusted 0.7%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 94.4%
Sad 100%
Fear 10.4%
Surprised 6.5%
Calm 4.3%
Angry 1.8%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 98.9%
Chair 68.5%

Captions

Microsoft

a group of people in a room 93.8%
an old photo of a group of people in a room 91.9%
old photo of a group of people in a room 90.6%

Text analysis

Amazon

the
Court
The
of
are
and
tution
in
where
affecting
Republic
The Boya' Republic Court where cases affecting the dissipline
Boya'
The Boya' Republic Counoil in weekly seasion.
cases
weekly
seasion.
HS
dissipline
handled.
and norali 1/ of the inati tution are handled.
HS MICS
MICS
norali
BY
Counoil
inati
1/

Google

wych Hs Pos Pr The Boys' Republic Council in weekly session. The Boya Republic Court where cases affecting the discipline and morality of the institution are handled.
wych
Hs
Pos
Pr
The
Boys
'
Republic
Council
in
weekly
session
.
Boya
Court
where
cases
affecting
the
discipline
and
morality
of
institution
are
handled