Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Hebrew and religious instruction. The chapel is an integral part of the school.

Date

c. 1912

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.343.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Hebrew and religious instruction. The chapel is an integral part of the school.

People

Artist: Unidentified Artist,

Date

c. 1912

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Interior Design 99
Indoors 99
Person 97.4
Human 97.4
Room 97.4
Accessory 97
Tie 97
Accessories 97
Person 96.9
Person 96.3
Classroom 93.2
School 93.2
Person 92.3
Person 92.2
Person 91.9
Crowd 74.5
Auditorium 72.2
Theater 72.2
Hall 72.2
Audience 69.6
Person 69.1
Court 63.9
People 63.8

Clarifai
created on 2019-06-05

people 99.8
many 99.1
group 98.9
chair 98.8
furniture 98.3
indoors 98
room 97.1
group together 97
home 96.6
leader 96.4
administration 96.2
adult 96.2
seat 94.5
military 89.9
one 88
man 85.5
war 85.1
vehicle 85
woman 84.8
education 82.9

Imagga
created on 2019-06-05

room 81.7
classroom 58.9
interior 56.6
chair 40
table 38.4
furniture 35.4
hall 31.4
restaurant 25.2
house 25.1
floor 23.2
modern 22.4
home 22.3
inside 22.1
wood 21.7
chairs 20.6
seat 20.3
design 20.3
indoors 19.3
architecture 18.9
decor 18.6
comfortable 17.2
lamp 16.5
light 16
kitchen 16
building 15.6
empty 15.5
wall 15.2
style 14.8
luxury 14.6
window 14.2
wooden 14.1
glass 14
residential 13.4
dining 13.3
indoor 12.8
apartment 12.5
hotel 12.4
tables 11.8
dinner 11.8
elegance 11.8
drink 11.7
food 11.5
chandelier 11.1
stool 10.9
counter 10.8
living 10.4
decoration 10.1
nobody 10.1
sofa 9.9
residence 9.7
urban 9.6
structure 9.6
eat 9.2
plant 9
stove 8.9
cafeteria 8.6
tile 8.6
contemporary 8.5
relaxation 8.4
deck 8.4
wine 8.3
domestic 8.1
cabinets 7.9
business 7.9
carpet 7.8
space 7.8
travel 7.7
lunch 7.7
relax 7.6
city 7.5
place 7.4
life 7.4

Google
created on 2019-06-05

Building 84.1
Auditorium 72.6
Room 71.4
Architecture 65.5
Event 62.7
Interior design 59.1
Chapel 58.2
Black-and-white 56.4
Hall 52.7

Microsoft
created on 2019-06-05

indoor 98.6
wall 96.1
person 68.7
building 56.4
old 40.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Sad 54%
Disgusted 45%
Happy 45.7%
Angry 45.1%
Surprised 45.1%
Calm 45.1%
Confused 45%

AWS Rekognition

Age 20-38
Gender Female, 51.1%
Calm 46%
Surprised 45.1%
Disgusted 46.9%
Angry 45.2%
Happy 45.4%
Sad 51.3%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Sad 52.5%
Disgusted 45%
Angry 45.1%
Confused 45%
Calm 47.3%
Surprised 45.1%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51%
Surprised 45.8%
Sad 47.4%
Happy 45.5%
Confused 45.4%
Calm 50%
Angry 45.5%
Disgusted 45.4%

AWS Rekognition

Age 20-38
Gender Female, 52.8%
Calm 48.6%
Sad 50.9%
Disgusted 45.1%
Surprised 45.1%
Confused 45.1%
Happy 45.1%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Surprised 45.6%
Happy 48%
Calm 45.7%
Sad 48.9%
Disgusted 45.8%
Confused 45.3%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.5%
Surprised 49.5%
Sad 50.4%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 35-52
Gender Female, 53%
Happy 51%
Disgusted 45.8%
Surprised 45.5%
Angry 45.5%
Sad 46.1%
Confused 45.2%
Calm 46%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Sad 50.4%
Disgusted 49.5%
Calm 49.6%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 15-25
Gender Male, 53.1%
Disgusted 45%
Happy 48.3%
Calm 45.9%
Angry 45.2%
Surprised 45.1%
Confused 45.1%
Sad 50.4%

AWS Rekognition

Age 19-36
Gender Male, 52.8%
Angry 45.5%
Surprised 45.4%
Happy 45.2%
Disgusted 45.2%
Sad 49.6%
Confused 45.2%
Calm 49%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Sad 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.5%
Surprised 49.5%
Angry 50.4%

AWS Rekognition

Age 19-36
Gender Male, 50%
Confused 49.6%
Sad 49.8%
Happy 49.5%
Surprised 49.5%
Disgusted 49.6%
Calm 49.8%
Angry 49.7%

AWS Rekognition

Age 15-25
Gender Male, 50.3%
Happy 49.5%
Surprised 49.5%
Angry 49.6%
Calm 50.1%
Sad 49.7%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Male, 50.5%
Calm 49.7%
Confused 49.8%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%
Sad 49.7%
Surprised 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Confused 49.5%
Sad 50.1%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.7%
Angry 49.7%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Calm 49.7%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.2%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 50.3%
Disgusted 49.5%
Calm 49.6%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Sad 49.7%
Confused 49.5%
Angry 49.5%
Calm 50.3%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Calm 50.4%
Surprised 49.5%

AWS Rekognition

Age 27-44
Gender Male, 50.5%
Calm 49.5%
Confused 49.7%
Sad 49.6%
Surprised 49.6%
Happy 49.5%
Disgusted 49.9%
Angry 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Happy 49.5%
Angry 49.5%
Calm 50.3%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.5%
Sad 50.4%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 6-13
Gender Male, 50.4%
Angry 49.5%
Sad 50%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.9%
Happy 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.5%
Sad 49.7%
Surprised 49.6%
Confused 49.6%
Calm 50%
Angry 49.5%

AWS Rekognition

Age 45-63
Gender Female, 50.2%
Angry 49.6%
Disgusted 49.6%
Sad 50%
Surprised 49.5%
Happy 49.7%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.1%
Happy 49.5%
Angry 49.5%
Calm 49.5%
Sad 50.1%
Surprised 49.5%
Confused 49.5%
Disgusted 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Disgusted 49.5%
Sad 49.6%
Calm 50.1%
Surprised 49.6%
Angry 49.5%
Happy 49.6%
Confused 49.7%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Disgusted 49.6%
Confused 49.6%
Sad 50%
Angry 49.6%
Happy 49.6%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Surprised 49.5%
Sad 50.4%
Disgusted 49.6%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.6%
Sad 49.7%
Disgusted 49.6%
Happy 49.5%
Confused 49.7%
Calm 49.7%
Angry 49.8%

AWS Rekognition

Age 19-36
Gender Male, 50.5%
Confused 49.5%
Disgusted 49.8%
Surprised 49.5%
Sad 50%
Angry 49.7%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 23-38
Gender Female, 52.3%
Surprised 45.9%
Happy 46.2%
Confused 45.4%
Calm 45.5%
Disgusted 47.4%
Angry 46.2%
Sad 48.4%

AWS Rekognition

Age 26-44
Gender Female, 50.1%
Happy 49.5%
Surprised 49.5%
Confused 49.6%
Disgusted 49.9%
Calm 49.5%
Angry 49.6%
Sad 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Calm 49.6%
Sad 50%
Surprised 49.5%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.6%
Angry 49.6%
Confused 49.6%
Calm 49.9%
Surprised 49.5%
Sad 49.8%

AWS Rekognition

Age 4-9
Gender Female, 50.4%
Sad 50.3%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 4-7
Gender Female, 50.1%
Calm 49.9%
Happy 49.5%
Confused 49.5%
Sad 49.9%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Calm 50.1%
Angry 49.5%
Sad 49.7%
Happy 49.6%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Calm 50.2%
Happy 49.5%
Angry 49.5%
Sad 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Calm 49.6%
Happy 49.5%
Angry 49.6%
Disgusted 49.9%
Surprised 49.5%
Confused 49.5%
Sad 49.8%

AWS Rekognition

Age 12-22
Gender Female, 50.4%
Calm 49.5%
Happy 49.5%
Angry 49.7%
Disgusted 49.7%
Surprised 49.5%
Confused 49.5%
Sad 49.9%

AWS Rekognition

Age 4-9
Gender Female, 50.4%
Calm 49.5%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Sad 50.5%
Confused 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50.5%
Calm 49.5%
Sad 50.1%
Surprised 49.6%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%
Confused 49.6%

AWS Rekognition

Age 14-23
Gender Female, 50.3%
Sad 50.1%
Calm 49.6%
Angry 49.6%
Disgusted 49.6%
Surprised 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.7%
Surprised 49.5%
Disgusted 49.6%
Angry 49.5%
Happy 49.6%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Confused 49.5%
Calm 49.6%
Angry 49.6%
Surprised 49.6%
Sad 50%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Sad 50%
Calm 49.7%
Angry 49.6%
Disgusted 49.5%
Surprised 49.6%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Angry 49.6%
Surprised 49.6%
Happy 49.9%
Disgusted 49.5%
Sad 49.7%
Confused 49.5%
Calm 49.7%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Calm 50.2%
Disgusted 49.5%
Sad 49.6%
Angry 49.6%
Happy 49.5%
Confused 49.6%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Angry 49.6%
Sad 50%
Surprised 49.5%
Confused 49.6%
Disgusted 49.5%
Calm 49.6%
Happy 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Surprised 49.6%
Angry 49.5%
Disgusted 49.6%
Happy 49.6%
Calm 49.7%
Sad 49.9%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.9%
Confused 49.5%
Sad 49.7%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%
Happy 49.7%
Calm 49.6%
Sad 50%
Confused 49.5%

AWS Rekognition

Age 16-27
Gender Male, 50.5%
Calm 49.7%
Confused 49.8%
Sad 49.8%
Surprised 49.6%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.6%
Disgusted 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.6%
Sad 50.1%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Surprised 49.5%
Sad 49.8%
Angry 49.5%
Happy 49.7%
Confused 49.5%
Disgusted 49.5%
Calm 49.9%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Surprised 49.5%
Disgusted 49.6%
Sad 49.7%
Calm 49.9%
Happy 49.5%
Confused 49.6%
Angry 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Surprised 49.5%
Sad 50%
Angry 49.6%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Calm 49.8%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Sad 50.1%
Disgusted 49.6%
Angry 49.6%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Happy 49.7%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Tie 97%

Captions

Microsoft

a group of people in a room 92.4%
a group of people standing in a room 89.7%
a group of people in a large room 89.6%