Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Ohio. Dayton. National Cash Register Company: Welfare Institutions of the National Cash Register Company, Dayton, Ohio: Advantages for Employes' Children.: Girls' Club

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.514.B.4

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Ohio. Dayton. National Cash Register Company: Welfare Institutions of the National Cash Register Company, Dayton, Ohio: Advantages for Employes' Children.: Girls' Club

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Room 100
School 100
Classroom 100
Indoors 100
Chair 99.9
Furniture 99.9
Human 99.6
Person 99.6
Person 99.4
Person 99.1
Person 98.3
Person 97.7
Person 97.1
Person 96
Person 91.8
Person 91.4
Person 88.3
Chair 79.8
Person 62.8
Person 57.9

Imagga
created on 2022-06-25

classroom 100
room 83.1
people 31.2
kin 24.4
man 22.1
person 18.6
women 18.2
group 17.7
male 17.1
men 16.3
interior 15.9
chair 15.8
table 15.6
indoors 14
sitting 13.7
adult 13.2
happy 13.1
friends 13.1
couple 13
smiling 13
school 12.9
business 12.7
restaurant 12.2
home 11.9
indoor 11.8
girls 11.8
students 11.7
student 11.3
child 11.3
education 11.2
teacher 11
lifestyle 10.8
black 10.8
family 10.7
together 10.5
boy 10.4
inside 10.1
building 9.9
fun 9.7
portrait 9.7
urban 9.6
meeting 9.4
work 9.4
learning 9.4
teamwork 9.3
smile 9.2
city 9.1
cheerful 8.9
mother 8.9
studying 8.6
holiday 8.6
communication 8.4
attractive 8.4
study 8.4
old 8.3
drink 8.3
fashion 8.3
teenager 8.2
office 8.2
scene 7.8
drinking 7.6
two 7.6
enjoying 7.6
leisure 7.5
silhouette 7.4
style 7.4
children 7.3
hall 7.2
team 7.2
dinner 7.1
businessman 7.1
happiness 7

Google
created on 2022-06-25

Chair 88.7
Style 83.8
Dress 83.8
Tire 77.2
Monochrome 74.2
Event 73.7
Vintage clothing 72.9
Crew 71.7
Monochrome photography 71.5
Team 70.6
Class 67
Room 64.8
History 63.5
Uniform 60.7
Wheel 60.1
Table 58.4
Curtain 57.1
Sitting 53.4
Family 52.1

Microsoft
created on 2022-06-25

person 99.7
clothing 98.3
indoor 97.3
group 91.5
people 85.4
man 81.9
text 81.3
table 80.2
ceiling 71.9
woman 71.1
smile 63.9
furniture 62.4
posing 35.9
restaurant 21.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 58.5%
Confused 25.8%
Sad 9.1%
Surprised 7.2%
Fear 6.3%
Angry 1.1%
Disgusted 0.7%
Happy 0.4%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 59.5%
Fear 18.5%
Sad 16.8%
Surprised 7.8%
Angry 1.3%
Happy 0.7%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 6-12
Gender Female, 100%
Confused 62.2%
Calm 20.3%
Surprised 9.8%
Fear 6.9%
Sad 5.1%
Angry 1.2%
Disgusted 1%
Happy 0.7%

AWS Rekognition

Age 20-28
Gender Female, 98.9%
Calm 88%
Confused 7.7%
Surprised 6.3%
Fear 5.9%
Sad 3.4%
Angry 0.5%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Female, 99.8%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Female, 99.4%
Calm 93.9%
Surprised 6.4%
Fear 6.2%
Sad 3.8%
Confused 0.3%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Female, 98.1%
Sad 99%
Calm 24.1%
Surprised 10.1%
Fear 6.5%
Confused 4.1%
Disgusted 3.1%
Angry 2.1%
Happy 0.4%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 4-10
Gender Female, 99.7%
Sad 99.8%
Calm 25.6%
Surprised 6.5%
Fear 6.2%
Confused 1.6%
Angry 1.4%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 79.1%
Confused 10.3%
Surprised 6.7%
Fear 6.5%
Sad 3.7%
Disgusted 1.9%
Angry 1.7%
Happy 0.7%

AWS Rekognition

Age 19-27
Gender Male, 94.7%
Sad 98.3%
Calm 29.7%
Fear 9.6%
Surprised 6.9%
Confused 2.9%
Disgusted 1.2%
Angry 1.1%
Happy 0.8%

AWS Rekognition

Age 23-33
Gender Male, 87.3%
Sad 100%
Surprised 6.3%
Fear 6.2%
Angry 2.9%
Calm 1.5%
Disgusted 0.3%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Sad 100%
Surprised 6.4%
Fear 6.1%
Confused 3.9%
Calm 0.5%
Angry 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 2-10
Gender Female, 100%
Fear 96.6%
Surprised 6.6%
Sad 3.6%
Calm 2.3%
Disgusted 0.8%
Angry 0.7%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Female, 86.1%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 67.3%
Surprised 14.9%
Confused 14%
Fear 6.7%
Happy 2.6%
Sad 2.5%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 20-28
Gender Female, 97.7%
Sad 78.2%
Calm 54.8%
Surprised 6.6%
Fear 6.1%
Angry 5.3%
Confused 1.5%
Disgusted 1%
Happy 0.5%

AWS Rekognition

Age 30-40
Gender Female, 85.8%
Confused 86.1%
Surprised 9.3%
Fear 6%
Calm 2.6%
Sad 2.4%
Happy 2.2%
Angry 1.7%
Disgusted 1.1%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 77.5%
Sad 28.4%
Surprised 6.4%
Fear 6%
Confused 0.6%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 94.6%
Calm 77.5%
Fear 9%
Surprised 8.4%
Sad 4.3%
Disgusted 4.3%
Angry 1.4%
Happy 0.7%
Confused 0.6%

AWS Rekognition

Age 28-38
Gender Female, 90.5%
Sad 88.5%
Calm 43.8%
Angry 9.6%
Surprised 6.9%
Fear 6.2%
Disgusted 2.5%
Happy 0.7%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Sad 54.3%
Calm 32.5%
Surprised 11.4%
Fear 8.3%
Disgusted 7.5%
Happy 7.1%
Confused 7.1%
Angry 4.6%

AWS Rekognition

Age 30-40
Gender Female, 89.7%
Confused 94.9%
Surprised 6.6%
Fear 6%
Sad 2.9%
Calm 0.8%
Angry 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 99.2%
Calm 91.9%
Surprised 6.4%
Fear 6%
Sad 4.8%
Happy 0.8%
Confused 0.6%
Angry 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.9%
Person 99.6%

Captions

Microsoft

a group of people standing in a room 98.7%
a group of people in a room 98.6%
a group of people sitting and standing in a room 98.4%

Text analysis

Google

30