Human Generated Data

Title

Untitled (children's party)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.465

Human Generated Data

Title

Untitled (children's party)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.7
Person 99.6
Person 99.2
Person 99.2
Person 98.7
Person 98.6
Person 97.3
Person 90.6
Female 89.4
Clothing 89.1
Apparel 89.1
Furniture 86.7
Person 85.9
Chair 82.2
Person 77.8
Person 75.2
Woman 69.8
Restaurant 67.6
People 65.8
Girl 65.1
Room 64.9
Indoors 64.9
Kindergarten 64.2
Kid 61.6
Child 61.6
School 59.6
Classroom 59.6
Food 59.1
Meal 59.1
Wood 56.9
Plywood 56.9
Face 56
Sitting 55.8
Skirt 55.5

Imagga
created on 2022-01-23

nurse 72.4
people 34
man 32.3
male 31.3
room 30
person 29.7
home 23.9
adult 23
indoors 22
hospital 21
smiling 20.2
patient 19.9
sitting 18.9
happy 18.8
men 18
business 17.6
together 17.5
couple 17.4
women 17.4
work 17.3
lifestyle 16.6
meeting 16
family 16
professional 16
senior 15.9
table 15.6
child 14.9
teacher 14.7
office 14.6
businesswoman 14.5
talking 14.3
smile 14.2
medical 14.1
businessman 14.1
happiness 14.1
holding 14
mature 13.9
team 13.4
working 13.3
health 13.2
group 12.9
worker 12.7
desk 12.3
doctor 12.2
cheerful 12.2
indoor 11.9
classroom 11.7
businesspeople 11.4
mother 11.2
love 11
two 11
two people 10.7
interior 10.6
new 10.5
husband 10.5
wife 10.4
portrait 10.4
care 9.9
old 9.8
elderly 9.6
corporate 9.4
chair 9.4
teamwork 9.3
20s 9.2
kid 8.9
illness 8.6
clothing 8.5
relationship 8.4
modern 8.4
clinic 8.4
color 8.3
coffee 8.3
school 8
to 8
job 8
standing 7.8
40s 7.8
student 7.8
retired 7.8
retirement 7.7
waiter 7.7
help 7.4
executive 7.4
successful 7.3
looking 7.2
domestic 7.1
life 7

Google
created on 2022-01-23

Photograph 94.2
Dress 89.9
Table 88.6
Standing 86.4
Sharing 82.1
Toddler 81
Adaptation 79.2
Baby 77.5
Vintage clothing 75.5
Snapshot 74.3
Child 73.6
Monochrome 73.2
Event 73.2
Monochrome photography 72.4
Room 71.4
Classic 69.7
Photo caption 63.4
Fun 59.9
House 59.8
Retro style 57.6

Microsoft
created on 2022-01-23

person 99.2
clothing 92.3
child 91.5
indoor 90.5
family 87.8
table 81.3
toddler 80.8
girl 77.3
little 76
woman 73.4
baby 63.8
school 63
human face 62.4
furniture 58.1
smile 50.4
old 48.6
dining table 7.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 75.6%
Angry 83.6%
Calm 7.7%
Sad 2.8%
Confused 2.2%
Disgusted 1.6%
Happy 0.9%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 16-24
Gender Female, 100%
Calm 49.5%
Sad 47.1%
Confused 1.3%
Angry 0.7%
Disgusted 0.5%
Fear 0.5%
Surprised 0.4%
Happy 0.1%

AWS Rekognition

Age 1-7
Gender Male, 99.3%
Calm 97.1%
Sad 1.9%
Disgusted 0.5%
Confused 0.2%
Angry 0.2%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 99.9%
Sad 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 18-24
Gender Male, 56.2%
Sad 69.1%
Calm 29.8%
Confused 0.5%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 4-12
Gender Male, 99.9%
Sad 86.2%
Calm 5.8%
Angry 5.8%
Disgusted 0.8%
Fear 0.6%
Confused 0.5%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Male, 96.7%
Sad 82.3%
Calm 14.3%
Fear 1.9%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 7-17
Gender Female, 99.1%
Sad 49.3%
Surprised 18.8%
Disgusted 11.6%
Calm 8.3%
Fear 5.2%
Angry 4%
Happy 1.7%
Confused 1.1%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of young children sitting around a table 80.1%
a group of young children sitting on a table 72.8%
a group of children sitting at a table 72.7%

Text analysis

Amazon

health
the health
the
DIXIES
They
of
patrens
Salegbood