Human Generated Data

Title

Untitled (four young women, seated, half-length, three-quarter view)
Date

c. 1940
People

Artist: Michael Disfarmer, American 1884 - 1959
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.266

Human Generated Data

Title

Untitled (four young women, seated, half-length, three-quarter view)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Person 99.4
Person 99.3
Person 99.3
Apparel 83.4
Clothing 83.4
People 82.6
Female 77.1
Girl 73.4
Teen 71.6
Face 65.7
Kid 56.9
Child 56.9

Imagga
created on 2022-03-05

kin 75
people 32.3
man 30.9
happy 30.1
male 28.5
smiling 27.5
adult 27.3
couple 25.3
together 24.5
group 24.2
portrait 23.3
person 21.7
happiness 21.1
cheerful 20.3
family 19.6
team 18.8
attractive 18.2
love 18.1
sibling 17.6
child 17.6
lifestyle 17.3
smile 17.1
mother 17.1
two 16.9
women 16.6
business 16.4
men 16.3
home 15.1
businessman 14.1
teamwork 13.9
20s 13.7
businesswoman 13.6
30s 13.5
parent 13
office 12.8
face 12.8
suit 12.6
pretty 12.6
senior 12.2
boy 12.2
standing 12.2
indoors 11.4
businesspeople 11.4
professional 11.3
meeting 11.3
fun 11.2
party 11.2
mature 11.2
husband 11
old 10.4
groom 10.4
friends 10.3
relationship 10.3
youth 10.2
bow tie 9.9
holding 9.9
father 9.9
fashion 9.8
new 9.7
colleagues 9.7
brother 9.7
partnership 9.6
looking 9.6
four 9.6
elderly 9.6
wife 9.5
adults 9.5
sitting 9.4
friendship 9.4
cute 9.3
holiday 9.3
year 9.1
hat 9.1
kid 8.9
success 8.8
working 8.8
tie 8.5
daughter 8.5
laughing 8.5
camera 8.3
indoor 8.2
celebration 8
interior 8
hair 7.9
brunette 7.8
clothing 7.8
black 7.8
table 7.8
40s 7.8
color 7.8
boss 7.6
talking 7.6
necktie 7.5
style 7.4
successful 7.3
children 7.3
dress 7.2
dad 7.2
handsome 7.1
work 7.1
medical 7.1

Google
created on 2022-03-05

Photograph 94.2
Smile 80.5
Vintage clothing 73.8
Event 71.7
Sleeve 71
Classic 68.8
Room 68.7
Fun 66.4
Stock photography 64
History 62.8
Art 57.9
Retro style 56.1
Photographic paper 54.8
Sitting 54.3
Family 53.4
Family reunion 50.8

Microsoft
created on 2022-03-05

person 99.3
human face 99.1
clothing 98.6
text 98.5
wall 97.8
posing 96.9
smile 96.3
woman 92.2
vintage clothing 77
retro style 71.5
old 64.2
portrait 60.6
white 60
group 55.5
picture frame 17.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 69.5%
Happy 97%
Calm 2.1%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 99.7%
Surprised 0.1%
Happy 0.1%
Angry 0.1%
Sad 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-37
Gender Female, 99.3%
Happy 92.9%
Calm 4.6%
Angry 0.9%
Confused 0.6%
Sad 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Male, 97.6%
Calm 99.9%
Happy 0%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

Eva Braun et al. posing for a photo 97.7%
Eva Braun et al. posing for the camera 97.6%
Eva Braun et al. posing for a picture 97.5%