Human Generated Data

Title

Untitled (family portrait of five: grandparents, parents, and baby)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6937

Human Generated Data

Title

Untitled (family portrait of five: grandparents, parents, and baby)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.6
Person 99.3
Person 99.1
People 98.3
Family 97.9
Person 95
Sitting 56.5

Imagga
created on 2022-01-23

bow tie 47.7
kin 40.7
man 40.3
necktie 39.2
male 35.8
person 33.8
people 29
adult 28.2
portrait 25.9
happy 23.2
family 23.1
smiling 22.4
men 21.5
senior 19.7
couple 19.2
mother 18.9
business 18.8
garment 18.8
businessman 18.5
home 18.3
office 17.7
mature 17.7
professional 17.6
lifestyle 17.3
clothing 17.2
father 16.8
attractive 16.1
child 15.7
group 15.3
black 15
smile 15
looking 14.4
tie 14.2
love 14.2
casual 13.6
face 13.5
elderly 13.4
meeting 13.2
work 12.6
team 12.5
old 12.5
brunette 12.2
boy 12.2
success 12.1
nurse 11.6
son 11.3
sitting 11.2
executive 11.1
suit 10.8
husband 10.7
parent 10.6
job 10.6
30s 10.6
together 10.5
health 10.4
corporate 10.3
hair 10.3
women 10.3
happiness 10.2
daughter 10
businesswoman 10
aged 9.9
room 9.8
dad 9.5
expression 9.4
youth 9.4
successful 9.1
fashion 9
human 9
cheerful 8.9
medical 8.8
standing 8.7
golfer 8.7
guy 8.6
wife 8.5
desk 8.5
pretty 8.4
teamwork 8.3
planner 8.2
confident 8.2
lady 8.1
grandfather 8
indoors 7.9
retired 7.8
eyes 7.7
retirement 7.7
boss 7.6
player 7.6
businesspeople 7.6
doctor 7.5
joy 7.5
fun 7.5
shirt 7.5
manager 7.4
holding 7.4
care 7.4
glasses 7.4
buddy 7.4
interior 7.1
working 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

human face 99.5
person 99.4
wall 99.3
clothing 97.2
smile 96.9
indoor 96.5
text 91.3
baby 85.7
man 82.1
posing 80.8
boy 66.8
people 64.5
toddler 56.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Female, 99%
Calm 87.3%
Happy 10.8%
Sad 0.5%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 98.9%
Angry 0.4%
Confused 0.2%
Sad 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 49-57
Gender Male, 100%
Sad 74.1%
Calm 21.6%
Confused 2.7%
Fear 0.7%
Surprised 0.3%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 78-88
Gender Male, 99.3%
Calm 95.1%
Angry 3.4%
Sad 0.8%
Fear 0.3%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 0-3
Gender Male, 99.9%
Calm 99.1%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 98.6%
a group of people posing for the camera 98.5%
a group of people posing for a picture 98.4%