Human Generated Data

Title

Untitled (grandparents holding two grandchildren)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16939

Human Generated Data

Title

Untitled (grandparents holding two grandchildren)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.7
Clothing 99.7
Human 99.4
Person 99.4
Person 98.6
Person 98.4
Person 97.4
Chair 94.8
Furniture 94.8
Suit 90.6
Overcoat 90.6
Coat 90.6
Female 85.5
Dress 81.9
Face 78.5
Person 75.9
Shirt 75.5
Indoors 75
Woman 72
Sleeve 67.5
Gown 67.2
Fashion 67.2
People 64.9
Robe 64.5
Man 63
Room 62.4
Wedding 61.3
Photography 60.9
Photo 60.9
Wedding Gown 58.7
Girl 57.9
Tuxedo 57.7
Bridegroom 56.4

Imagga
created on 2022-02-26

people 34.6
nurse 32.2
man 32.2
medical 29.1
person 28.1
doctor 25.4
adult 24.9
male 24.8
professional 24.3
medicine 22
laboratory 21.2
work 21.2
worker 20.8
health 18.7
science 18.7
research 18.1
men 18
human 17.2
women 16.6
lab 16.5
hospital 16.4
shower cap 16.1
scientist 14.7
chemistry 14.5
equipment 14.1
cap 13.8
happy 13.8
chemical 13.6
team 13.4
working 13.2
surgeon 13.2
sitting 12.9
clinic 12.6
clothing 12.6
uniform 12.6
happiness 12.5
mask 12.5
biology 12.3
portrait 12.3
looking 12
student 11.9
occupation 11.9
scientific 11.6
patient 11.6
smiling 11.6
business 11.5
care 11.5
development 11.4
education 11.2
senior 11.2
coat 11.2
life 11.1
negative 10.9
headdress 10.8
surgery 10.7
test 10.6
indoors 10.5
couple 10.4
technology 10.4
metropolitan 10.2
suit 9.9
job 9.7
profession 9.6
illness 9.5
industry 9.4
teamwork 9.3
face 9.2
room 9.2
hand 9.1
modern 9.1
holding 9.1
old 9
cheerful 8.9
surgical 8.9
chemist 8.8
biotechnology 8.8
businessman 8.8
technician 8.8
hair 8.7
emergency 8.7
elderly 8.6
spectator 8.6
film 8.6
instrument 8.5
casual 8.5
specialist 8.4
glasses 8.3
home 8
groom 7.9
love 7.9
researcher 7.9
operation 7.9
sterile 7.9
experiment 7.8
tube 7.7
two 7.6
study 7.5
office 7.4
protection 7.3
smile 7.1
together 7
look 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 99.5
text 97.5
clothing 90.4
musical instrument 83.9
man 73

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98.2%
Calm 73%
Surprised 22.7%
Happy 1.3%
Angry 1%
Sad 0.7%
Confused 0.7%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 83.7%
Sad 13.1%
Happy 1.6%
Angry 0.6%
Surprised 0.4%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Female, 68.1%
Calm 91.2%
Sad 8.4%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 97.6%
Calm 97.1%
Surprised 1.6%
Fear 0.6%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people standing in front of a window 91.9%
a group of people standing in front of a mirror 89.3%
a group of people standing in front of a mirror posing for the camera 82.3%

Text analysis

Amazon

a
LIFK
JASCO 20221A LIFK
20221A
JASCO