Human Generated Data

Title

Untitled (people socializing in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17786

Human Generated Data

Title

Untitled (people socializing in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.2
Person 99.2
Person 99.2
Person 99.1
Person 99.1
Clinic 97.8
Indoors 88
Room 87.4
Apparel 84.4
Clothing 84.4
Hat 84.4
Hospital 72.5
Operating Theatre 72.5
Doctor 67.2
Surgery 57.6

Imagga
created on 2022-02-26

nurse 49.7
surgeon 42.2
people 36.8
medical 33.5
doctor 31
man 30.9
patient 29.1
person 27.7
medicine 27.3
professional 26.1
hospital 24.9
work 24.3
working 23.8
health 23.6
worker 21.4
negative 20.7
men 20.6
male 20.6
adult 20.4
clinic 18.8
business 18.2
film 17.8
shower cap 17.8
lab 17.5
occupation 17.4
team 17
room 16.8
job 16.8
indoors 16.7
coat 16.1
specialist 15.8
chemical 15.5
laboratory 15.4
cap 15
equipment 15
care 14.8
scientist 14.7
illness 14.3
research 14.3
human 14.2
biology 14.2
clothing 13.6
technology 13.4
science 13.3
uniform 13.3
looking 12.8
surgery 12.7
women 12.7
scientific 12.6
chemistry 12.6
test 12.5
profession 12.4
case 12.4
photographic paper 12.2
sterile 11.8
businessman 11.5
happy 11.3
office 11.2
industry 11.1
headdress 11
portrait 11
chemist 10.8
mask 10.7
instrument 10.2
teamwork 10.2
student 10
operation 9.9
microbiology 9.8
modern 9.8
biotechnology 9.8
assistant 9.7
sick person 9.7
group 9.7
emergency 9.6
development 9.5
corporate 9.4
sitting 9.4
senior 9.4
horizontal 9.2
microscope 8.9
optical 8.7
lifestyle 8.7
day 8.6
lab coat 8.4
20s 8.2
indoor 8.2
photographic equipment 8.2
to 8
smiling 8
researcher 7.9
urban 7.9
shop 7.8
smile 7.8
30s 7.7
casual 7.6
window 7.6
screen 7.5
mature 7.4
computer 7.2
home 7.2
life 7.1
interior 7.1
architecture 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 99.5
clothing 92.4
man 91.7
standing 83.1
wedding 73
wedding dress 71.2
people 66.4
group 56.5
preparing 52.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 68.8%
Happy 75.6%
Calm 14.4%
Sad 6.5%
Angry 1%
Confused 1%
Disgusted 0.7%
Surprised 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 84.4%

Captions

Microsoft

a group of people standing in front of a crowd 88.3%
a group of people standing in a room 88.2%
a group of people standing in front of a crowd of people 87.7%

Text analysis

Amazon

19
SIC
UDVRCOVLETA

Google

19
19