Human Generated Data

Title

Untitled (woman and children around piano)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17952

Human Generated Data

Title

Untitled (woman and children around piano)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 99.7
Human 99.7
Person 99.6
Person 99.2
Person 99
Clinic 98.9
Person 98.8
Hospital 95.4
Operating Theatre 92.3
Doctor 57.2
Clothing 56.7
Apparel 56.7

Imagga
created on 2022-03-04

nurse 100
patient 49.3
person 44
man 41.7
people 36.3
male 34.8
medical 33.6
professional 32.1
adult 29.5
doctor 29.2
coat 26.8
businessman 25.6
hospital 23.9
lab coat 23.8
health 23.6
case 23.6
team 23.3
worker 23.3
sick person 23.1
men 22.3
work 22
business 21.9
job 21.2
indoors 20.2
happy 19.4
medicine 19.4
office 19.3
smiling 18.8
teamwork 18.6
working 17.7
corporate 17.2
businesspeople 17.1
clinic 17
senior 16.9
couple 15.7
specialist 15.7
occupation 15.6
lab 15.6
sitting 15.5
businesswoman 15.5
laboratory 15.4
group 15.3
women 15
day 14.9
colleagues 14.6
meeting 14.1
table 13.9
room 13.8
scientist 13.7
illness 13.4
research 13.3
desk 13.2
lifestyle 13
indoor 12.8
40s 12.7
assistant 12.6
chemistry 12.6
color 12.2
bright 12.2
clothing 11.9
casual 11.9
suit 11.7
portrait 11.7
chemical 11.6
30s 11.6
care 11.5
talking 11.4
biology 11.4
face 11.4
education 11.3
looking 11.2
mature 11.2
science 10.7
test 10.6
elderly 10.5
standing 10.4
manager 10.2
happiness 10.2
two 10.2
student 10.1
holding 9.9
doctors 9.8
coworkers 9.8
50s 9.8
two people 9.7
scientific 9.7
technology 9.7
mid adult 9.7
together 9.6
angle 9.6
profession 9.6
adults 9.5
smile 9.3
focus 9.3
communication 9.2
successful 9.2
executive 9.1
human 9
70s 8.9
associates 8.9
forties 8.8
casual clothing 8.8
home 8.8
daytime 8.7
exam 8.6
instrument 8.5
modern 8.4
inside 8.3
20s 8.3
cheerful 8.1
surgeon 8.1
success 8
teacher 8
to 8
interior 8
equipment 7.9
chemist 7.9
days 7.8
surgery 7.8
expertise 7.8
sick 7.7
life 7.7
workplace 7.6
development 7.6
uniform 7.6
horizontal 7.5
clothes 7.5
emotion 7.4
treatment 7.4
confident 7.3
computer 7.2
look 7
attractive 7

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

clothing 96.6
human face 94.9
man 91.1
person 88.2
smile 78.1
text 75.7

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 74.4%
Happy 98.5%
Surprised 0.5%
Calm 0.4%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 48-54
Gender Female, 96%
Calm 67.8%
Sad 19.6%
Happy 8.1%
Confused 1.4%
Disgusted 1.1%
Fear 0.7%
Surprised 0.7%
Angry 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Happy 91.7%
Sad 4.1%
Calm 2.5%
Surprised 0.5%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 6-14
Gender Male, 97.4%
Calm 53.4%
Happy 17.3%
Surprised 10.7%
Sad 7.7%
Angry 4%
Fear 3.7%
Disgusted 2.6%
Confused 0.7%

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Happy 57.5%
Surprised 22.1%
Sad 10.7%
Angry 3.5%
Confused 1.9%
Disgusted 1.9%
Calm 1.4%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 81.8%
a group of people posing for the camera 81.7%
a group of people posing for a picture 81.6%

Text analysis

Amazon

KODAK-SVLELA
b

Google

10
10