Human Generated Data

Title

Untitled (studio portrait of four men in formal attire)

Date

c. 1905

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3883

Human Generated Data

Title

Untitled (studio portrait of four men in formal attire)

People

Artist: Durette Studio, American 20th century

Date

c. 1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 98.7
Clothing 98.7
Accessory 98.1
Tie 98.1
Accessories 98.1
Human 96.7
Person 96.7
Person 93.9
Tie 84.4
Coat 83
Person 81.8
Shirt 75.4
Overcoat 71.6
Person 68.8
Lab Coat 67
Scientist 63.1
Suit 62.9
Face 61.8
Chef 56.4
Tie 52.4

Clarifai
created on 2019-06-01

people 99.9
adult 99.2
group 99
man 98.7
group together 98.2
wear 94.7
two 93.6
one 93.4
portrait 93.3
leader 92.2
administration 89.2
three 88.9
woman 87.3
several 85.8
outfit 83.2
four 81.7
medical practitioner 81.4
five 80.5
facial expression 79.8
veil 79.5

Imagga
created on 2019-06-01

lab coat 100
coat 100
garment 65.9
doctor 57.3
medical 49.4
man 47
hospital 43.2
professional 41.6
male 41.1
medicine 39.6
clothing 35.5
person 33.2
health 32.6
care 32.1
occupation 32.1
stethoscope 30.2
adult 29.9
clinic 29.7
job 29.2
people 28.4
uniform 24.7
work 24.3
happy 23.8
nurse 23.5
practitioner 22.5
laboratory 22.2
portrait 22
lab 19.4
looking 19.2
profession 19.1
handsome 18.7
mature 18.6
business 18.2
confident 18.2
smiling 18.1
research 18.1
men 18
businessman 17.7
specialist 17.5
elderly 17.2
smile 17.1
team 17
office 16.9
working 16.8
patient 16.8
scientist 16.6
necktie 16.5
expertise 16.5
physician 15.6
worker 15.5
bow tie 15.5
doctors 14.7
clinical 14.6
friendly 14.6
student 14.5
science 14.2
face 14.2
senior 14.1
attractive 14
surgeon 12.9
bright 12.9
colleagues 12.6
health care 12.6
chemistry 12.6
exam 12.4
staff 12.4
holding 12.4
teamwork 12
human 12
successful 11.9
happiness 11.7
examination 11.7
treatment 11
two 11
cheerful 10.6
confidence 10.5
group 10.5
couple 10.4
standing 10.4
computer 10.4
technology 10.4
corporate 10.3
indoor 10
chemical 9.7
success 9.7
test 9.6
30s 9.6
illness 9.5
education 9.5
businesspeople 9.5
color 9.5
glasses 9.3
general practitioner 8.9
associates 8.9
indoors 8.8
experiment 8.8
consultant 8.8
look 8.8
assistant 8.7
practice 8.7
women 8.7
day 8.6
serious 8.6
biology 8.5
expression 8.5
hand 8.4
healthy 8.2
lifestyle 7.9
biotechnology 7.8
healing 7.8
diagnosis 7.8
businessmen 7.8
scientific 7.7
cooperation 7.7
casual 7.6
shirt 7.5
lady 7.3

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 99.5
sketch 93.7
drawing 92.6
white 86.2
old 85.3
black 81.5
black and white 71.1
man 67.9
human face 67.3
vintage 35.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 99.5%
Angry 2.7%
Sad 1.5%
Disgusted 1%
Surprised 1.8%
Happy 1.4%
Calm 86.7%
Confused 5%

AWS Rekognition

Age 26-43
Gender Male, 97%
Surprised 15.7%
Happy 18.5%
Disgusted 8.2%
Calm 35.5%
Sad 7.8%
Confused 6.4%
Angry 7.8%

AWS Rekognition

Age 26-43
Gender Male, 99.8%
Disgusted 2.1%
Sad 12.8%
Confused 7%
Happy 14.7%
Angry 4%
Surprised 7.5%
Calm 51.9%

AWS Rekognition

Age 26-43
Gender Male, 97.8%
Disgusted 3.2%
Calm 39.6%
Sad 26.1%
Confused 18.1%
Angry 3.2%
Surprised 4.2%
Happy 5.6%

Feature analysis

Amazon

Tie 98.1%
Person 96.7%

Captions

Microsoft

a black and white photo of a person 93.6%
a group of people posing for a photo 93.2%
a vintage photo of a person 93.1%