Human Generated Data

Title

Untitled (studio portrait of two young men sitting in chair and standing)

Date

c. 1905

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3880

Human Generated Data

Title

Untitled (studio portrait of two young men sitting in chair and standing)

People

Artist: Durette Studio, American 20th century

Date

c. 1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.6
Clothing 99.6
Person 98.2
Human 98.2
Person 96.1
Shirt 93.9
Coat 87
Tie 85.3
Accessories 85.3
Accessory 85.3
Overcoat 82
Suit 82
Dress Shirt 74.2
Lab Coat 68.4
Drawing 66.8
Art 66.8
Text 64.4
Tuxedo 61.4

Clarifai
created on 2019-06-01

people 99.9
scientist 99.3
adult 98.9
man 98.2
portrait 96.2
one 96
group 95.3
leader 94.5
science 93.1
wear 91.9
two 91.4
administration 90.8
medical practitioner 88.4
group together 88.3
coat 87.8
outfit 85.7
three 85.1
outerwear 81.6
facial expression 79.6
several 78.9

Imagga
created on 2019-06-01

coat 100
lab coat 100
garment 61.7
doctor 57.4
medical 54.8
man 44.4
hospital 43.3
male 42.6
professional 40.2
medicine 39.7
person 36.3
health 34.8
clinic 34.5
stethoscope 33.9
nurse 33.6
clothing 33
people 31.8
care 30.5
uniform 30.4
adult 29.4
portrait 28.5
work 27.5
laboratory 27
occupation 25.7
profession 24.9
job 24.8
specialist 24.5
happy 23.8
lab 22.4
smiling 21
looking 20.8
men 20.6
mature 20.5
practitioner 20.2
worker 19.7
smile 19.3
scientist 18.6
confident 18.2
senior 17.8
office 17.7
bright 17.2
clinical 16.6
business 16.4
face 16.4
research 16.2
team 16.1
handsome 16.1
student 15.6
elderly 15.3
surgeon 15.3
businessman 15
standing 14.8
physician 14.7
chemistry 14.5
science 14.2
working 14.2
friendly 13.7
indoor 13.7
assistant 13.6
chemical 13.6
look 13.1
expertise 12.6
attractive 12.6
day 12.6
biology 12.3
indoors 12.3
equipment 12.2
success 12.1
teamwork 12.1
one 12
colleagues 11.7
patient 11.7
health care 11.7
exam 11.5
cheerful 11.4
instrument 11.3
human 11.3
computer 11.2
technology 11.1
treatment 11
successful 11
doctors 10.8
holding 10.7
consultant 10.7
examination 10.7
scientific 10.7
test 10.6
color 10.6
development 10.5
education 10.4
glasses 10.2
general practitioner 9.9
group 9.7
staff 9.6
illness 9.5
happiness 9.4
light 9.4
associates 8.9
expert 8.9
medic 8.8
women 8.7
serious 8.6
businesspeople 8.6
desk 8.5
modern 8.4
suit 8.2
healthy 8.2
chemist 7.9
general 7.9
clipboard 7.9
heal 7.9
analysis 7.8
corporate 7.7
30s 7.7
old 7.7
only 7.6
casual 7.6
two 7.6
shirt 7.6
study 7.5
camera 7.4
laptop 7.3
lifestyle 7.2

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 99.6
sketch 98.4
drawing 97.9
human face 92.5
old 87.8
clothing 87.6
man 87.1
person 85.9
black and white 85.6
white 85.3
black 83.7
suit 71.3
portrait 58.8
posing 56
vintage 29.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 94.7%
Angry 1.5%
Sad 57.5%
Disgusted 0.5%
Happy 0.4%
Calm 38.2%
Surprised 0.5%
Confused 1.3%

AWS Rekognition

Age 26-43
Gender Male, 97.9%
Disgusted 3.4%
Sad 10.2%
Happy 29%
Confused 6%
Surprised 8.6%
Angry 6.3%
Calm 36.6%

Feature analysis

Amazon

Person 98.2%
Tie 85.3%

Captions

Microsoft

a black and white photo of a person 97.3%
an old black and white photo of a person 97.1%
a vintage photo of a person 97%