Human Generated Data

Title

Untitled (four men standing with hats, coats, and gloves)

Date

c. 1930

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4253

Human Generated Data

Title

Untitled (four men standing with hats, coats, and gloves)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.9
Person 98.9
Person 98
Person 97.6
Person 96.4
Apparel 94.9
Clothing 94.9
Accessories 91.6
Accessory 91.6
Tie 91.6
Tie 88.2
Tie 82.3
Outdoors 79.2
Nature 75
Hat 71.2
Hat 70.5
Sleeve 66.1
Military Uniform 64.4
Military 64.4
Photography 61.8
Face 61.8
Photo 61.8
Portrait 61.8
Coat 59.9
Text 59.3
People 56.5

Clarifai
created on 2019-06-01

people 99.5
man 96.2
adult 93.8
monochrome 92.4
wear 91.7
group 90.7
group together 89.2
woman 87.5
child 87.1
retro 83.8
vertical 83.6
military 82.1
administration 80.9
portrait 79.1
war 78.6
uniform 73.7
vintage 72.4
old 71.4
several 71
leader 69.4

Imagga
created on 2019-06-01

lab coat 100
coat 96.5
garment 45.7
clothing 42.9
doctor 42.3
uniform 38.6
medical 37.1
hospital 35.7
man 35
male 34.1
adult 33
professional 31.7
nurse 28.6
person 27.5
medicine 27.3
clinic 27.1
health 27.1
people 25.1
care 24.7
portrait 24.6
military uniform 24.2
looking 24
stethoscope 22.4
smiling 21.7
happy 21.3
job 21.2
business 20.7
work 20.4
men 19.8
attractive 19.6
businessman 19.4
smile 18.5
occupation 18.3
office 17.7
worker 16.7
confident 15.5
indoors 14.9
face 14.9
doctors 14.7
corporate 14.6
handsome 14.3
suit 14.2
standing 13.9
20s 13.7
indoor 12.8
clinical 12.7
expertise 12.6
jacket 12.6
team 12.5
mid adult 12.5
profession 12.4
working 12.4
lifestyle 12.3
patient 11.9
casual 11.9
day 11.8
happiness 11.8
physician 11.7
consultant 11.7
lab 11.7
laboratory 11.6
confidence 11.5
covering 11.4
mature 11.2
color 11.1
teamwork 11.1
camera 11.1
practitioner 11
general practitioner 10.9
consumer goods 10.8
good mood 10.8
bright 10.7
cheerful 10.6
elderly 10.5
illness 10.5
one 10.5
career 10.4
women 10.3
friendly 10.1
assistant 9.7
30s 9.6
ethnic 9.5
tie 9.5
shirt 9.3
hand 9.1
businesswoman 9.1
holding 9.1
expert 8.9
success 8.9
heal 8.8
examining 8.8
employee 8.8
look 8.8
2 8.7
brunette 8.7
corporation 8.7
partnership 8.6
exam 8.6
staff 8.6
serious 8.6
businesspeople 8.5
human 8.2
executive 8
clinician 7.9
associates 7.9
black 7.8
colleagues 7.8
instrument 7.7
two 7.6
research 7.6
adults 7.6
student 7.5
successful 7.3
surgeon 7.3
computer 7.2
building 7.1
specialist 7.1
clipboard 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 96.5
clothing 87
window 83.1
posing 79
black and white 73.4
man 69.8
old 43.5

Face analysis

Amazon

AWS Rekognition

Age 4-7
Gender Female, 96.7%
Happy 3.5%
Sad 63.3%
Surprised 4.6%
Confused 5.7%
Disgusted 4.6%
Calm 13.8%
Angry 4.5%

AWS Rekognition

Age 26-43
Gender Male, 95.4%
Disgusted 0.8%
Confused 2.1%
Surprised 1.8%
Calm 82.5%
Happy 1%
Angry 2%
Sad 9.8%

AWS Rekognition

Age 27-44
Gender Female, 70.3%
Calm 15.5%
Surprised 2%
Disgusted 3.3%
Happy 2.6%
Sad 69.3%
Confused 2.5%
Angry 4.6%

Feature analysis

Amazon

Person 98.9%
Tie 91.6%
Hat 71.2%
Coat 59.9%

Captions

Microsoft

a group of people posing for a photo 91.2%
a group of people posing for a photo in front of a window 87.9%
a group of people posing for the camera 87.8%