Human Generated Data

Title

Untitled (two men standing with hats, coats, and gloves)

Date

c. 1930

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4256

Human Generated Data

Title

Untitled (two men standing with hats, coats, and gloves)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Coat 100
Clothing 100
Apparel 100
Coat 99.1
Human 97.9
Person 97.9
Person 97.5
Home Decor 92.5
Overcoat 90.7
Suit 89
Linen 88.6
Sleeve 86.3
Accessory 85.6
Tie 85.6
Accessories 85.6
Tie 83.7
Hat 73.4
Long Sleeve 70.9
Shirt 62.6
Face 60
Steamer 58.3
Tuxedo 57.8
Sailor Suit 56.9

Clarifai
created on 2019-06-01

people 99.7
wear 96.4
adult 96.4
coat 95.6
uniform 94.9
man 94.6
woman 92
scientist 90.5
administration 90.3
leader 89.1
military 85
two 85
group 84.8
portrait 84.5
lid 84
group together 83.4
one 82.8
retro 82.5
outfit 81.6
child 81.3

Imagga
created on 2019-06-01

lab coat 100
coat 100
garment 72.2
man 42.4
clothing 41.5
doctor 39.5
male 37.6
medical 36.2
professional 33.9
adult 32.4
person 31.7
hospital 31
people 27.9
portrait 27.8
medicine 27.3
stethoscope 25
nurse 24
smiling 23.9
health 23.6
uniform 21.5
smile 21.4
happy 21.3
clinic 21.1
looking 20.8
men 20.6
care 19.8
work 19.6
job 19.5
occupation 19.3
businessman 18.6
business 18.2
handsome 17.8
attractive 17.5
profession 17.2
worker 17
office 16.9
standing 15.7
lab 15.5
face 14.9
friendly 14.6
confident 14.6
one 14.2
laboratory 13.5
team 13.4
holding 13.2
indoors 12.3
shirt 12.1
corporate 12
working 11.5
human 11.2
mature 11.2
physician 10.7
patient 10.6
elderly 10.5
staff 10.5
practitioner 10.5
research 10.5
success 10.5
senior 10.3
happiness 10.2
20s 10.1
successful 10.1
indoor 10
color 10
bright 10
hand 9.9
doctors 9.8
suit 9.8
look 9.6
30s 9.6
day 9.4
casual 9.3
teamwork 9.3
student 9.2
science 8.9
scientist 8.8
clinical 8.8
health care 8.7
women 8.7
mid adult 8.7
confidence 8.6
serious 8.6
businesspeople 8.5
career 8.5
modern 8.4
camera 8.3
jacket 8.3
cheerful 8.1
lifestyle 8
general practitioner 7.9
consultant 7.8
colleagues 7.8
expertise 7.8
expression 7.7
only 7.6
two 7.6
tie 7.6
treatment 7.3
black 7.2
computer 7.2
home 7.2
specialist 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 99.3
coat 96.1
posing 96
man 93.9
standing 92.5
clothing 91.1
black and white 75.4
fashion 59.1
smile 50.5
old 40

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 65.9%
Confused 1.8%
Disgusted 1.8%
Happy 6.8%
Surprised 2%
Calm 11.3%
Sad 72.9%
Angry 3.3%

Feature analysis

Amazon

Coat 100%
Person 97.9%
Tie 85.6%
Hat 73.4%

Captions

Microsoft

a man and woman posing for a photo 89.4%
a man and a woman posing for a photo 89.3%
a person standing in front of a group of people posing for a photo 89.2%