Human Generated Data

Title

Untitled (woman and man performing skit, woman holding money)

Date

1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4190

Human Generated Data

Title

Untitled (woman and man performing skit, woman holding money)

People

Artist: Durette Studio, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Apparel 99.2
Clothing 99.2
Person 98.4
Shoe 94.1
Footwear 94.1
Coat 84.2
Hat 82.3
Female 79.9
Dress 78.6
Woman 64.1
Leisure Activities 62.1
Photography 61.1
Photo 61.1
Finger 59.9
Dance 56.5
Shirt 56.4

Clarifai
created on 2019-06-01

people 99.8
two 97.9
adult 97.8
wear 97.1
woman 95
one 94.8
man 92.1
group 91.7
portrait 91.2
actor 90.8
three 89.7
retro 84.7
outfit 83.7
actress 83.1
music 82.2
group together 81.9
uniform 81.4
costume 81.3
lid 80.8
facial expression 79.7

Imagga
created on 2019-06-01

bow tie 59
necktie 47.6
man 41
suit 38.1
male 37.6
garment 36.9
business 35.8
person 34.2
adult 33.5
people 33.5
professional 33
businessman 32.7
attractive 30.8
corporate 29.2
clothing 25.9
happy 25.7
nurse 25.7
smile 25.7
portrait 24
standing 23.5
success 23.3
secretary 23.3
successful 22.9
executive 21.4
looking 20.8
handsome 20.5
coat 20.5
confident 20
job 18.6
pretty 18.2
office 17.7
smiling 17.4
work 17.3
worker 16.9
tie 16.1
businesswoman 15.5
human 15
formal 14.3
businesspeople 14.2
one 14.2
model 14
jacket 13.9
lady 13.8
lab coat 13.8
men 13.7
women 13.5
boss 13.4
manager 13
casual 12.7
black 12.6
modern 12.6
team 12.5
employee 12.4
career 12.3
elegant 12
occupation 11.9
friendly 11.9
style 11.9
stand 11.4
fashion 11.3
teamwork 11.1
expression 11.1
full 11
lifestyle 10.8
face 10.7
studio 10.6
hand 10.6
cheerful 10.6
together 10.5
look 10.5
ethnic 10.5
couple 10.5
hands 10.4
body 10.4
meeting 10.4
20s 10.1
pose 10
uniform 9.9
posing 9.8
waiter 9.8
medical 9.7
diversity 9.6
building 9.5
happiness 9.4
doctor 9.4
shirt 9.3
alone 9.1
holding 9.1
talking 8.6
fashionable 8.5
youth 8.5
smart 8.5
hospital 8.5
joy 8.4
color 8.3
stethoscope 8.3
stylish 8.1
group 8.1
to 8
hair 7.9
bright 7.9
vertical 7.9
fresh 7.8
dining-room attendant 7.8
partner 7.7
partnership 7.7
profession 7.7
health 7.6
two 7.6
guy 7.5
company 7.4
glasses 7.4
indoor 7.3
sexy 7.2
cute 7.2
cool 7.1
medicine 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 98.8
woman 92.1
clothing 91.5
posing 89.6
standing 77.4
dress 75.9
player 75.2
black 69.6
white 66.1
old 61.7
footwear 58.9
dressed 51
clothes 17.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 94.2%
Surprised 10.8%
Sad 5%
Angry 17%
Disgusted 4.3%
Calm 42%
Happy 15.3%
Confused 5.6%

AWS Rekognition

Age 35-52
Gender Female, 95%
Confused 3.5%
Happy 4.3%
Surprised 2%
Angry 5%
Disgusted 15.9%
Calm 48.4%
Sad 20.8%

Feature analysis

Amazon

Person 99.6%
Shoe 94.1%
Coat 84.2%
Hat 82.3%

Captions

Microsoft

a vintage photo of a person wearing a black dress 93.1%
a vintage photo of a person in a black dress 93%
a person wearing a black dress posing for a photo 92.9%

Text analysis

Amazon

A3AA