Human Generated Data

Title

Untitled (New York City)
Date

1932-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3006
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 100
Apparel 100
Hat 99.9
Human 99
Person 99
Sun Hat 91.9
Cowboy Hat 78.6
Coat 56.1
Overcoat 56.1

Clarifai
created on 2018-03-23

people 99.8
adult 98.3
man 97
one 97
lid 97
wear 95.6
two 94.5
veil 94.2
three 93
group together 90.8
portrait 87.2
woman 86.4
actor 85.6
four 85.2
group 85.2
leader 85.2
retro 84.9
five 84.1
outfit 79.8
war 79.4

Imagga
created on 2018-03-23

ruler 45.1
man 30.2
male 26.9
old 26.5
portrait 25.2
hat 21.2
person 20.3
metropolitan 19.1
face 15.6
people 15.1
close 14.3
vintage 14
ancient 13
adult 12.3
black 11.4
human 11.2
senior 11.2
one 11.2
culture 11.1
history 10.7
sculpture 10.6
clothing 9.5
statue 9.5
men 9.4
historical 9.4
model 9.3
grandfather 9.3
beard 9.2
world 9.2
art 9.1
religion 9
headdress 8.9
eyes 8.6
smile 8.5
expression 8.5
head 8.4
dark 8.3
hair 7.9
wall 7.7
grunge 7.7
happy 7.5
closeup 7.4
blond 7.2

Google
created on 2018-03-23

photograph 95.2
human behavior 82.5
black and white 73.1
vision care 67.8
glasses 64.8
vintage clothing 63.2
eyewear 60.3

Microsoft
created on 2018-03-23

person 98.5
hat 74.6

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 98.6%
Confused 8%
Surprised 3.5%
Happy 0.8%
Angry 15.5%
Disgusted 2.6%
Sad 30.3%
Calm 39.4%

Feature analysis

Amazon

Hat 99.9%
Person 99%

Captions

Microsoft

a man wearing a hat 91.4%
a man wearing a black hat 87.1%
a man wearing a hat looking at the camera 85.6%