Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

Date

1934-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2810

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 99.7
Apparel 99.7
Person 98.7
Human 98.7
Hat 98.3
Person 94.3
Coat 74.6
Face 73.7
Overcoat 70.9
Wood 66.2
Cap 60.1
Sun Hat 59.6
Hat 57.9

Clarifai
created on 2018-03-23

people 100
adult 99.1
one 98.8
wear 96.6
man 96.1
portrait 95.6
two 94.7
veil 93.5
lid 92.9
administration 91.5
woman 91.1
outfit 90.7
leader 90.1
military 89.4
actor 88.6
elderly 86.1
three 85.8
soldier 84.6
uniform 83.9
war 83.3

Imagga
created on 2018-03-23

crutch 100
staff 94.7
stick 71.7
man 24.9
statue 22.9
old 21.6
religion 17.9
sculpture 17.2
person 16.5
art 16.3
people 15.6
male 15.6
portrait 14.9
adult 13.6
god 13.4
black 13.2
face 12.8
culture 12
history 11.6
city 10.8
prayer 10.6
holy 10.6
travel 10.6
ancient 10.4
historical 10.3
building 10.3
church 10.2
architecture 10.1
brass 10.1
clothing 10
vintage 9.9
uniform 9.5
religious 9.4
monument 9.3
historic 9.2
holding 9.1
hat 9.1
helmet 8.7
military uniform 8.7
spiritual 8.6
golden 8.6
men 8.6
stone 8.4
trombone 8.4
fashion 8.3
tourism 8.2
one 8.2
figure 8.1
worker 8
indoors 7.9
work 7.8
worship 7.7
faith 7.6
human 7.5
famous 7.4
gold 7.4

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.4
man 94.3
old 64.4
older 21.9

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 57-77
Gender Male, 68.6%
Calm 60.9%
Sad 13.5%
Confused 2.4%
Disgusted 9.7%
Happy 3.4%
Surprised 3.7%
Angry 6.4%

AWS Rekognition

Age 26-43
Gender Male, 51.4%
Sad 7.4%
Confused 2.4%
Happy 3.2%
Disgusted 27.7%
Angry 28.1%
Surprised 4%
Calm 27.1%

Microsoft Cognitive Services

Age 39
Gender Male

Feature analysis

Amazon

Person 98.7%
Hat 98.3%

Captions

Microsoft

a man sitting on a bench 72.2%
a man sitting on a suitcase 72.1%
a man sitting in front of a building 72%