Human Generated Data

Title

Untitled (Shriver, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1264

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Shriver, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1264

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Apparel 100
Clothing 100
Person 99.8
Human 99.8
Person 99.6
Person 99.6
Person 99.5
Hat 95.5
Sun Hat 92
Cowboy Hat 90
Hat 89.7
Accessories 87.9
Accessory 87.9
Tie 87.9
Hat 83.5
Overcoat 79.7
Coat 79.7
Shoe 76.7
Footwear 76.7
Suit 74.4
Shoe 66
People 63.7
Shoe 55.9

Clarifai
created on 2018-03-23

people 100
group 99.7
group together 99.5
adult 99.4
several 98.6
many 97.9
administration 97.2
man 97.1
three 94.8
woman 94.8
four 94.7
five 93.5
military 92.9
war 92.9
wear 92.4
sit 91.9
child 91.7
leader 90.3
outfit 89.6
vehicle 89.5

Imagga
created on 2018-03-23

cemetery 28
graffito 22.6
old 19.5
decoration 19
man 16.8
statue 16.4
history 16.1
sculpture 15.4
art 15.4
people 13.4
city 12.5
black 12.2
ancient 12.1
building 12
architecture 11.7
tourism 10.7
kin 10.5
person 10.4
historical 10.3
vintage 9.9
religion 9.9
travel 9.9
clothing 9.8
stone 9.4
grunge 9.4
monument 9.3
drawing 9.2
uniform 9.1
landmark 9
sky 8.9
detail 8.8
mask 8.6
god 8.6
male 8.5
historic 8.2
military uniform 8.2
symbol 8.1
covering 8
holiday 7.9
scene 7.8
color 7.8
men 7.7
war 7.7
culture 7.7
religious 7.5
protection 7.3
danger 7.3
national 7.2
dress 7.2
day 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.8
outdoor 99.5
old 96.2
group 62
posing 41.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 94.2%
Calm 36.1%
Angry 12.3%
Disgusted 5.6%
Sad 6.5%
Surprised 14.2%
Happy 18.5%
Confused 6.8%

AWS Rekognition

Age 27-44
Gender Male, 98.8%
Angry 0.5%
Disgusted 0.2%
Calm 97.9%
Happy 0.3%
Sad 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 26-43
Gender Male, 73.6%
Disgusted 18.5%
Surprised 3.7%
Sad 4%
Calm 30.2%
Angry 9.3%
Happy 20.9%
Confused 13.3%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 95.5%
Tie 87.9%
Shoe 76.7%