Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2986

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2986

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.8
Human 99.8
Person 99.8
Footwear 99.7
Clothing 99.7
Apparel 99.7
Shoe 99.7
Person 99.6
Person 99.6
Shoe 99.6
Person 99.6
Person 99.3
Shoe 99
Shoe 98.8
Person 98
Person 97.5
Shoe 95.9
People 77.7
Coat 77
Worker 76.3
Shoe 75.3
Military Uniform 73.4
Military 73.4
Overcoat 71.7
Officer 70.5
Suit 68.1
Hat 65.4
Helmet 63
Pants 63
Face 62.9
Hardhat 62.5
Standing 58
Shoe 54.1
Shoe 52.3

Clarifai
created on 2018-03-23

people 100
group together 99.4
group 99
adult 98.5
many 97.8
military 97.5
man 96.8
several 95.7
administration 95.2
uniform 95.2
wear 94.8
child 93.3
four 92.7
outfit 92.4
five 92.1
war 90.6
soldier 89.8
leader 89.6
vehicle 88.2
veil 88

Imagga
created on 2018-03-23

military uniform 71.4
uniform 63.4
clothing 50.5
covering 29.3
consumer goods 29.1
man 26.9
person 19.6
male 19.1
soldier 17.6
people 17.3
danger 17.3
statue 17
sculpture 16.5
protection 15.5
military 15.5
adult 14.9
commodity 14.2
silhouette 13.2
destruction 12.7
travel 12.7
history 12.5
mask 12.1
dirty 11.7
army 11.7
protective 11.7
nuclear 11.6
sky 11.5
industrial 10.9
radioactive 10.8
radiation 10.8
accident 10.7
toxic 10.7
outdoor 10.7
water 10.7
chemical 10.6
gas 10.6
men 10.3
gun 10.2
stalker 9.9
sunset 9.9
religion 9.9
camouflage 9.8
summer 9.6
beach 9.3
suit 9.2
street 9.2
dark 9.2
city 9.1
tourism 9.1
old 9.1
pedestrian 9
building 8.7
culture 8.5
portrait 8.4
monument 8.4
smoke 8.4
world 8.3
weapon 8.2
group 8.1
urban 7.9
private 7.8
brass 7.8
disaster 7.8
explosion 7.7
protect 7.7
industry 7.7
rifle 7.5
black 7.4
kin 7.3
to 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 100
outdoor 99.9
military uniform 84.8
posing 44.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.6%
Confused 45.3%
Sad 47%
Surprised 45.4%
Calm 50.9%
Happy 45.3%
Disgusted 45.5%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Surprised 45.1%
Sad 45%
Happy 54.9%
Disgusted 45%
Angry 45%
Calm 45%
Confused 45%

AWS Rekognition

Age 45-63
Gender Male, 53.7%
Happy 45.3%
Surprised 45.2%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Calm 53.8%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Male, 55%
Sad 45%
Disgusted 45%
Confused 45%
Surprised 45.1%
Calm 45%
Angry 45.1%
Happy 54.7%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Sad 46.6%
Disgusted 45.2%
Confused 45.2%
Surprised 45.2%
Calm 45.5%
Angry 45.2%
Happy 52.2%

AWS Rekognition

Age 35-52
Gender Male, 52.1%
Calm 45.2%
Confused 45%
Surprised 45%
Disgusted 54.6%
Happy 45%
Angry 45.1%
Sad 45%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Calm 49.4%
Surprised 45.2%
Confused 45.3%
Angry 46.4%
Sad 47.4%
Happy 45.5%
Disgusted 45.8%

AWS Rekognition

Age 30-47
Gender Male, 54.8%
Calm 54.2%
Surprised 45.1%
Confused 45%
Angry 45.1%
Sad 45.1%
Happy 45.4%
Disgusted 45.1%

Microsoft Cognitive Services

Age 76
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 99.7%