Human Generated Data

Title

Untitled (South Street pier, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2073

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (South Street pier, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2073

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Sailor Suit 99.5
Human 99.5
Apparel 99.4
Clothing 99.4
Person 99.3
Hat 99.1
Hat 99.1
Person 98.8
Person 98
Person 92.1
Person 83.8
Cap 75.1
Person 72.4
Person 72
People 70.7
Crowd 65.7
Person 65.6
Coat 65.3
Suit 65.3
Overcoat 65.3
Baseball Cap 61
Face 60
Military 59.7
Officer 58.2
Military Uniform 58.2

Clarifai
created on 2018-03-23

people 99.9
group 98.7
adult 98.3
group together 98.2
many 97.6
vehicle 97.3
watercraft 95.7
military 95
man 94.8
leader 93.9
administration 93.6
war 92.7
wear 92.4
woman 92.4
outfit 90.9
several 90.5
transportation system 89.6
aircraft 87.3
two 82.9
veil 82.6

Imagga
created on 2018-03-23

man 25.5
machinist 23.8
person 21.5
people 20.6
engineer 19.4
device 18.8
male 17.9
iron lung 15.5
men 15.5
world 15.2
work 14.9
portrait 14.2
industrial 13.6
clothing 13.6
megaphone 13.5
safety 12.9
industry 12.8
war 12.6
respirator 12.4
job 12.4
military 11.6
worker 11.6
face 11.4
weapon 11
adult 11
protection 10.9
acoustic device 10.8
vehicle 10.5
old 10.4
breathing device 10.4
black 10.2
uniform 10.1
mask 9.8
fun 9.7
gun 9.7
playing 9.1
vintage 9.1
fashion 9
equipment 8.8
looking 8.8
soldier 8.8
labor 8.8
photographer 8.7
happiness 8.6
smoke 8.4
car 8.3
gunnery 8.3
holding 8.3
retro 8.2
danger 8.2
happy 8.1
transportation 8.1
metal 8
steel 8
weaponry 7.9
armed 7.9
army 7.8
helmet 7.7
attractive 7.7
life 7.6
hand 7.6
wheel 7.5
city 7.5
outdoors 7.5
child 7.4
inside 7.4
occupation 7.3
lifestyle 7.2
smile 7.1
working 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.9
military uniform 90.1
outdoor 87.7
old 55.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 70.2%
Surprised 0.9%
Happy 0.3%
Disgusted 0.7%
Calm 94.1%
Confused 0.9%
Angry 0.9%
Sad 2.2%

AWS Rekognition

Age 26-44
Gender Male, 98.5%
Calm 87.8%
Angry 1.8%
Disgusted 0.5%
Sad 5%
Surprised 1.7%
Happy 1.4%
Confused 1.9%

AWS Rekognition

Age 35-52
Gender Female, 84.1%
Angry 1.2%
Sad 3.4%
Calm 93.3%
Disgusted 0.4%
Happy 0.4%
Surprised 0.6%
Confused 0.6%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 99.1%
Suit 65.3%

Text analysis

Amazon

BAG
tt