Human Generated Data

Title

Untitled (Theatre Union demonstrators, May Day Parade, Communist Party route, New York City)

Date

May 1, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2818

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Theatre Union demonstrators, May Day Parade, Communist Party route, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1, 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 98.7
Accessories 98.2
Tie 98.2
Accessory 98.2
Crowd 97.9
Person 97.5
Person 97.2
Person 96.8
Parade 96.2
Person 95.6
Person 95.4
Protest 94.4
Person 93.4
Person 90.2
Person 88.2
Text 79.6
People 67.6
Apparel 65.3
Overcoat 65.3
Suit 65.3
Clothing 65.3
Coat 65.3
Suit 57.9
Word 57.6
Face 55.3
Suit 54.9

Clarifai
created on 2018-03-23

people 99.9
many 99.3
group 99
adult 98.4
woman 96.9
administration 96.8
leader 96.6
man 93.2
wear 92.3
war 90.7
crowd 89.3
group together 88.1
military 81.2
outfit 76.8
several 76.7
street 75.4
education 73
vehicle 72.5
rally 70.1
child 68.8

Imagga
created on 2018-03-23

city 26.6
architecture 26.5
world 23
building 22.7
old 20.2
currency 18.8
history 17.9
money 16.2
finance 16
cash 15.6
spectator 15.2
tourism 14.8
travel 14.8
ancient 14.7
sky 14.7
business 14.6
man 14.1
people 13.9
person 13.6
bank 13.4
bill 13.3
monument 13.1
town 13
tourist 12.3
capital 12.3
male 12.2
dollar 12.1
flag 12.1
historic 11.9
landmark 10.8
tower 10.7
financial 10.7
pedestrian 10.5
famous 10.2
street 10.1
banking 10.1
stone 10.1
wealth 9.9
historical 9.4
daily 8.8
businessman 8.8
urban 8.7
banknote 8.7
dollars 8.7
emblem 8.6
culture 8.5
newspaper 8.5
tree 8.5
house 8.4
church 8.3
note 8.3
castle 8.1
paper 7.9
kin 7.8
skyline 7.6
cityscape 7.6
buildings 7.6
park 7.4
palace 7.2

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 98.9
outdoor 95.4
newspaper 77.6
group 71.2
people 62.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 100%
Calm 49.9%
Angry 4.2%
Happy 8.3%
Disgusted 1.2%
Sad 22.7%
Surprised 5.4%
Confused 8.4%

AWS Rekognition

Age 30-47
Gender Male, 99.1%
Surprised 3.3%
Sad 18.4%
Happy 3.2%
Disgusted 8.3%
Angry 4.8%
Calm 51.6%
Confused 10.5%

AWS Rekognition

Age 35-52
Gender Female, 65.2%
Happy 8.1%
Disgusted 7.5%
Calm 26.9%
Surprised 7.5%
Angry 8.9%
Sad 33.1%
Confused 8.1%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 47.4%
Disgusted 45.3%
Surprised 45.5%
Confused 45.4%
Angry 47.4%
Happy 46.1%
Calm 47.9%

AWS Rekognition

Age 26-43
Gender Female, 89.7%
Disgusted 8.5%
Angry 20.3%
Calm 25.9%
Sad 1.8%
Happy 27.8%
Confused 5%
Surprised 10.7%

AWS Rekognition

Age 26-43
Gender Male, 95.5%
Sad 4.7%
Surprised 32.9%
Confused 4.5%
Happy 2.9%
Calm 45.1%
Disgusted 4.7%
Angry 5.2%

AWS Rekognition

Age 26-43
Gender Male, 98.8%
Happy 2.9%
Disgusted 51.1%
Calm 31.2%
Surprised 2.8%
Sad 3.8%
Confused 2.9%
Angry 5.2%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Calm 47.1%
Angry 47.8%
Disgusted 45.5%
Sad 48%
Surprised 45.6%
Happy 45.4%
Confused 45.6%

AWS Rekognition

Age 26-43
Gender Female, 99.3%
Disgusted 3.5%
Surprised 2.1%
Sad 21.9%
Calm 21.1%
Angry 39.3%
Happy 0.5%
Confused 11.7%

AWS Rekognition

Age 35-52
Gender Male, 72.6%
Sad 27%
Disgusted 1.6%
Confused 8.9%
Surprised 16.2%
Calm 22.5%
Angry 22.6%
Happy 1.3%

AWS Rekognition

Age 26-43
Gender Male, 86.3%
Disgusted 1.1%
Sad 72.2%
Calm 9.8%
Surprised 2.8%
Happy 3.3%
Confused 4.4%
Angry 6.3%

AWS Rekognition

Age 9-14
Gender Male, 54.7%
Confused 46.1%
Sad 51.2%
Calm 46%
Happy 45.7%
Surprised 45.2%
Angry 45.6%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 55%
Calm 53.7%
Surprised 45.5%
Confused 45%
Angry 45.1%
Sad 45.2%
Happy 45.4%
Disgusted 45.2%

AWS Rekognition

Age 23-38
Gender Male, 75.1%
Disgusted 2.2%
Surprised 2.9%
Angry 6.6%
Sad 56%
Confused 2.3%
Happy 3.6%
Calm 26.4%

AWS Rekognition

Age 14-23
Gender Female, 54.6%
Sad 45.3%
Calm 53.2%
Angry 45.3%
Surprised 45.6%
Confused 45.5%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.6%
Confused 45.3%
Sad 50.8%
Surprised 45.6%
Calm 47.2%
Happy 45.3%
Disgusted 45.2%
Angry 45.7%

AWS Rekognition

Age 26-43
Gender Female, 65.4%
Disgusted 29.1%
Surprised 5.8%
Happy 16.8%
Confused 3.9%
Calm 6.2%
Sad 19.6%
Angry 18.6%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Calm 50.7%
Disgusted 45.2%
Angry 45.6%
Surprised 46%
Confused 45.5%
Sad 46.6%
Happy 45.4%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 16
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.2%
Person 97.5%
Suit 65.3%

Captions

Microsoft

a group of people standing in front of a newspaper 77.6%
a group of people standing in front of a sign 77.5%
a group of people standing in a newspaper 77.4%

Text analysis

Amazon

ADITION
EQUAL
CREATED
LUTIONARY
RATION
GHTS
UTIONS
LL GHTS
LL
ENDENCE
ITEES
EARY
GHT
CAN
EQUAL SA12 UTIONS GHT
HEY
ORIGHT
HABIT IT
AND
AND HABIT IT EARY HEY CAN oF
TUTI ORIGHT
SA12
TUTI
oF

Google

UTIONS
UTIONAR
0RIGHT
ADITION
,
RATION
NDENCE
EQUAL
UTIONAR RATION NDENCE ADITION CREATEDBA EQUAL, UTIONS ,0RIGHT
CREATEDBA