Human Generated Data

Title

Untitled (John Reed Club demonstrators, Division IX, May Day Parade, Communist Party route, Fifth Avenue and East Twenty-fifth Street, Madison Square, New York City)
Date

May 1, 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4077

Human Generated Data

Title

Untitled (John Reed Club demonstrators, Division IX, May Day Parade, Communist Party route, Fifth Avenue and East Twenty-fifth Street, Madison Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4077

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
People 100
Person 98.9
Adult 98.9
Male 98.9
Man 98.9
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.4
Person 98.3
Adult 98.3
Male 98.3
Man 98.3
Person 98.2
Person 97.8
Person 97.7
Person 97.5
Person 96.8
Coat 96.4
Person 96.2
Person 94
Person 93.7
Coat 93.5
Person 91.7
Person 88.6
Person 85.6
Person 85.3
Overcoat 84.8
City 82.3
Person 81.2
Footwear 78.1
Shoe 78.1
Person 76.2
Face 76.2
Head 76.2
Hat 75.6
Shoe 75
Person 74.7
Person 74.6
Person 73.5
Person 73.2
Coat 72.3
Coat 72.3
Shoe 72
Person 71.1
Parade 68.8
Person 68.1
Text 65.5
Walking 64.4
Person 64.3
Shoe 63.7
Shoe 62.7
Shoe 62.2
Crowd 61.7
Shoe 58.7
Shoe 58.2
Shoe 58.1
Protest 57.9
Shoe 57.5
Marching 56.8
Officer 56.6

Clarifai
created on 2018-05-10

people 99.9
many 98.5
military 98.2
adult 97.7
war 96.9
crowd 96.9
group together 96.9
administration 95.4
man 95.1
group 95
uniform 94.7
soldier 92.7
military uniform 88.8
revolution 87.3
police 84.5
skirmish 82.2
leader 82
wear 81.6
chair 77.9
army 75.4

Imagga
created on 2023-10-07

private 77.3
uniform 51.2
military uniform 49.4
pedestrian 41.1
clothing 35
man 32.9
people 30.1
male 24.1
military 21.2
group 20.1
walking 19.9
consumer goods 19.8
covering 19.6
person 18.3
men 18
soldier 17.6
adult 14.9
army 13.6
war 13.5
gun 13.3
street 12.9
danger 12.7
travel 12.7
women 12.6
camouflage 12
winter 11.9
weapon 11.9
team 11.6
business 11.5
crowd 11.5
walk 11.4
city 10.8
holding 10.7
outdoors 10.4
black 10.2
commodity 9.8
together 9.6
urban 9.6
protection 9.1
rifle 9
active 9
family 8.9
to 8.8
destruction 8.8
nuclear 8.7
smiling 8.7
mask 8.6
friends 8.5
tourist 8.4
portrait 8.4
outdoor 8.4
silhouette 8.3
happy 8.1
dirty 8.1
suit 8.1
snow 8
businessman 7.9
stalker 7.9
radioactive 7.9
couple 7.8
standing 7.8
conflict 7.8
toxic 7.8
gas 7.7
casual 7.6
helmet 7.6
landscape 7.4
action 7.4
park 7.4
vacation 7.4
lifestyle 7.2
smile 7.1
day 7.1
happiness 7

Google
created on 2018-05-10

black and white 88.8
troop 83
military person 79.8
standing 79.4
staff 79
military officer 77.9
militia 74.7
monochrome photography 73.9
military 72.2
history 70.9
crowd 68.3
monochrome 68
street 65.3

Microsoft
created on 2018-05-10

person 98.6
outdoor 95.2
group 93.1
people 77.1
posing 75.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 93.8%
Surprised 6.6%
Fear 6%
Sad 2.7%
Confused 1.7%
Angry 1.4%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 84.5%
Confused 11.5%
Surprised 6.4%
Fear 6%
Sad 2.5%
Angry 1.4%
Disgusted 0.5%
Happy 0.5%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 93.6%
Surprised 6.5%
Fear 6%
Angry 3.8%
Sad 2.4%
Confused 0.8%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Surprised 45.7%
Happy 23.9%
Calm 21.5%
Fear 10%
Sad 6%
Angry 4%
Disgusted 3.4%
Confused 1.7%

AWS Rekognition

Age 40-48
Gender Male, 99.5%
Sad 95.8%
Calm 17.3%
Confused 13.3%
Fear 8.4%
Surprised 7.1%
Angry 5%
Disgusted 4.5%
Happy 4%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Surprised 60%
Calm 37.6%
Happy 22.5%
Fear 5.9%
Sad 2.2%
Angry 1.8%
Confused 1%
Disgusted 0.9%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Angry 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Calm 0.8%
Confused 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 47-53
Gender Male, 99.5%
Sad 60.6%
Confused 22.5%
Calm 19.4%
Fear 16.1%
Surprised 9%
Angry 3.9%
Disgusted 2.1%
Happy 1%

AWS Rekognition

Age 45-51
Gender Male, 92.6%
Calm 61.8%
Angry 14.4%
Surprised 10.8%
Fear 6.3%
Sad 5.8%
Disgusted 5.2%
Confused 1.9%
Happy 1.6%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Calm 96.4%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Happy 2.3%
Angry 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Female, 98.6%
Calm 41.3%
Fear 25.9%
Happy 13.3%
Surprised 7.3%
Sad 6.1%
Confused 5.2%
Disgusted 2.9%
Angry 2%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 84.9%
Surprised 9.1%
Fear 8%
Sad 2.4%
Angry 1.5%
Confused 1.4%
Disgusted 0.9%
Happy 0.8%

AWS Rekognition

Age 18-24
Gender Male, 99.4%
Surprised 70%
Calm 52.9%
Fear 6%
Sad 2.6%
Disgusted 2%
Confused 0.7%
Angry 0.7%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 98%
Calm 97.8%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 81.7%
Calm 37.3%
Confused 14.8%
Surprised 13.1%
Disgusted 11.1%
Angry 8.6%
Fear 7.9%
Sad 7.8%
Happy 4.4%

AWS Rekognition

Age 23-33
Gender Male, 93.5%
Sad 58.1%
Happy 29.7%
Disgusted 17.7%
Calm 11.2%
Surprised 8.3%
Fear 7.3%
Angry 4.3%
Confused 1.1%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 98.4%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.7%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Sad 99.9%
Surprised 8.7%
Disgusted 7.2%
Fear 6.6%
Happy 5.5%
Calm 5.1%
Confused 2.3%
Angry 1.7%

AWS Rekognition

Age 7-17
Gender Male, 70.4%
Sad 100%
Surprised 6.5%
Fear 6%
Confused 1.7%
Calm 1.3%
Disgusted 0.9%
Angry 0.6%
Happy 0.1%

AWS Rekognition

Age 11-19
Gender Male, 85.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 2.9%
Calm 1.5%
Angry 0.6%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 97.9%
Calm 63.8%
Surprised 13.7%
Disgusted 13.4%
Fear 6.6%
Sad 4.7%
Happy 2.2%
Angry 2.1%
Confused 1%

AWS Rekognition

Age 20-28
Gender Female, 74.3%
Calm 93.5%
Surprised 6.4%
Fear 6%
Sad 3.5%
Happy 0.9%
Confused 0.7%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Angry 63.5%
Calm 32.1%
Surprised 7.8%
Fear 5.9%
Sad 2.2%
Confused 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Surprised 97%
Calm 22.6%
Fear 6.1%
Sad 2.4%
Confused 1.5%
Angry 1.4%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Female, 76.9%
Calm 57.7%
Confused 9.8%
Surprised 8.4%
Fear 8%
Sad 7.3%
Disgusted 5.5%
Angry 5.1%
Happy 4.3%

AWS Rekognition

Age 30-40
Gender Female, 54.4%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 28-38
Gender Male, 91.6%
Happy 72.5%
Calm 10.1%
Sad 7.4%
Fear 7.1%
Surprised 7%
Disgusted 1.6%
Angry 1.4%
Confused 0.9%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Adult 98.9%
Male 98.9%
Man 98.9%
Coat 96.4%
Shoe 78.1%

Categories

Imagga

streetview architecture 99.9%

Text analysis

Amazon

College
inverted
and
fm
WAR
Art
University
ART
430
FASCISM
SCHOOL
CLUB
REED
FIGHT
neg
JOHN
(Harvard
CLASS
AVE.
STRUGGLE
Fellows
SCHOOL of ART
President and Fellows of Harvard College (Harvard University Art Museums)
of
AVE
Museums)
Harvard
NOW
WAR and
Revolutionary
AGAINST
P1970.4077.0000 inverted fm neg
WEAPON
ART IS A WEAPON
REGISTER NOW
A
IS
Lamels
REGISTER
President
THE
in THE CLASS STRUGGLE
P1970.4077.0000
430 6th, AVE
Artists FIGHT
Artists
in
6th,
25 ST
ace 430-6г AVE.
430-6г
ace
#3

Google

REED CLUB 4 30 6 AVE s ST hevoliliona isFIGH JOHN เก THE CLASS STRUGGLE NST SCHOOL &f ART WARand FASCISM O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4077.0000 inverted fm neg
REED
CLUB
4
30
6
AVE
s
ST
hevoliliona
isFIGH
JOHN
เก
THE
CLASS
STRUGGLE
NST
SCHOOL
&f
ART
WARand
FASCISM
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4077.0000
inverted
fm
neg