Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

Date

April 20, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.30

Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 20, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.30

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
People 99.8
Person 99
Adult 99
Male 99
Man 99
Person 98.9
Adult 98.9
Male 98.9
Man 98.9
Formal Wear 98.7
Suit 98.7
Person 98.4
Adult 98.4
Male 98.4
Man 98.4
Person 98.2
Adult 98.2
Male 98.2
Man 98.2
Person 98.1
Person 97.9
Coat 97.9
Person 97.1
Person 93.3
Person 92.5
Person 92.1
Person 92
Photography 91.3
Person 91.2
Adult 91.2
Male 91.2
Man 91.2
Person 88.3
Footwear 87.7
Shoe 87.7
Helmet 87.1
Shoe 84.8
Accessories 84.2
Glasses 84.2
Person 83.8
Person 82.2
Person 81.2
Tie 79.5
Glove 79.4
Bag 77.5
Handbag 77.5
Face 74.8
Head 74.8
Person 74.2
Jeans 73.9
Pants 73.9
Shoe 70.1
Crowd 69.6
Shoe 69.4
Coat 69.2
Parade 64.9
High Heel 64.6
Hat 62.2
Shorts 61.7
City 61
Overcoat 60.9
Bus 60.3
Transportation 60.3
Vehicle 60.3
Handbag 58.5
Text 57.1
Protest 56.1
Urban 55.7
Road 55.5
Street 55.5
Cap 55.1
Sunglasses 55.1

Clarifai
created on 2018-05-11

people 99.5
military 98.4
monochrome 98.3
group 97.6
man 97.5
group together 96.8
adult 95.1
retro 94.4
many 94.2
crowd 93.8
movie 91.2
war 89.2
street 86.1
vehicle 85.9
vintage 83.8
woman 82.6
square 82.1
actor 80.4
transportation system 79.7
support 79.6

Imagga
created on 2023-10-05

brass 33.5
pedestrian 28.2
uniform 26.9
military uniform 26.3
wind instrument 25.8
man 25.5
people 25.1
trombone 23.4
clothing 22.7
silhouette 22.3
male 19.8
city 19.1
musical instrument 19
stage 17.4
person 15.7
men 15.4
cornet 14.8
travel 14.1
group 13.7
urban 13.1
protection 12.7
destruction 12.7
sunset 12.6
street 12
platform 11.7
nuclear 11.6
military 11.6
tourism 11.5
adult 11
beach 10.9
business 10.9
industrial 10.9
black 10.8
consumer goods 10.7
photographer 10.6
covering 10.6
crowd 10.6
walk 10.5
sky 10.2
danger 10
tourist 10
protective 9.7
walking 9.5
symbol 9.4
stalker 8.9
radioactive 8.8
radiation 8.8
accident 8.8
toxic 8.8
chemical 8.7
gas 8.7
war 8.7
mask 8.6
architecture 8.6
private 8.5
outdoor 8.4
dark 8.3
vacation 8.2
dirty 8.1
history 8
water 8
life 7.9
soldier 7.8
disaster 7.8
factory 7.7
sign 7.5
building 7.5
holding 7.4
suit 7.3
women 7.1
summer 7.1
businessman 7.1
sea 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99
standing 82.5
group 68.4
people 60
crowd 32.5
line 18.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Calm 58.7%
Angry 37.6%
Surprised 6.5%
Fear 6%
Sad 2.6%
Disgusted 0.7%
Confused 0.6%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Sad 83.2%
Calm 40.1%
Confused 16.7%
Surprised 6.7%
Fear 6.1%
Happy 1.9%
Disgusted 1.2%
Angry 0.8%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 41.6%
Confused 27.3%
Surprised 11.4%
Angry 9%
Disgusted 7%
Fear 6.7%
Sad 3.5%
Happy 1.8%

AWS Rekognition

Age 23-31
Gender Female, 63.1%
Calm 58.1%
Disgusted 14.7%
Fear 8%
Surprised 7.3%
Angry 6.7%
Sad 5.7%
Happy 3.9%
Confused 2.8%

AWS Rekognition

Age 18-26
Gender Female, 70.9%
Calm 62.3%
Fear 12.2%
Disgusted 8.5%
Surprised 7.6%
Angry 6.6%
Confused 3.8%
Sad 3.2%
Happy 1.4%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 72.4%
Confused 20.2%
Surprised 6.9%
Fear 6.3%
Sad 3.3%
Angry 0.9%
Disgusted 0.9%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 99.6%
Calm 46.2%
Sad 22.8%
Angry 11.7%
Surprised 9.7%
Happy 8.1%
Confused 6.6%
Fear 6.4%
Disgusted 2.3%

AWS Rekognition

Age 22-30
Gender Male, 98.6%
Calm 50%
Confused 22.7%
Surprised 9.5%
Disgusted 9.5%
Fear 6.6%
Happy 5.3%
Sad 3.7%
Angry 1.4%

AWS Rekognition

Age 21-29
Gender Male, 98.6%
Calm 97.8%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Angry 0.7%
Confused 0.4%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Confused 72.8%
Fear 17.2%
Surprised 7.5%
Calm 3.7%
Sad 2.7%
Angry 0.8%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 34-42
Gender Male, 99.6%
Calm 70.1%
Happy 22.8%
Surprised 8.4%
Fear 6%
Sad 2.5%
Angry 0.9%
Disgusted 0.8%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 86.4%
Sad 99.7%
Calm 24%
Surprised 6.4%
Fear 6%
Angry 3.1%
Confused 3%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 26-36
Gender Male, 90.6%
Calm 58.8%
Confused 15.6%
Surprised 13.1%
Fear 6.7%
Sad 6.5%
Happy 2.9%
Disgusted 1.9%
Angry 1.3%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 60.3%
Happy 23.9%
Surprised 8.4%
Fear 6.3%
Confused 4%
Sad 3.5%
Angry 2.5%
Disgusted 1%

AWS Rekognition

Age 20-28
Gender Female, 97.4%
Sad 100%
Calm 10%
Surprised 6.5%
Fear 6%
Confused 4%
Happy 0.5%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 13-21
Gender Male, 92.4%
Surprised 65.9%
Fear 41.3%
Calm 8.9%
Angry 4.8%
Disgusted 3.4%
Sad 3%
Confused 2.9%
Happy 2.4%

AWS Rekognition

Age 4-12
Gender Female, 99.8%
Calm 80%
Fear 9.7%
Surprised 6.7%
Sad 3.6%
Happy 2.4%
Disgusted 2%
Confused 1.6%
Angry 1.4%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Adult 99%
Male 99%
Man 99%
Coat 97.9%
Shoe 87.7%
Helmet 87.1%
Glasses 84.2%
Tie 79.5%
Glove 79.4%
Handbag 77.5%
Jeans 73.9%
High Heel 64.6%
Hat 62.2%
Shorts 61.7%
Bus 60.3%

Text analysis

Amazon

35
ON
REINSTATE
62
CHILDsLUSTIG
artists
ON 259!!
Jon
ANE
259!!
artists Union
Union

Google

35 REINSTATE CHILDsLUSTIG ON 259! 62 ANE
35
REINSTATE
CHILDsLUSTIG
ON
259!
62
ANE