Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)
Date

April 20, 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.2

Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 20, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.2

Machine Generated Data

Tags

Amazon
created on 2022-04-08

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.4
Pedestrian 98.8
Person 98.4
Overcoat 98.3
Coat 98.3
Person 98.2
Person 97.9
Person 97.2
Person 96.5
Person 96.5
Person 96.5
Suit 96.5
Person 96.4
Person 95.9
Shoe 76.6
Footwear 76.6
Tuxedo 74.8
Crowd 71
Face 67.8
Officer 67.3
Military 67.3
Military Uniform 67.3
People 65.5
Funeral 65.3
Tarmac 62
Asphalt 62
Sailor Suit 58.1

Clarifai
created on 2023-10-18

people 99.8
group 98.8
group together 98.6
many 98
crowd 95.9
queue 95.1
transportation system 95
wear 94.7
man 93.2
street 90.9
adult 90.6
vehicle 90.6
train 90.4
military 90.3
airport 89.6
veil 89.6
woman 89
recreation 88.1
movie 84.3
child 84.1

Imagga
created on 2022-04-08

pedestrian 32.2
people 26.8
clothing 26.5
city 24.1
business 23.1
hall 19.3
crowd 19.2
urban 18.3
group 17.7
cap 17.1
building 16.5
architecture 16.4
travel 15.5
uniform 14.9
man 14.8
stage 14.5
military uniform 14.4
suit 13.9
mortarboard 13.7
male 13.5
silhouette 13.2
businessman 13.2
women 12.6
covering 12.2
headdress 11.9
consumer goods 11.9
musical instrument 11.7
adult 11.7
transportation 11.6
person 11.4
platform 11.3
men 11.2
tourism 10.7
brass 10.5
life 10.4
work 10.2
world 10
marimba 10
tourist 10
night 9.8
transport 9.1
old 9
station 8.7
scene 8.6
day 8.6
party 8.6
corporate 8.6
walk 8.6
journey 8.5
window 8.4
percussion instrument 8.4
office 8.2
team 8.1
history 8
subway 7.9
audience 7.8
wind instrument 7.8
black 7.5
fashion 7.5
traditional 7.5
street 7.4
lifestyle 7.2
job 7.1
indoors 7

Google
created on 2022-04-08

Coat 89.3
Human 89.2
Fashion 87.8
Standing 86.4
Black-and-white 86.3
Style 84.1
Font 82.5
Social group 82.4
Headgear 81.4
Building 81
Crowd 80.2
Suit 78.8
Blazer 77.8
Monochrome 75.7
Monochrome photography 75.3
Hat 74.1
Formal wear 73.8
City 73.2
Event 72.9
White-collar worker 71.7

Microsoft
created on 2022-04-08

person 99.6
clothing 96.7
text 94.6
man 88.5
black and white 87.1
group 80
people 77.5
line 47.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 85.5%
Confused 6.6%
Sad 5.4%
Disgusted 0.9%
Angry 0.5%
Surprised 0.5%
Happy 0.5%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 100%
Sad 90.3%
Calm 6.8%
Confused 2.4%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 72.6%
Sad 93.7%
Calm 3%
Confused 1.2%
Surprised 0.7%
Angry 0.6%
Disgusted 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Male, 92.1%
Fear 50.2%
Calm 23.6%
Sad 13.8%
Angry 6%
Happy 1.9%
Disgusted 1.7%
Confused 1.5%
Surprised 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.7%
Person 99.4%
Person 98.4%
Person 98.2%
Person 97.9%
Person 97.2%
Person 96.5%
Person 96.5%
Person 96.5%
Person 96.4%
Person 95.9%
Shoe 76.6%

Categories

Imagga

paintings art 51.1%
interior objects 16.9%
food drinks 15.1%
people portraits 7.8%
events parties 4.7%
text visuals 1.6%
cars vehicles 1.6%

Text analysis

Amazon

7
FLORIST
STREET FLORIST
STREET

Google

7 00000 STREET FLORIS
7
00000
STREET
FLORIS