Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

Date

April 20, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.4

Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 20, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.4

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 99.9
Coat 99.4
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Car 98.6
Transportation 98.6
Vehicle 98.6
Adult 98.2
Male 98.2
Man 98.2
Person 98.2
Hat 95.8
Person 95.7
Car 95.3
Car 93.4
Person 93.2
Machine 92.6
Wheel 92.6
Accessories 87.7
Formal Wear 87.7
Tie 87.7
Wheel 81.2
People 81.2
Face 80.4
Head 80.4
Wheel 75.5
Hat 75.4
Text 73.9
Jewelry 70.5
Necklace 70.5
Wheel 69.5
City 66.2
Hat 66.2
Parade 61.9
Photography 57.9
Cap 57.4
License Plate 57.1
Road 57
Street 57
Urban 57
Protest 56.8
Jacket 56.3
Belt 56
Overcoat 55.8
Sunglasses 55.5
Suit 55.3
Portrait 55.2

Clarifai
created on 2018-05-11

street 99.7
people 99.4
man 99
retro 98
vintage 97
monochrome 97
group 96.4
city 95.2
group together 93.9
woman 93.1
crowd 92.7
square 92.2
blur 91.6
military 90.7
movie 89.5
adult 87.2
old 86.9
newspaper 86.8
snapshot 86.6
actor 86.5

Imagga
created on 2023-10-05

city 22.4
people 18.4
man 18.2
business 16.4
building 16.4
black 16.3
person 16.2
architecture 15.6
hat 15.4
shop 15.2
cowboy hat 14.5
adult 14.3
urban 14
megaphone 13.6
travel 13.4
male 12.8
town 12.1
device 12
men 12
street 12
structure 11.9
night 11.5
modern 11.2
old 11.1
acoustic device 11.1
headdress 9.8
office 9.8
human 9.7
technology 9.6
sky 9.6
mercantile establishment 9.4
newspaper 9.2
outdoors 9
product 8.9
to 8.8
lifestyle 8.7
clothing 8.6
day 8.6
close 8.6
finance 8.4
portrait 8.4
famous 8.4
hand 8.3
silhouette 8.3
music 8.2
road 8.1
musical instrument 8.1
car 7.9
billboard 7.9
play 7.8
tourist 7.5
restaurant 7.4
light 7.3
digital 7.3
equipment 7.3
holiday 7.2
financial 7.1
face 7.1
businessman 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 94.1
sign 71
store 30.2
sale 13

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Female, 100%
Sad 95.8%
Calm 48.8%
Surprised 6.4%
Fear 6%
Angry 0.6%
Confused 0.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 36-44
Gender Female, 80.9%
Happy 86.6%
Fear 10.4%
Surprised 7.5%
Sad 2.3%
Angry 0.5%
Confused 0.4%
Disgusted 0.4%
Calm 0.2%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 73.6%
Angry 23%
Surprised 6.4%
Fear 5.9%
Sad 2.5%
Confused 1.1%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Female, 99.4%
Calm 92.9%
Surprised 6.3%
Fear 5.9%
Happy 5.4%
Sad 2.4%
Confused 0.4%
Disgusted 0.2%
Angry 0.1%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%
Car 98.6%
Hat 95.8%
Wheel 92.6%
Tie 87.7%
Necklace 70.5%
Belt 56%

Categories

Text analysis

Amazon

ART
PUBLIC
9
MURALS
DECORATION
PR
HUNDREDS
INTIM
ATION
NEED
JECT
DRUGS
of
and
artists
of PUBLIC BUILDING
t
OF PR
ORGAN
artists Union
ОР
NION
Union
BUILDING
S
OF
ArtArin
de
de W
ARTISI
W
STIC

Google

9 ART JOBS HUNDREDS NEED SOP INTIM ATION ORGA ATION DECORATIO
9
ART
JOBS
HUNDREDS
NEED
SOP
INTIM
ATION
ORGA
DECORATIO