Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

Date

April 20, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.1

Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 20, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.1

Machine Generated Data

Tags

Amazon
created on 2022-04-08

Person 99.7
Human 99.7
Person 99.4
Person 99
Person 98.8
Person 98.6
Pedestrian 98.6
Person 97.8
Person 97
Person 96.4
Clothing 94.7
Apparel 94.7
Suit 89.3
Overcoat 89.3
Coat 89.3
Crowd 80.3
People 78.6
Person 78.1
Person 75.2
Face 71
Tuxedo 59.9
Hair 59.1
Funeral 58.3
Officer 57.1
Military 57.1
Military Uniform 57.1
Person 49.4

Clarifai
created on 2023-10-19

movie 99.8
people 99.6
many 98.6
group 98.1
negative 97.9
group together 96.2
cinematography 94.3
crowd 93.3
street 92.7
man 92.5
monochrome 90.7
filmstrip 90.4
woman 89.7
recreation 89.2
wear 88.4
exposed 87
cinematic 86.2
adult 84.8
elderly 83.2
military 82.1

Imagga
created on 2022-04-08

people 30.7
marimba 25.5
group 25
percussion instrument 21
man 20.9
person 18.8
photographer 18.6
men 18
city 17.4
silhouette 17.4
crowd 17.3
stage 16.9
musical instrument 16.8
business 16.4
women 15.8
spectator 15.2
world 14
urban 13.1
adult 13
center 12.9
black 12.4
male 12
hall 11.4
platform 11.3
old 11.1
building 10.6
together 10.5
music 9.9
team 9.8
life 9.7
work 9.4
lifestyle 9.4
clothing 8.9
gymnasium 8.1
businessman 7.9
architecture 7.8
scene 7.8
portrait 7.8
travel 7.7
athletic facility 7.7
corporate 7.7
sky 7.6
casual 7.6
walking 7.6
leisure 7.5
sunset 7.2
celebration 7.2
transportation 7.2
happiness 7

Google
created on 2022-04-08

Outerwear 95.2
Photograph 94.4
White 92.2
Coat 91.4
Product 90.7
Black 89.9
Fashion 88.4
Black-and-white 86.6
Style 84.1
Font 83.7
Line 83.1
Interaction 83.1
Suit 81.2
Crowd 78.9
Monochrome 76
Snapshot 74.3
Monochrome photography 74.1
Event 74.1
Design 68.6
Formal wear 68

Microsoft
created on 2022-04-08

person 99.9
text 98.9
clothing 93.9
man 90.4
people 89.4
black and white 88.3
group 73.6
screenshot 72.5
poster 64.1
crowd 53.5
subway 35.6
line 27.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 81.6%
Sad 7.3%
Confused 5.4%
Angry 2.6%
Surprised 2.1%
Fear 0.4%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 36-44
Gender Male, 100%
Angry 43.3%
Calm 39.5%
Surprised 8.8%
Confused 5.6%
Happy 0.8%
Disgusted 0.8%
Fear 0.7%
Sad 0.7%

AWS Rekognition

Age 28-38
Gender Male, 97.7%
Sad 62%
Calm 29.8%
Confused 4.2%
Angry 1.3%
Fear 1.2%
Disgusted 0.6%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 89.9%
Sad 3.7%
Confused 2.7%
Angry 0.9%
Disgusted 0.9%
Fear 0.8%
Surprised 0.7%
Happy 0.5%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 79.3%
Sad 17.5%
Surprised 0.9%
Confused 0.8%
Disgusted 0.6%
Angry 0.5%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Female, 66.7%
Calm 44.9%
Sad 41%
Confused 3.7%
Fear 3.3%
Surprised 2.8%
Happy 1.7%
Angry 1.5%
Disgusted 1.1%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 96.2%
Sad 2.2%
Angry 0.5%
Confused 0.5%
Surprised 0.3%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 98.8%
Calm 59.7%
Sad 29.3%
Happy 8.4%
Angry 1.1%
Surprised 0.4%
Confused 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Male, 95.8%
Sad 85.6%
Confused 9.6%
Disgusted 1.7%
Calm 1.5%
Fear 0.7%
Surprised 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 96.1%
Sad 1.3%
Angry 1%
Confused 0.6%
Surprised 0.5%
Happy 0.3%
Disgusted 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.4%
Person 99%
Person 98.8%
Person 98.6%
Person 97.8%
Person 97%
Person 96.4%
Person 78.1%
Person 75.2%
Person 49.4%

Categories

Text analysis

Amazon

6
G
8
F
A
OPTI
to
ARS OPTI to
ARS

Google

ARS OPTI A G E A
ARS
OPTI
A
G
E