Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

Date

April 20, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.34

Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 20, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.34

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 100
Formal Wear 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.2
Person 99.2
Female 99.2
Woman 99.2
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Person 98.8
Hat 98.2
Person 96.7
Sun Hat 95.1
Accessories 94.5
Bag 94.5
Handbag 94.5
Person 93.6
Suit 90.5
Tie 90.3
Overcoat 88
Face 87
Head 87
Person 85.7
Hat 84.5
Photography 76.8
Hat 72.3
Person 71
Tie 63.9
Jewelry 61.8
Necklace 61.8
Portrait 57.2
Cap 57.1
Terminal 56.8
Railway 56.8
Train 56.8
Train Station 56.8
Transportation 56.8
Vehicle 56.8

Clarifai
created on 2018-05-11

people 99.7
retro 98.3
man 97.3
movie 95.8
adult 94.9
vintage 94.4
old 94.1
woman 93.2
portrait 92.1
monochrome 91.7
group 90.8
nostalgia 88.9
lid 88.6
elderly 82.4
group together 82.1
wear 78.4
train 75.7
bowler 74.6
transportation system 73.7
horizontal 73.2

Imagga
created on 2023-10-05

marimba 40.4
percussion instrument 33.7
bartender 31.8
bow tie 28.2
man 28.2
musical instrument 27.2
people 26.2
waiter 22.6
necktie 21.6
male 21.3
business 18.8
employee 16.8
dining-room attendant 16.6
person 15.8
black 15.7
worker 15.4
garment 14.8
happy 14.4
adult 14.3
couple 13.9
clothing 13.9
men 13.7
group 13.7
suit 13.7
building 13.6
silhouette 11.6
office 11.2
executive 11
inside 11
groom 10.7
corporate 10.3
love 10.2
manager 10.2
work 10.2
smiling 10.1
businessman 9.7
portrait 9.7
meeting 9.4
architecture 9.4
smile 9.3
city 9.1
success 8.8
standing 8.7
glass 8.5
professional 8.5
handsome 8
women 7.9
face 7.8
move 7.7
boss 7.6
casual 7.6
window 7.5
hall 7.3
family 7.1
night 7.1
job 7.1
happiness 7
indoors 7
sky 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.3
old 78.1
group 68
people 58.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 87.3%
Surprised 7.3%
Fear 6.1%
Confused 4.6%
Sad 2.5%
Angry 1.6%
Happy 1.6%
Disgusted 1.1%

AWS Rekognition

Age 23-31
Gender Female, 96.5%
Sad 100%
Calm 10.4%
Surprised 6.3%
Fear 5.9%
Confused 1.3%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.8%
Calm 97.7%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Angry 0.5%
Confused 0.5%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 33-41
Gender Female, 74%
Surprised 94.4%
Fear 20.7%
Calm 6.4%
Angry 3.8%
Sad 3.2%
Happy 0.6%
Disgusted 0.5%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 63.8%
Calm 71.6%
Angry 11.9%
Surprised 6.6%
Fear 6.4%
Confused 5.9%
Disgusted 4.2%
Happy 3%
Sad 2.7%

AWS Rekognition

Age 21-29
Gender Male, 79.5%
Calm 96.1%
Surprised 6.3%
Fear 5.9%
Sad 3.2%
Angry 0.5%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%
Female 99.2%
Woman 99.2%
Hat 98.2%
Handbag 94.5%
Suit 90.5%
Tie 90.3%
Necklace 61.8%

Categories

Text analysis

Amazon

39
TR
OF
52
a

Google

39 TR
39
TR