Human Generated Data

Title

Untitled (Union Square, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2867

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Union Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2867

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Bench 100
Furniture 100
Adult 98.9
Male 98.9
Man 98.9
Person 98.9
Adult 97.6
Male 97.6
Man 97.6
Person 97.6
Adult 97.5
Male 97.5
Man 97.5
Person 97.5
Adult 97.4
Male 97.4
Man 97.4
Person 97.4
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Adult 96.1
Male 96.1
Man 96.1
Person 96.1
Adult 92.9
Male 92.9
Man 92.9
Person 92.9
Person 91.6
Face 88.5
Head 88.5
Person 84.4
Adult 75.2
Person 75.2
Bride 75.2
Female 75.2
Wedding 75.2
Woman 75.2
Overcoat 71.8
Formal Wear 64.1
Suit 64.1
Person 63.2
Car 62.8
Transportation 62.8
Vehicle 62.8
Hat 59.7
Cap 57.9
Sitting 57.6
Jacket 57.1
Smoke 55.9
Park Bench 55

Clarifai
created on 2018-05-10

people 99.9
group together 98.5
adult 98.3
many 97.7
group 96
military 95.3
uniform 95.2
administration 94.8
wear 93.7
outfit 93.4
man 92.8
leader 91.6
several 87.1
vehicle 85.8
war 85.4
military uniform 84.8
veil 83.2
soldier 79.4
transportation system 74.6
one 74.3

Imagga
created on 2023-10-06

brass 55.8
wind instrument 47.8
cornet 45
man 33.6
male 31.9
musical instrument 31.7
person 26.4
people 24.5
sax 20.6
silhouette 19
men 18
business 16.4
adult 15.8
device 15.7
businessman 15
black 13.2
work 12.5
job 12.4
horn 12.2
room 12.2
symbol 12.1
group 12.1
worker 11.5
hand 11.4
human 11.2
skill 10.6
success 10.5
event 10.2
protection 10
industrial 10
sport 9.9
suit 9.7
player 9.6
music 9.2
dark 9.2
holding 9.1
office 8.8
stage 8.7
lifestyle 8.7
education 8.7
sitting 8.6
classroom 8.4
power 8.4
training 8.3
competition 8.2
blackboard 8.2
danger 8.2
light 8
looking 8
night 8
executive 8
couple 7.8
portrait 7.8
concert 7.8
teacher 7.7
drawing 7.7
factory 7.7
class 7.7
crowd 7.7
athlete 7.6
guy 7.5
smoke 7.4
instrumentality 7.4
professional 7.3
student 7.2
dirty 7.2
team 7.2
women 7.1
working 7.1
sky 7
bass 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.9
outdoor 93
black 86.6
old 85.2
group 74.8
white 73.5
people 70.5
vintage 27.6
crowd 1.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Sad 100%
Calm 7.5%
Surprised 6.4%
Fear 5.9%
Confused 1.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Male, 96.6%
Calm 78.7%
Happy 10%
Sad 8.3%
Surprised 6.3%
Fear 6%
Angry 0.5%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 98.6%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 43-51
Gender Female, 54.7%
Calm 94.7%
Surprised 6.5%
Fear 6.1%
Sad 3%
Angry 1.1%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.9%
Male 98.9%
Man 98.9%
Person 98.9%
Bride 75.2%
Female 75.2%
Woman 75.2%
Suit 64.1%
Car 62.8%
Hat 59.7%

Text analysis

Amazon

DAYS
KEEP
KEEP OFF
OFF
S.
S.KLEIN
BACKWITHIN
5
KLEIN
WONNEY