Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3014
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3014

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 100
City 99.8
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Person 98.2
Road 98
Street 98
Urban 98
Cap 97
Outdoors 93
Face 92.1
Head 92.1
Overcoat 90.9
Adult 89.6
Male 89.6
Man 89.6
Person 89.6
Neighborhood 89.5
Smoke 86.5
Nature 83.9
Person 76.6
Hat 70
Weather 57.7
Photography 56.9
Portrait 56.9
Fog 56.8
Smog 56.8
Alley 55.3
Snow 55.1

Clarifai
created on 2018-05-10

people 99.9
adult 98.5
group 97
man 96.6
group together 96
two 95.2
street 94.2
three 92.4
administration 91.8
one 90.6
leader 89.3
wear 88.2
veil 87.4
home 83.3
four 82.1
woman 81.7
vehicle 80.6
several 80.4
lid 80.3
many 79.8

Imagga
created on 2023-10-05

hat 45.6
person 43.1
man 40.3
cowboy hat 34.1
scholar 32.8
male 32
people 30.1
headdress 28.5
clothing 28.4
intellectual 26.2
business 22.5
adult 21.6
smile 18.5
senior 17.8
building 17.3
face 17
happy 16.9
portrait 16.8
men 16.3
work 15.7
worker 15.6
corporate 14.6
sitting 14.6
black 14.5
looking 14.4
businessman 14.1
covering 13.6
handsome 13.4
old 13.2
office 13.1
lifestyle 13
professional 12.4
industry 12
hair 11.9
casual 11.9
cap 11.9
guy 11.2
smiling 10.8
job 10.6
consumer goods 10.6
attractive 10.5
manager 10.2
city 10
working 9.7
equipment 9.6
suit 9.6
mature 9.3
glasses 9.2
head 9.2
mortarboard 9.1
hand 9.1
engineer 9
one 9
success 8.8
room 8.6
reading 8.6
model 8.5
expression 8.5
youth 8.5
fashion 8.3
life 8
women 7.9
indoors 7.9
together 7.9
look 7.9
urban 7.9
boy 7.8
leader 7.7
construction 7.7
elderly 7.7
serious 7.6
finance 7.6
executive 7.6
horizontal 7.5
human 7.5
outdoors 7.5
jacket 7.4
back 7.3
occupation 7.3
indoor 7.3
computer 7.2
home 7.2
uniform 7.1
day 7.1
modern 7

Google
created on 2018-05-10

photograph 96
black and white 90.2
standing 85.8
snapshot 81.8
monochrome photography 80
monochrome 65.5
history 64.9
vintage clothing 63.5
stock photography 58.1

Microsoft
created on 2018-05-10

person 98.3
outdoor 96.9
man 93.3
old 78.7
white 64.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 43-51
Gender Male, 75.5%
Happy 96.2%
Surprised 6.3%
Fear 5.9%
Calm 3.6%
Sad 2.2%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 85.7%
Calm 98.4%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 16-22
Gender Male, 96.1%
Calm 67.5%
Sad 10%
Happy 9.5%
Angry 7%
Surprised 6.5%
Fear 6.2%
Confused 2.1%
Disgusted 1.1%

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Adult 99.5%
Adult 99.4%
Adult 89.6%
Male 99.5%
Male 99.4%
Male 89.6%
Man 99.5%
Man 99.4%
Man 89.6%
Person 99.5%
Person 99.4%
Person 98.2%
Person 89.6%
Person 76.6%
Hat 70%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a man 94.2%
an old photo of a man 94.1%
a man standing in front of a building 93.7%