Human Generated Data

Title

Untitled (Sixth Avenue, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2948
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2948

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 99.9
Formal Wear 99.9
Suit 99.9
Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Person 99.5
Adult 99.5
Male 99.5
Man 99.5
Door 98.1
Hat 94.9
Sun Hat 86.1
Cap 57.3
Overcoat 55

Clarifai
created on 2018-05-10

people 99.8
one 98.3
adult 98.1
man 95.3
monochrome 95
portrait 92.6
wear 92.3
indoors 91.3
street 90
woman 87
administration 86.9
room 86.2
veil 85.3
education 84.7
offense 82.7
outfit 81.9
school 81.3
side view 78.2
group 76.9
two 76.9

Imagga
created on 2023-10-06

prison 49
man 41.7
correctional institution 38.7
person 37.6
male 32.6
people 29.6
adult 29.1
penal institution 29
scholar 27.8
men 22.3
intellectual 22.2
institution 21.3
portrait 20.7
clothing 20.7
work 20.4
professional 20.2
smile 19.9
worker 19.4
hat 18.4
uniform 18
job 17.7
business 17
looking 16.8
smiling 16.6
happy 16.3
standing 15.6
helmet 15.4
one 14.9
military uniform 14.8
building 13.6
architecture 13.3
construction 12.8
occupation 12.8
industry 12.8
face 12.8
engineer 12.8
working 12.4
lifestyle 12.3
suit 11.9
happiness 11.7
handsome 11.6
architect 11.6
office 10.8
bow tie 10.7
attractive 10.5
site 10.3
establishment 10.1
protective 9.7
businessman 9.7
profession 9.6
color 9.5
coat 9.4
shirt 9.3
employee 9.3
builder 9.2
safety 9.2
student 9.2
holding 9.1
old 9.1
necktie 8.8
labor 8.8
mid adult 8.7
education 8.7
confidence 8.6
engineering 8.6
youth 8.5
vintage 8.3
20s 8.2
indoor 8.2
outdoors 8.2
confident 8.2
cheerful 8.1
success 8
posing 8
indoors 7.9
urban 7.9
contractor 7.8
model 7.8
serious 7.6
casual 7.6
covering 7.6
fashion 7.5
house 7.5
city 7.5
manager 7.4
consumer goods 7.4
equipment 7.3
guy 7.3
home 7.2
jacket 7.1
cell 7.1
medical 7.1
travel 7

Google
created on 2018-05-10

white 96
photograph 95.9
black and white 91.5
standing 90.6
photography 83.1
monochrome photography 82.9
snapshot 81.8
gentleman 78.9
monochrome 71.8
vintage clothing 71
human 68.4
portrait 67.9
vision care 66
window 62.4
glasses 61.2
stock photography 52.8
street 50.2

Microsoft
created on 2018-05-10

person 97.9
hat 89.4
outdoor 87
white 75.6
old 72.1
black 66.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Confused 44.8%
Calm 40.9%
Angry 9%
Surprised 7%
Fear 6.1%
Sad 3.1%
Disgusted 0.7%
Happy 0.2%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Adult 99.5%
Male 99.5%
Man 99.5%
Hat 94.9%

Categories

Imagga

people portraits 78.6%
paintings art 17.8%
streetview architecture 2.1%

Captions

Microsoft
created on 2018-05-10

Mos Def wearing a black hat 86.9%
a black and white photo of Mos Def 86.8%
Mos Def wearing a black hat 86.7%