Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2860
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2860

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Coat 99
Hat 98.2
Hat 94.8
Face 88.3
Head 88.3
Shirt 87.6
Photography 67.7
Portrait 67.7
Accessories 59.6
Glasses 59.6
Formal Wear 57.8
Suit 57.8
Cap 57.7

Clarifai
created on 2018-05-10

people 99.8
lid 99.5
veil 98
adult 97.9
fedora 97.3
man 95.6
wear 93.8
elderly 91.8
one 90.9
two 88
cowboy hat 85.6
woman 84.2
administration 83.5
three 81.9
military 81.5
leader 81
outfit 79
newspaper 76.9
group 75.4
law 75.1

Imagga
created on 2023-10-06

hat 54
man 46.4
male 43.3
cowboy hat 37.3
person 34.2
clothing 30.4
worker 28
people 26.8
work 26.7
headdress 23.8
adult 23.6
men 23.2
portrait 22.6
job 22.1
engineer 20.7
uniform 20.2
old-timer 18.6
looking 17.6
professional 17.5
construction 17.1
industry 17.1
helmet 16.7
bow tie 16.6
occupation 16.5
necktie 16.1
surgeon 16
safety 15.6
black 15
face 14.9
builder 14.8
architect 14.5
senior 14.1
protection 13.6
building 13.5
hand 12.9
guy 12.9
industrial 12.7
happy 12.5
serious 12.4
medical 12.4
look 12.3
doctor 12.2
business 12.1
smile 12.1
old 11.8
equipment 11.7
covering 11.4
consumer goods 11.2
profession 10.5
suit 10.4
manager 10.2
nurse 10.2
holding 9.9
handsome 9.8
attractive 9.8
health 9.7
working 9.7
businessman 9.7
medicine 9.7
project 9.6
hospital 9.4
site 9.4
architecture 9.4
shirt 9.3
two 9.3
mask 9.1
care 9
hardhat 8.8
labor 8.8
patient 8.8
contractor 8.8
standing 8.7
engineering 8.6
seller 8.5
one 8.2
style 8.2
garment 8.1
smiling 8
lifestyle 7.9
couple 7.8
happiness 7.8
coat 7.8
harmonica 7.8
model 7.8
military uniform 7.7
factory 7.7
collar 7.7
illness 7.6
hard 7.6
plan 7.6
foreman 7.3
confident 7.3
pose 7.2
computer 7.2

Google
created on 2018-05-10

photograph 96.1
black and white 87.5
snapshot 81.8
standing 81.3
photography 79.5
monochrome photography 72.2
monochrome 68.8
vintage clothing 65.6
stock photography 59
human behavior 58.8
picture frame 51
history 50.4

Microsoft
created on 2018-05-10

person 99.4
outdoor 95.9
man 94.7
old 61.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 90.3%
Surprised 7.1%
Fear 5.9%
Angry 5.8%
Sad 2.2%
Disgusted 0.8%
Confused 0.8%
Happy 0.3%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 99.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0%

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Hat 98.2%
Glasses 59.6%

Captions

Microsoft
created on 2018-05-10

a man standing in front of a building 90.1%
a man standing in front of a store 87.3%
an old photo of a man 87.2%

Text analysis

Amazon

SALAD
THE
10
city
TEA
NET
THE BARON
شثلا city
BARON
شثلا
25