Human Generated Data

Title

One of the few remaining inhabitants of Zinc, Arkansas
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3062

Human Generated Data

Title

One of the few remaining inhabitants of Zinc, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Hat 99.9
Person 99.6
Human 99.6
Coat 98.4
Suit 98.4
Overcoat 98.4
Sun Hat 93.4
Cowboy Hat 75.4
Face 58.7

Imagga
created on 2021-12-15

hat 100
cowboy hat 100
headdress 84.2
clothing 63.5
man 50.4
male 46.1
person 36.1
portrait 29.8
consumer goods 29.4
covering 29.1
people 28.5
face 27.7
adult 23.3
bow tie 21.2
senior 20.6
men 18.9
necktie 18.2
old 18.1
worker 18
hand 16.7
guy 16.6
black 16.2
handsome 16.1
job 15.9
businessman 15.9
shirt 15.9
happy 15
business 14.6
looking 14.4
professional 14.4
smile 14.3
industry 13.7
serious 13.4
work 13.4
grandfather 13.3
suit 13.3
construction 12.8
expression 12.8
cowboy 12.8
attractive 11.9
head 11.8
engineer 11.7
elderly 11.5
safety 11
model 10.9
smiling 10.9
builder 10.9
western 10.7
look 10.5
building 10.3
lifestyle 10.1
occupation 10.1
helmet 9.6
boy 9.6
glasses 9.3
one 9
style 8.9
success 8.9
garment 8.8
corporate 8.6
uniform 8.6
hard 8.6
tie 8.5
indoor 8.2
alone 8.2
industrial 8.2
eye 8
office 8
hair 7.9
hardhat 7.8
architect 7.7
modern 7.7
youth 7.7
formal 7.6
casual 7.6
age 7.6
engineering 7.6
dark 7.5
human 7.5
manager 7.5
old-timer 7.4
sexy 7.2
beard 7

Google
created on 2021-12-15

Hat 94.3
Beard 90.9
Black 89.6
Sun hat 89.1
Fedora 86.9
Black-and-white 85.3
Street fashion 85
Style 84.1
Collar 83.9
Headgear 81.8
Window 79.6
Eyewear 79.5
Facial hair 79
Blazer 78.3
Monochrome photography 76.6
Moustache 75.9
Costume hat 75.5
Monochrome 75.1
Bow tie 72.8
Vintage clothing 72.3

Microsoft
created on 2021-12-15

fashion accessory 99.7
man 99.4
fedora 98.7
hat 98.6
person 98.4
cowboy hat 95.7
window 94.3
sun hat 93.1
human face 92.5
clothing 91.6
wearing 88
black and white 81.2
old 75.9
suit 72.8
white 70
smile 69.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-52
Gender Male, 97.8%
Calm 75.1%
Angry 16.6%
Sad 6%
Confused 0.9%
Happy 0.5%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 99.6%
Suit 98.4%

Captions

Microsoft

a man wearing a hat in front of a window 95.3%
a man wearing a hat 95.2%
a man wearing a hat in front of a building 95.1%