Human Generated Data

Title

Untitled (Mr. Kollar, Hungarian miner, Calumet, Pennsyvania)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1298
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mr. Kollar, Hungarian miner, Calumet, Pennsyvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1298

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hardhat 100
Helmet 100
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Face 99.5
Head 99.5
Photography 99.5
Portrait 99.5
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Formal Wear 98
Suit 98
Hat 76
Coat 73.2
Shirt 63
Body Part 57.5
Hand 57.5
Accessories 57.2
Tie 57.2
Sun Hat 56.8
Door 55.6
Jacket 55.1

Clarifai
created on 2018-05-11

people 99.9
portrait 99.4
adult 99.2
one 99.2
man 98.6
lid 97.3
wear 96.6
elderly 95.8
two 94.4
veil 93.7
administration 89.5
three 86.8
facial hair 86.1
facial expression 85.8
outfit 84.9
monochrome 83.8
mustache 83.3
leader 80.8
music 79.9
coat 79.3

Imagga
created on 2023-10-06

hat 47.8
man 45.7
male 34.8
person 34.1
cowboy hat 30.7
clothing 22.1
people 21.7
worker 21.7
headdress 20
work 19.6
men 18
job 17.7
adult 17.6
portrait 16.8
home 16.7
building 14.3
hair 14.3
face 14.2
senior 13.1
guy 12.4
professional 12.1
construction 12
safety 12
happy 11.9
old 11.8
handsome 11.6
tool 11.3
shirt 11.3
one 11.2
bow tie 11
occupation 11
model 10.9
black 10.8
working 10.6
repair 10.5
sitting 10.3
industrial 10
necktie 9.9
helmet 9.9
builder 9.8
labor 9.7
mustache 9.7
equipment 9.6
smiling 9.4
industry 9.4
site 9.4
head 9.2
protection 9.1
eye 8.9
looking 8.8
indoors 8.8
look 8.8
collar 8.6
elderly 8.6
smile 8.6
covering 8.4
mature 8.4
glasses 8.3
plunger 8.2
interior 8
consumer goods 8
beard 7.9
cowboy 7.9
standing 7.8
garment 7.8
western 7.7
laboratory 7.7
profession 7.7
serious 7.6
hand 7.6
style 7.4
indoor 7.3
pose 7.2
lifestyle 7.2
women 7.1

Google
created on 2018-05-11

photograph 95.9
black and white 91.5
monochrome photography 84
snapshot 81.8
photography 81.1
gentleman 81
standing 78.5
headgear 63.5
monochrome 63.3
stock photography 54.6
vintage clothing 52.6
fedora 52

Microsoft
created on 2018-05-11

person 99.9
man 97.2
old 83.6
hat 80.5
standing 76.4
white 71.8
black 71.2
posing 35.6
work-clothing 12.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 60.9%
Happy 21%
Angry 8.7%
Surprised 8.2%
Fear 6%
Sad 2.9%
Confused 2.3%
Disgusted 1.1%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Hat 76%
Coat 73.2%