Human Generated Data

Title

Untitled (Smithland, Kentucky)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3467

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Smithland, Kentucky)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3467

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Person 98.9
Human 98.9
Person 98.2
Person 94.7
Suit 85
Coat 85
Overcoat 85
Hat 74.5
Sun Hat 68.4
Military 63.1
Face 59.5
Door 57
Officer 56.7
Military Uniform 56.7
Man 55.9
Hat 51.2

Clarifai
created on 2023-10-15

people 99.9
lid 98.7
man 98.7
group 98.5
three 98.2
veil 97.7
group together 97.4
administration 96
four 95.6
leader 95
collage 93.7
two 93.4
nostalgia 93.1
adult 93
wear 89.6
retro 88.6
police 88.3
several 87.5
vehicle 86.9
fedora 86.9

Imagga
created on 2021-12-15

man 47.7
hat 45.7
male 39
clothing 32.7
people 30.7
person 28.6
cowboy hat 28.6
men 23.2
adult 22.8
portrait 22
bow tie 21
military uniform 21
uniform 20.9
business 20.6
face 19.9
professional 19.8
work 19.6
headdress 19.1
suit 17.7
necktie 17.1
covering 16.2
hand 15.9
smile 15.7
worker 15.6
consumer goods 15.1
businessman 15
happy 13.8
attractive 13.3
guy 12.9
building 12.8
looking 12.8
black 12.6
office 12.5
senior 12.2
construction 12
occupation 11.9
old 11.8
handsome 11.6
job 11.5
lifestyle 10.8
working 10.6
look 10.5
industry 10.2
smiling 10.1
safety 10.1
head 10.1
helmet 9.7
success 9.7
skill 9.6
couple 9.6
meeting 9.4
happiness 9.4
site 9.4
model 9.3
call 9.1
human 9
style 8.9
engineer 8.9
garment 8.8
indoors 8.8
serious 8.6
shirt 8.4
mature 8.4
one 8.2
standing 7.8
architecture 7.8
corporate 7.7
workplace 7.6
two 7.6
engineering 7.6
tie 7.6
window 7.5
one person 7.5
manager 7.4
jacket 7.4
indoor 7.3
team 7.2
shop 7.1
hair 7.1
love 7.1

Google
created on 2021-12-15

Clothing 98.8
Outerwear 95.1
Photograph 94.2
Hat 92.6
Coat 87
Fedora 85.9
Sun hat 83.1
Headgear 81.7
Art 81.6
Collar 79.4
Monochrome 75
Blazer 74.6
Snapshot 74.3
White-collar worker 73
Monochrome photography 72.1
Vintage clothing 71.1
Room 67.6
Event 67.3
Font 67.2
Picture frame 66.9

Microsoft
created on 2021-12-15

person 99.9
clothing 97.2
text 96.7
drawing 95
man 93.9
outdoor 92.8
sketch 88
hat 85.8
people 65.7
gallery 63.7
old 61.8
fedora 58.6
fashion accessory 54.8
photograph 53.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-60
Gender Male, 88.1%
Calm 99.3%
Sad 0.4%
Happy 0.3%
Angry 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 23-37
Gender Male, 97.6%
Calm 96.8%
Sad 1.7%
Confused 0.7%
Angry 0.3%
Surprised 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Suit 85%
Hat 74.5%

Categories

Imagga

paintings art 93.7%
people portraits 4.5%

Text analysis

Amazon

M
M CHOCERYTES
Rub
STUDELAND
CHOCERYTES

Google

ND OROCERY CS
ND
OROCERY
CS