Human Generated Data

Title

Untitled (Worthington, Ohio)
Date

August 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3462
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Worthington, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3462

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Sun Hat 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.7
Jacket 99.5
Person 99
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Formal Wear 95.1
Suit 95.1
Hat 89.5
Face 88.3
Head 88.3
Overcoat 80.1
Hat 79.6
Suit 78.7
Photography 57.9
Portrait 57.9
Body Part 57.5
Finger 57.5
Hand 57.5
Cap 57.1
Hat 56.6

Clarifai
created on 2018-05-10

people 99.9
lid 99.8
fedora 99.5
man 98.7
veil 98.1
adult 96.7
two 95.2
woman 94
wear 94
street 93.3
cowboy 92.8
sheriff 92.7
cowboy hat 92.3
bowler 91.6
three 91.1
elderly 89
cowman 86.9
group 86.5
group together 85.9
monochrome 85.7

Imagga
created on 2023-10-06

man 55.1
male 46.1
helmet 43
builder 41.9
construction 41.9
worker 41.6
industry 38.4
engineer 38.2
hat 36.2
occupation 33.9
work 32.9
job 30.9
architect 30.9
foreman 30.8
people 29.5
person 29
site 28.1
professional 25.7
working 25.6
industrial 25.4
men 24.9
safety 24.8
building 24.7
hardhat 24.5
business 24.3
manager 24.2
engineering 23.8
uniform 23.5
contractor 23.3
clothing 23.2
adult 20.8
equipment 19.9
architecture 19.5
happy 18.8
smile 17.8
workplace 17.1
military uniform 17
handsome 16.9
success 16.9
portrait 16.8
suit 16.4
protective 15.6
cowboy hat 15.3
plans 14.7
protection 14.5
smiling 14.5
development 14.3
factory 13.9
supervisor 13.8
successful 13.7
designer 13.5
structure 13.5
skill 13.5
attractive 13.3
businessman 13.2
black 12.6
team 12.5
collar 12.5
expert 11.8
employment 11.6
project 11.5
profession 11.5
build 11.4
standing 11.3
looking 11.2
teamwork 11.1
house 10.9
blueprints 10.8
urban 10.5
hard 10.5
mature 10.2
two 10.2
face 9.9
headdress 9.9
consultant 9.7
labor 9.7
workers 9.7
covering 9.6
diversity 9.6
consumer goods 9.6
repair 9.6
plan 9.4
private 9.3
indoor 9.1
outdoors 8.9
steel 8.8
clipboard 8.8
home 8.8
talk 8.6
corporate 8.6
tools 8.5
one 8.2
warehouse 8
hard hat 7.9
inspector 7.9
tool 7.7
casual 7.6
meeting 7.5
happiness 7

Google
created on 2018-05-10

photograph 95.3
black and white 87.8
gentleman 75.1
standing 75.1
monochrome photography 73.4
monochrome 64.2
human behavior 61.1
military person 56.6
vintage clothing 53.4
military officer 53.3
stock photography 50.5

Microsoft
created on 2018-05-10

person 99.9
outdoor 99.3
man 97.4
standing 86.9
people 68.4
old 65.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 66-76
Gender Male, 99.7%
Calm 97.8%
Surprised 6.4%
Fear 6%
Sad 2.3%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 58-66
Gender Male, 99.1%
Happy 74.2%
Calm 17.2%
Surprised 6.5%
Fear 6.2%
Sad 4.2%
Confused 1.1%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 18-24
Gender Male, 83.1%
Calm 90.3%
Surprised 8.5%
Fear 6.1%
Sad 2.5%
Happy 2.3%
Confused 0.6%
Disgusted 0.5%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.7%
Male 99.7%
Man 99.7%
Person 99.7%
Suit 95.1%
Hat 89.5%

Text analysis

Amazon

RESTAUP
ROYAL
CH
CO

Google

CH RESTAUP OYAL
CH
RESTAUP
OYAL