Human Generated Data

Title

Untitled (Zinc, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1138
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Zinc, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1138

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Photography 98.7
Face 98.7
Head 98.7
Portrait 98.7
Coat 97.4
Cap 95.1
Firearm 87.9
Gun 87.9
Rifle 87.9
Weapon 87.9
Outdoors 78.3
People 72.2
Person 71.6
Nature 66.6
Hat 66.3
Countryside 65.5
Architecture 58
Building 58
Housing 58
Baseball Cap 57.3
Hut 57.3
Rural 57.3
Vest 56.6
Sun Hat 56.5
House 55.9
Porch 55.4
Military 55.3
Military Uniform 55.3

Clarifai
created on 2018-05-11

people 100
military 99.3
adult 98.9
group together 98.8
war 98.4
soldier 98.2
group 98.1
uniform 98
military uniform 96
administration 95.5
man 95.4
outfit 94.5
two 93.9
several 93.7
veil 92.7
wear 92.4
three 90.7
five 88.6
vehicle 88.6
weapon 88.4

Imagga
created on 2023-10-06

man 35.6
people 31.8
male 26.2
military uniform 25.9
person 24.3
uniform 23.7
clothing 23.7
barbershop 19.3
shop 19
men 18.9
city 18.3
adult 17.6
work 17.3
mercantile establishment 14.4
old 13.9
portrait 13.6
black 13.2
smile 12.8
happy 11.9
covering 11.5
business 11.5
building 11.4
professional 11.3
consumer goods 11.3
casual 11
worker 10.9
smiling 10.8
hat 10.6
urban 10.5
safety 10.1
job 9.7
equipment 9.7
place of business 9.6
industry 9.4
face 9.2
protection 9.1
industrial 9.1
room 9
looking 8.8
look 8.8
labor 8.8
standing 8.7
lifestyle 8.7
two 8.5
leisure 8.3
school 8.2
private 8.1
history 8
family 8
home 8
helmet 7.9
office 7.9
couple 7.8
happiness 7.8
sitting 7.7
engineer 7.6
life 7.6
senior 7.5
outdoors 7.5
mature 7.4
suit 7.4
occupation 7.3
world 7.3
aged 7.2
team 7.2
seller 7.1
businessman 7.1
architecture 7

Google
created on 2018-05-11

photograph 95.6
soldier 92.5
military 91.1
black and white 87.9
military officer 86.3
army 86
military person 85.6
troop 84.3
snapshot 81.8
militia 76
monochrome photography 73.3
vehicle 70.8
staff 69.4
monochrome 62.6
military organization 58.3
vintage clothing 56.6
non commissioned officer 53.8
infantry 51.5

Microsoft
created on 2018-05-11

outdoor 98.5
person 98.3
store 53.5
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 97.6%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Confused 0.8%
Angry 0.6%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 97.3%
Sad 99.6%
Calm 30.2%
Surprised 6.4%
Fear 6.2%
Confused 1.8%
Disgusted 0.6%
Happy 0.4%
Angry 0.3%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 75%
Sad 7.8%
Surprised 7.5%
Angry 7.5%
Fear 6.2%
Happy 2.1%
Disgusted 2%
Confused 0.8%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Male 99.6%
Man 99.6%
Person 99.6%
Hat 66.3%

Text analysis

Amazon

STAR
STORE
AGENCY
GENERAL
LOCAL AGENCY
-
LOCAL
I
STAR TOBACK
TOBACK

Google

ENERAL TORE TAR
ENERAL
TORE
TAR