Human Generated Data

Title

Kentucky coal miner, Jenkins, Kentucky
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3100

Human Generated Data

Title

Kentucky coal miner, Jenkins, Kentucky

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3100

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.7
Apparel 99.7
Person 99.6
Human 99.6
Hat 93.3
Worker 86.2
Helmet 79.5
Wood 78.7
Face 78.4
Hardhat 72.6
Carpenter 72.3
Sun Hat 67.2
Portrait 60.1
Photography 60.1
Photo 60.1

Clarifai
created on 2023-10-15

people 99.8
uniform 98.7
one 98.4
adult 97.7
man 97.3
portrait 97.3
military 96.1
lid 95.8
soldier 93.7
war 93.6
veil 93.1
two 92.9
wear 91.9
vintage 88.7
actor 82.4
three 81.7
industry 81.2
gun 80
train 79.9
outfit 79.3

Imagga
created on 2021-12-15

military uniform 46.5
uniform 39.5
clothing 36.5
man 27.5
old 27.1
statue 23.2
male 22.7
hat 21.2
covering 21
architecture 20.4
consumer goods 19.8
sculpture 18.4
person 18.4
ancient 17.3
city 16.6
private 16.1
building 16
history 15.2
people 14.5
one 13.4
monument 13.1
travel 12.7
portrait 12.3
antique 12.1
black 12
art 11.8
landmark 11.7
religion 11.6
adult 11.6
face 11.4
culture 11.1
engineer 11.1
historic 11
house 10.9
sky 10.8
vintage 10.7
smile 10.7
tourism 9.9
soldier 9.8
historical 9.4
stone 9.4
famous 9.3
commodity 9
human 9
worker 8.8
men 8.6
world 8.4
figure 8.2
structure 8.1
helmet 8
construction 7.7
god 7.6
hand 7.6
street 7.4
boy 7.2
day 7.1
roof 7
life 7

Google
created on 2021-12-15

Cap 88.5
Collar 83.3
Sleeve 82.3
Hat 80.7
Military person 72.6
Vintage clothing 69.3
Uniform 67.4
Monochrome photography 66.3
Monochrome 65.8
Stock photography 64.4
History 62.9
Sitting 58.3
Art 55.8
Wood 55.2
Portrait photography 54
Portrait 52.9
Personal protective equipment 52.3
Soldier 50.6
Blue-collar worker 50.2

Microsoft
created on 2021-12-15

person 99.3
text 99.1
clothing 98.8
outdoor 98.2
man 93.8
hat 91.4
human face 85.3
fashion accessory 80.8
firefighter 60.4
cowboy hat 60
old 42.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 97.8%
Angry 55.8%
Calm 26.9%
Sad 15.4%
Fear 1.3%
Confused 0.5%
Surprised 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 93.3%

Categories

Imagga

paintings art 80%
pets animals 18.6%