Human Generated Data

Title

Man gathering good coal from the slag heaps at Nanty Glo, Pennsylvania
Date

1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3110

Human Generated Data

Title

Man gathering good coal from the slag heaps at Nanty Glo, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Slope 97.2
Soil 94.1
Outdoors 92.3
Rubble 90.1
Gravel 83.1
Road 83.1
Dirt Road 83.1
Coal 82.5
Nature 75.6
Mining 62.6
Worker 59.9
Slate 57.5

Imagga
created on 2021-12-15

thatch 51.4
grave 40.4
roof 39.2
travel 36.7
mountain 32.7
stone 31.3
protective covering 30.7
sky 30
rock 29.6
desert 29
landscape 27.6
ancient 26
sand 24.8
history 24.2
tourism 23.2
cliff 22.5
rocks 21.7
covering 20.3
clouds 19.5
outdoors 18.7
tourist 18.7
architecture 18.1
hill 17.8
monument 17.8
pyramid 16.8
ascent 16.8
scenic 16.7
landmark 16.3
old 16.1
mountains 15.8
slope 15.5
summer 14.8
peak 14.5
pharaoh 13.9
wall 13.7
construction 13.7
sun 13.7
park 13.2
destination 13.1
vacation 13.1
culture 12.8
archeology 12.8
geology 12.7
great 12.5
stones 12.3
canyon 12
national 11.8
scenery 11.7
environment 11.5
outdoor 11.5
east 11.2
famous 11.2
civilization 10.8
sandstone 10.8
temple 10.7
hiking 10.6
wilderness 10.5
adventure 10.5
geological formation 10.4
rampart 10.4
heat 10.2
holiday 10.1
building 9.8
wonder 9.8
hike 9.8
ruins 9.8
scene 9.5
historical 9.4
dry 9.3
land 9.3
tomb 8.9
climb 8.8
climbing 8.8
natural 8.7
day 8.6
extreme 8.6
brick 8.4
historic 8.3
river 8
tower 8
trekking 7.9
ruin 7.8
plant 7.5
snow 7.3
sea 7.1

Google
created on 2021-12-15

Wood 84
Adaptation 79.3
Bedrock 78.6
Landscape 76.6
Sky 76.5
Slope 75.4
Climbing 74.1
Monochrome 70.8
Monochrome photography 70.3
Art 69.2
Rectangle 66.9
Rock 66.5
Sport climbing 64.1
Stock photography 63.7
Recreation 63.5
Soil 62.5
Outcrop 61.6
History 61.6
Visual arts 59.4
Fault 58.5

Microsoft
created on 2021-12-15

mountain 98.8
outdoor 98.1
text 95.1
hiking 91.6
person 88.8
sky 80.5
man 79.1
clothing 73.3
black and white 50.5

Face analysis

Amazon

Google

AWS Rekognition

Age 51-69
Gender Male, 94.1%
Calm 84%
Happy 12.3%
Sad 3.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a person in a rocky area 61.6%
a person flying through the air on a rocky hill 35%
a person in a rocky area 34.9%