Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania
Date

1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3107

Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Person 99.2
Face 90.9
Hat 83.2
Clothing 83.2
Apparel 83.2
People 69.5
Outdoors 69.2
Photography 65.6
Photo 65.6
Portrait 65.2
Smile 58.5
Wheel 57.9
Machine 57.9

Imagga
created on 2021-12-15

child 55.2
sibling 28.2
portrait 24.6
people 24.5
male 24.4
person 23.8
man 22.8
happy 22.6
love 20.5
adult 20
childhood 18.8
beach 18.5
outdoors 17.9
face 17
kid 16.8
outdoor 16.8
boy 16.5
dad 16.4
summer 16.1
parent 15.9
father 15.7
fun 15.7
smile 15.7
smiling 15.2
family 15.1
happiness 14.9
world 14.8
girls 14.6
youth 14.5
sand 14.2
couple 13.9
vacation 13.9
outside 13.7
hair 13.5
son 13.1
juvenile 13.1
men 12.9
playing 12.8
two 12.7
model 12.4
lifestyle 12.3
mother 12.1
one 11.9
children 11.8
joy 11.7
holiday 11.5
together 11.4
play 11.2
pretty 11.2
black 10.8
leisure 10.8
cute 10.8
little 10.6
fashion 10.5
human 10.5
attractive 10.5
women 10.3
park 9.9
old 9.8
brother 9.4
sky 8.9
lady 8.9
body 8.8
day 8.6
enjoying 8.5
clothing 8.5
casual 8.5
senior 8.4
active 8.1
looking 8
sea 7.8
life 7.7
eyes 7.7
expression 7.7
sport 7.7
hat 7.6
toddler 7.6
hand 7.6
healthy 7.6
cheerful 7.3
sexy 7.2
activity 7.2
grass 7.1

Google
created on 2021-12-15

Helmet 89.6
Vehicle 86.3
Military person 83.6
Motor vehicle 83.5
Headgear 81.1
Military uniform 80.3
Soldier 80.1
Adaptation 79.2
Marines 75
Cap 74.4
Military organization 73.1
Non-commissioned officer 70.5
Crew 69.9
Combat vehicle 69.3
Personal protective equipment 68.7
Infantry 68.4
Army 67.9
Monochrome 67
Uniform 65.4
Stock photography 63.2

Microsoft
created on 2021-12-15

text 99.5
human face 98.1
clothing 96.8
person 95.6
smile 95.3
outdoor 92.8
black and white 85.9
man 73
posing 48.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-21
Gender Male, 96%
Happy 88.6%
Calm 10.9%
Angry 0.3%
Sad 0.1%
Surprised 0.1%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 2-8
Gender Male, 99.3%
Happy 95.8%
Calm 1.4%
Confused 1.2%
Angry 0.5%
Surprised 0.5%
Sad 0.3%
Fear 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 83.2%
Wheel 57.9%

Captions

Microsoft

a group of people posing for a photo 91.2%
a group of people posing for the camera 91.1%
a group of people posing for a picture 91%