Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania
Date

1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3108

Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.4
Human 99.4
Person 99.4
Boy 89.4
Face 88
Machine 86.9
Wheel 86.9
Hat 79
Clothing 79
Apparel 79
Child 62.6
Kid 62.6
Outdoors 60.6
People 60.3
Smile 59.6
Photography 59.2
Photo 59.2
Portrait 58.8

Imagga
created on 2021-12-15

child 57.8
happy 26.9
person 26.2
people 26.2
male 24
adult 22.6
man 22.2
world 20.7
portrait 20.7
smiling 20.3
happiness 19.6
smile 18.5
outdoors 17.9
boy 17.4
love 17.4
summer 16.1
joy 15.9
family 15.1
juvenile 15.1
kid 15.1
sibling 14.9
sitting 14.6
parent 14.4
father 14.4
dad 14.1
couple 13.9
attractive 13.3
outdoor 13
cute 12.9
youth 12.8
fun 12.7
childhood 12.5
mother 12.5
together 12.3
face 12.1
looking 12
car 11.9
pretty 11.9
girls 11.8
beach 11.8
day 11
model 10.9
vacation 10.6
son 10.6
little 10.6
clothing 10.6
old 10.4
enjoying 10.4
black 10.3
women 10.3
grass 10.3
two 10.2
lifestyle 10.1
children 10
leisure 10
vehicle 9.9
sky 9.6
hair 9.5
outside 9.4
holding 9.1
one 9
sand 8.8
home 8.8
eyes 8.6
expression 8.5
relationship 8.4
park 8.2
playing 8.2
lady 8.1
handsome 8
brunette 7.8
play 7.8
work 7.7
laugh 7.7
fashion 7.5
care 7.4
camera 7.4
adorable 7.4
sexy 7.2
holiday 7.2
daughter 7.1
posing 7.1
look 7

Google
created on 2021-12-15

Helmet 92.8
Military uniform 90.5
Military person 89.2
Smile 88.1
Army 82.4
Marines 82.1
Soldier 81.6
Headgear 81.5
Vehicle 79.8
Cap 79.2
Military organization 78.1
Motor vehicle 77.7
Personal protective equipment 76.3
Jacket 75.7
Infantry 75.3
Non-commissioned officer 74.5
Squad 74
Crew 72.9
Uniform 72.3
Military 69.1

Microsoft
created on 2021-12-15

text 99.7
human face 96.6
clothing 95.2
outdoor 95.1
person 93.4
smile 92.8
man 84.8
black and white 81.6
vehicle 75.7
land vehicle 65.9
car 59.3
posing 47.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-26
Gender Male, 98.2%
Happy 84.5%
Calm 14.7%
Angry 0.5%
Sad 0.1%
Surprised 0.1%
Fear 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 2-8
Gender Male, 99.6%
Happy 96.5%
Calm 1.4%
Confused 0.9%
Surprised 0.4%
Angry 0.4%
Sad 0.2%
Fear 0.2%
Disgusted 0%

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Wheel 86.9%
Hat 79%

Captions

Microsoft

a group of people posing for a photo 91.6%
a group of people posing for the camera 91.5%
a group of people posing for a picture 91.4%