Human Generated Data

Title

Untitled (children of miners working in Sunbeam Mines, Scotts Run, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5604

Human Generated Data

Title

Untitled (children of miners working in Sunbeam Mines, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Human 99.3
Boy 99.3
Pants 98.9
Apparel 98.9
Clothing 98.9
Person 98.8
Person 98.2
Face 88.5
Denim 87.5
Jeans 87.5
Child 63.3
Kid 63.3
People 62.3
Photography 58
Photo 58
Portrait 56.6
Baby 56.2

Clarifai
created on 2019-11-11

people 100
child 99.8
two 99.1
portrait 98.7
son 98.5
three 98
group 98
sibling 96.7
offspring 96
boy 95.1
adult 93.9
four 93.4
family 92
man 91.8
facial expression 91.6
actress 90.9
wear 90
war 89.6
affection 88.6
baby 88.3

Imagga
created on 2019-11-11

sibling 50
child 36.1
portrait 25.2
people 21.8
person 20.3
adult 18.8
kin 18.1
face 17.7
happiness 17.2
statue 17.1
family 16.9
cute 16.5
hair 15.8
human 15.7
blond 15.6
model 14.8
outdoors 14.2
smiling 13.7
sculpture 13.4
park 13.2
happy 13.2
boy 13
fashion 12.8
man 12.8
love 12.6
outdoor 12.2
mother 12.2
black 12.1
youth 11.9
women 11.9
two 11.9
girls 11.8
clothing 11.8
childhood 11.6
male 11.6
posing 11.5
kid 11.5
little 11.5
parent 11.3
old 11.1
head 10.9
smile 10.7
art 10.4
world 10.2
dress 9.9
cheerful 9.7
style 9.6
sexy 9.6
daughter 9.3
joy 9.2
hand 9.1
attractive 9.1
one 9
sepia 8.7
marble 8.7
stone 8.6
culture 8.5
togetherness 8.5
pretty 8.4
vintage 8.3
brother 8.2
fun 8.2
playing 8.2
lady 8.1
lifestyle 7.9
outside 7.7
leisure 7.5
holding 7.4
retro 7.4
sensuality 7.3
looking 7.2
religion 7.2
grass 7.1
antique 7.1
summer 7.1

Google
created on 2019-11-11

Photograph 97.3
People 95.3
Snapshot 88.5
Standing 88.4
Vintage clothing 81.6
Photographic paper 78.8
Photography 75.7
Retro style 73.3
Stock photography 69.2
Grass 68.8
Adaptation 67
Child 64.5
Family 62.9
Black-and-white 56.4
Sibling 52.2
Gesture 51.7

Microsoft
created on 2019-11-11

person 100
clothing 98.7
toddler 96.8
boy 94.5
human face 94.4
child 93.3
text 93.2
baby 91.9
standing 87.9
smile 83.6
posing 41

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Female, 87.8%
Happy 2.3%
Calm 0.7%
Angry 0.2%
Surprised 0.1%
Fear 0.3%
Disgusted 0.1%
Confused 0.2%
Sad 96.2%

AWS Rekognition

Age 4-12
Gender Male, 55.3%
Surprised 0.3%
Confused 0.1%
Sad 1.8%
Happy 22%
Disgusted 0.1%
Fear 0.1%
Calm 75.4%
Angry 0.2%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people posing for a photo 95.1%
a group of people posing for the camera 95%
a man standing in front of a group of people posing for a photo 88.5%