Human Generated Data

Title

Children of unemployed trapper, Plaquemines Parish, Louisiana
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3091

Human Generated Data

Title

Children of unemployed trapper, Plaquemines Parish, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.4
Human 99.4
Person 99.4
Clothing 98.9
Apparel 98.9
Person 98.4
Hat 94.6
People 92.6
Person 91.6
Family 79.6
Housing 77.1
Building 77.1
Cowboy Hat 69.8
Kid 57.7
Child 57.7
Face 55.7
Person 47.2

Imagga
created on 2021-12-15

sibling 63.6
mother 48.8
father 46.5
kin 46.4
parent 45.8
family 45.4
child 42.1
dad 39.6
happy 35.1
portrait 31.7
happiness 29.8
man 29.6
male 28.8
people 28.5
smiling 28.2
love 27.6
daughter 24.4
smile 22.1
couple 21.8
together 21
adult 20.7
fun 20.2
outdoors 19.4
playing 19.2
home 19.2
park 19
two 18.6
children 18.2
childhood 17.9
boy 17.4
lifestyle 17.4
son 17.1
girls 16.4
togetherness 16.1
kid 16
husband 15.3
joy 15
face 14.9
cheerful 14.6
cute 14.4
baby 13.7
dress 13.6
sitting 12.9
looking 12.8
casual 12.7
mom 12.6
day 12.6
wife 12.3
enjoying 12.3
laughing 12.3
youth 11.9
parents 11.7
person 11.3
adorable 11.1
brother 10.8
outdoor 10.7
30s 10.6
married 10.6
loving 10.5
relationship 10.3
clothing 10.1
handsome 9.8
attractive 9.8
old 9.8
affectionate 9.7
black 9.6
bride 9.6
relaxed 9.4
enjoyment 9.4
senior 9.4
leisure 9.1
summer 9
little 8.8
hair 8.7
grass 8.7
toddler 8.6
men 8.6
outside 8.6
marriage 8.6
culture 8.6
pretty 8.4
mature 8.4
fashion 8.3
wedding 8.3
human 8.3
women 7.9
indoors 7.9
grandma 7.9
caring 7.9
sister 7.8
sepia 7.8
play 7.8
affection 7.7
females 7.6
healthy 7.6
garden 7.5
kids 7.5
groom 7.5
teen 7.4
joyful 7.4
20s 7.3
bench 7.1
interior 7.1
look 7
model 7

Google
created on 2021-12-15

Photograph 94.2
Facial expression 93.3
Black 89.8
Human 89.7
Black-and-white 85.9
Mammal 85.7
Happy 85.7
Style 84.1
Toddler 82
Hat 80.7
Child 79.8
Adaptation 79.3
People 77.9
Monochrome 76.7
Monochrome photography 76.4
Vintage clothing 74.1
Sitting 72.7
Sun hat 71.9
Baby 70.4
Sharing 68.6

Microsoft
created on 2021-12-15

person 99.8
text 99
human face 98.5
boy 98.1
clothing 97.5
baby 96.4
toddler 95
child 91.7
smile 91.3
outdoor 88.9
black 75.3
white 62.2
posing 46.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 60.8%
Sad 56.4%
Calm 22.2%
Angry 11%
Confused 3.6%
Surprised 3.6%
Fear 2.3%
Happy 0.7%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Female, 75.6%
Calm 97.4%
Sad 2%
Surprised 0.2%
Angry 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 2-8
Gender Female, 78%
Angry 93.8%
Confused 3.4%
Sad 0.8%
Fear 0.8%
Disgusted 0.5%
Surprised 0.3%
Calm 0.2%
Happy 0.2%

AWS Rekognition

Age 22-34
Gender Female, 68.6%
Calm 91.5%
Sad 7.7%
Happy 0.3%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 94.6%

Captions

Microsoft

a young boy sitting on a bench posing for the camera 71.4%
a young boy sitting on a bench posing for a photo 66.1%
a little boy posing for a photo 66%