Human Generated Data

Title

Mother and Child on the Road in Tulelake, Siskiyou County, California, September 1939

Date

1939

People

Artist: Dorothea Lange, American 1895 - 1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.720

Human Generated Data

Title

Mother and Child on the Road in Tulelake, Siskiyou County, California, September 1939

People

Artist: Dorothea Lange, American 1895 - 1965

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Face 98.1
Person 97.9
Baby 95.5
Accessories 95.5
Accessory 95.5
Glasses 95.5
Female 90.9
Teen 84.5
Newborn 82.1
Clothing 81.1
Apparel 81.1
Photo 77.2
Portrait 77.2
Photography 77.2
People 77
Girl 74.8
Woman 74.6
Home Decor 71
Child 69.8
Kid 69.8
Blonde 62.4
Text 58.8
Smile 58.6
Person 49.6

Imagga
created on 2022-01-22

child 73.3
mother 70
parent 67.8
family 58.8
daughter 39.6
kid 39
father 37
grandma 35.9
happy 35.8
baby 33.5
love 32.4
little 30.9
sibling 30.6
male 29.3
kin 28.9
happiness 28.2
home 27.1
childhood 26.9
portrait 25.9
cute 25.9
dad 25.7
together 25.4
children 24.6
smile 24.3
people 24
fun 24
senior 20.6
adorable 20.3
smiling 20.3
adult 20.1
boy 20
lifestyle 19.5
man 19.5
girls 18.2
toddler 18.2
husband 18.1
cheerful 17.9
face 17.8
old 16.7
care 16.5
playing 16.4
togetherness 16.1
kids 16
joy 15.9
couple 15.7
loving 15.3
wife 15.2
son 14.6
infant 14.5
casual 14.4
laughing 14.2
holding 14
grandfather 14
mature 14
generations 13.8
grandmother 13.7
blond 13.6
two 13.6
hug 13.6
parenthood 12.7
women 12.7
newborn 12.6
black 12.6
mom 12.6
life 12.5
affectionate 11.6
elderly 11.5
brother 11.3
affection 10.6
indoors 10.6
human 10.5
play 10.3
sitting 10.3
person 10.2
youth 10.2
leisure 10
granddaughter 9.9
grandparent 9.9
embracing 9.8
retired 9.7
house 9.2
park 9.1
grandchild 8.9
healthy 8.8
motherhood 8.8
offspring 8.7
innocence 8.7
eyes 8.6
expression 8.5
enjoying 8.5
relaxed 8.5
hand 8.4
toy 8.3
outdoors 8.2
aged 8.2
hair 7.9
sweet 7.9
cuddling 7.9
hands 7.8
boys 7.8
couch 7.7
generation 7.7
retirement 7.7
living 7.6
enjoyment 7.5
joyful 7.4
indoor 7.3
domestic 7.2
color 7.2
gray 7.2
day 7.1
attractive 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

baby 99.2
human face 98.6
toddler 98.2
text 98.1
person 96.9
clothing 96.2
smile 88.1
child 86.4
black and white 75.8
boy 71.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Female, 100%
Fear 55%
Calm 20.6%
Confused 9.9%
Surprised 4.7%
Disgusted 2.9%
Happy 2.6%
Sad 2.2%
Angry 2%

AWS Rekognition

Age 0-4
Gender Male, 72%
Sad 87.9%
Angry 4.6%
Calm 4.4%
Confused 1.8%
Fear 0.4%
Disgusted 0.4%
Happy 0.3%
Surprised 0.3%

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Glasses 95.5%

Captions

Microsoft

a person holding a baby 46.9%
a person holding a baby 46.8%
a man and a woman holding a baby 28.1%

Text analysis

Amazon

SE
TO

Google

SE
SE