Human Generated Data

Title

Mother and children on the road in Tulelake, Siskiyou County, California, September 1939
Date

1939
People

Artist: Dorothea Lange, American 1895 - 1965
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.706

Human Generated Data

Title

Mother and children on the road in Tulelake, Siskiyou County, California, September 1939

People

Artist: Dorothea Lange, American 1895 - 1965

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.9
Human 98.9
Person 97.1
Person 96.2
People 94.3
Face 92.1
Baby 89.7
Newborn 87.4
Family 78
Female 75.9
Clothing 75.1
Apparel 75.1
Portrait 72.2
Photography 72.2
Photo 72.2
Kid 63.6
Child 63.6
Girl 58.9
Woman 58

Imagga
created on 2022-01-22

mother 66.9
child 64.7
parent 60.9
family 54.3
kin 42.5
father 40
love 34.7
baby 34.7
kid 32.8
happy 31.3
daughter 30.3
male 29.8
home 29.5
dad 27.9
happiness 25.9
little 25.6
grandfather 24
children 23.7
cute 23.7
people 22.9
grandma 22.9
boy 22.6
man 22.2
portrait 21.4
smiling 21
childhood 20.6
together 20.2
fun 19.5
joy 19.2
couple 19.2
cheerful 18.7
husband 18.1
lifestyle 18.1
kids 17
smile 16.4
adult 16.2
sibling 16
adorable 15.7
face 15.6
affectionate 14.5
casual 14.4
loving 14.3
life 14.1
playing 13.7
two 13.6
infant 13.5
old 13.2
black 13.2
togetherness 13.2
son 13.1
brother 12.8
newborn 12.6
couch 12.6
care 12.3
wife 12.3
laughing 12.3
senior 12.2
girls 11.9
generations 11.8
one 11.2
blond 11.1
holding 10.7
mom 10.7
affection 10.6
indoors 10.5
human 10.5
sitting 10.3
joyful 10.1
house 10
leisure 10
domestic 10
looking 9.6
living 9.5
men 9.5
indoor 9.1
interior 8.9
embracing 8.8
hug 8.7
women 8.7
four 8.6
play 8.6
toddler 8.6
youth 8.5
enjoyment 8.4
attractive 8.4
mature 8.4
room 8.2
hair 7.9
caring 7.9
grandmother 7.8
parenthood 7.8
sister 7.8
bonding 7.8
innocent 7.8
neonate 7.7
30s 7.7
innocence 7.7
expression 7.7
hand 7.6
enjoying 7.6
head 7.6
person 7.6
offspring 7.5
color 7.2

Google
created on 2022-01-22

Face 98.3
Photograph 94.1
Baby 85.9
Toddler 79.7
Chair 78.1
Art 75
Snapshot 74.3
Vintage clothing 73.8
Classic 73.5
Monochrome photography 70.1
Room 68.7
Monochrome 68.2
Sitting 67.5
Child 65.7
Stock photography 63.4
History 61.7
Visual arts 58.1
Painting 56.2
Retro style 54.5
Portrait 53.7

Microsoft
created on 2022-01-22

person 97.3
human face 97.3
toddler 95.9
clothing 92.9
child 89.6
text 89.3
baby 74.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 100%
Confused 40.4%
Calm 34.5%
Fear 14.9%
Surprised 3.2%
Disgusted 2.6%
Sad 2%
Happy 1.6%
Angry 0.7%

AWS Rekognition

Age 0-4
Gender Female, 50.3%
Confused 70.4%
Calm 8.9%
Happy 8.8%
Fear 3.3%
Sad 2.9%
Surprised 2.8%
Angry 1.6%
Disgusted 1.4%

Microsoft Cognitive Services

Age 54
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a person holding a baby 87.4%
a person holding a baby 79.8%
an old photo of a baby 79.7%

Text analysis

Amazon

SUGAR
Karo
ROSE

Google

aro ROSE SUGAR
aro
ROSE
SUGAR