Human Generated Data

Title

Mother and Child on the Road in Tulelake, Siskiyou County, California, September 1939
Date

1939
People

Artist: Dorothea Lange, American 1895 - 1965
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.720

Human Generated Data

Title

Mother and Child on the Road in Tulelake, Siskiyou County, California, September 1939

People

Artist: Dorothea Lange, American 1895 - 1965

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.720

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Face 98.1
Person 97.9
Baby 95.5
Glasses 95.5
Accessories 95.5
Accessory 95.5
Female 90.9
Teen 84.5
Newborn 82.1
Clothing 81.1
Apparel 81.1
Portrait 77.2
Photography 77.2
Photo 77.2
People 77
Girl 74.8
Woman 74.6
Home Decor 71
Kid 69.8
Child 69.8
Blonde 62.4
Text 58.8
Smile 58.6
Person 49.6

Clarifai
created on 2023-10-26

people 99.9
portrait 99.8
child 99.3
two 99
monochrome 98
son 97
baby 96
offspring 96
family 95.5
facial expression 95.5
adult 95.1
group 93
music 92.5
three 91.5
one 91.3
man 90.2
sibling 89
affection 88.7
wear 87.2
interaction 81.3

Imagga
created on 2022-01-22

child 73.3
mother 70
parent 67.8
family 58.8
daughter 39.6
kid 39
father 37
grandma 35.9
happy 35.8
baby 33.5
love 32.4
little 30.9
sibling 30.6
male 29.3
kin 28.9
happiness 28.2
home 27.1
childhood 26.9
portrait 25.9
cute 25.9
dad 25.7
together 25.4
children 24.6
smile 24.3
people 24
fun 24
senior 20.6
adorable 20.3
smiling 20.3
adult 20.1
boy 20
lifestyle 19.5
man 19.5
girls 18.2
toddler 18.2
husband 18.1
cheerful 17.9
face 17.8
old 16.7
care 16.5
playing 16.4
togetherness 16.1
kids 16
joy 15.9
couple 15.7
loving 15.3
wife 15.2
son 14.6
infant 14.5
casual 14.4
laughing 14.2
holding 14
grandfather 14
mature 14
generations 13.8
grandmother 13.7
blond 13.6
two 13.6
hug 13.6
parenthood 12.7
women 12.7
newborn 12.6
black 12.6
mom 12.6
life 12.5
affectionate 11.6
elderly 11.5
brother 11.3
affection 10.6
indoors 10.6
human 10.5
play 10.3
sitting 10.3
person 10.2
youth 10.2
leisure 10
granddaughter 9.9
grandparent 9.9
embracing 9.8
retired 9.7
house 9.2
park 9.1
grandchild 8.9
healthy 8.8
motherhood 8.8
offspring 8.7
innocence 8.7
eyes 8.6
expression 8.5
enjoying 8.5
relaxed 8.5
hand 8.4
toy 8.3
outdoors 8.2
aged 8.2
hair 7.9
sweet 7.9
cuddling 7.9
hands 7.8
boys 7.8
couch 7.7
generation 7.7
retirement 7.7
living 7.6
enjoyment 7.5
joyful 7.4
indoor 7.3
domestic 7.2
color 7.2
gray 7.2
day 7.1
attractive 7

Google
created on 2022-01-22

Glasses 97.6
Chair 80.2
Toddler 78
Baby 77.8
Vintage clothing 75.4
Monochrome photography 73.8
Monochrome 71.8
Room 70.4
Sitting 68.9
Child 68.7
Classic 68.2
Lap 66.1
Picture frame 65.6
Stock photography 65.2
Event 65.2
Photo caption 64.6
History 58.2
Happy 57
Fun 55.8
Photographic paper 54.7

Microsoft
created on 2022-01-22

baby 99.2
human face 98.6
toddler 98.2
text 98.1
person 96.9
clothing 96.2
smile 88.1
child 86.4
black and white 75.8
boy 71.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Female, 100%
Fear 55%
Calm 20.6%
Confused 9.9%
Surprised 4.7%
Disgusted 2.9%
Happy 2.6%
Sad 2.2%
Angry 2%

AWS Rekognition

Age 0-4
Gender Male, 72%
Sad 87.9%
Angry 4.6%
Calm 4.4%
Confused 1.8%
Fear 0.4%
Disgusted 0.4%
Happy 0.3%
Surprised 0.3%

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Glasses 95.5%

Categories

Imagga

people portraits 89.8%
paintings art 9.3%

Captions

Microsoft
created on 2022-01-22

a person holding a baby 46.9%
a person holding a baby 46.8%
a man and a woman holding a baby 28.1%

Text analysis

Amazon

SE
TO

Google

SE
SE