Human Generated Data

Title

Dorothea Lange (1895-1965)
Date

June 1964
People

Artist: Sol Libsohn, American 1914 - 2001
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1973.74

Human Generated Data

Title

Dorothea Lange (1895-1965)

People

Artist: Sol Libsohn, American 1914 - 2001

Date

June 1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.1
Human 99.1
Face 90.8
Head 77.1
Clothing 76.2
Apparel 76.2
Finger 66.4
Wristwatch 66.4
Man 60.1

Imagga
created on 2022-01-22

grandma 97.3
senior 46
man 39.7
portrait 37.6
mature 37.2
person 36.9
elderly 31.6
male 31.3
old 30.7
adult 30.4
people 28.5
face 28.4
hair 27
retired 26.2
happy 23.2
looking 22.4
retirement 22.1
smiling 21.7
older 20.4
handsome 19.6
smile 19.3
grandfather 18.9
love 17.4
one 17.2
close 17.1
head 16.8
gray 16.2
age 16.2
pensioner 15.8
aged 15.4
serious 15.3
black 15
human 15
lifestyle 14.5
beard 14.2
couple 13.9
expression 13.7
husband 13.4
lady 13
grandmother 12.7
casual 12.7
pretty 12.6
mother 12.5
wife 12.3
look 12.3
closeup 12.1
eyes 12.1
glasses 12
joy 11.7
aging 11.5
home 11.2
emotion 11.1
happiness 11
alone 11
guy 10.9
tattoo 10.6
blond 10.4
men 10.3
healthy 10.1
hand 9.9
elder 9.9
attractive 9.8
family 9.8
skin 9.7
depression 9.7
affection 9.7
sad 9.7
married 9.6
marriage 9.5
model 9.3
world 9.1
romance 8.9
wrinkled 8.8
together 8.8
boy 8.7
thinking 8.6
health 8.3
friendly 8.2
outdoors 8.2
confident 8.2
cheerful 8.1
eye 8.1
sexy 8
women 7.9
pension 7.9
vertical 7.9
sadness 7.8
masculine 7.8
lonely 7.7
nose 7.6
active 7.3
businessman 7.1
hearing aid 7.1
life 7.1

Google
created on 2022-01-22

Chin 96.6
Sleeve 86.5
Smile 85.3
Black-and-white 83.1
Chest 80.2
Wrinkle 77.1
Eyewear 75.7
Jewellery 74.3
Necklace 72
Facial hair 71.5
Monochrome photography 70.7
Monochrome 70.5
Beard 69.5
Moustache 67.7
Wrist 66.8
Fashion accessory 64.7
Vintage clothing 63.9
Elbow 62.4
Art 61.4
Happy 58.5

Microsoft
created on 2022-01-22

person 99.8
man 93.8
human face 89.6
indoor 86.3
portrait 81.9
face 75.1
fashion accessory 62.8
watch 62.1
staring 15.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 63-73
Gender Female, 95%
Calm 58.8%
Happy 16.1%
Sad 13%
Confused 4.6%
Fear 3.2%
Angry 1.7%
Disgusted 1.5%
Surprised 1.1%

Microsoft Cognitive Services

Age 63
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Wristwatch 66.4%

Captions

Microsoft

Ruth Graham standing in front of a mirror posing for the camera 25.9%
Ruth Graham posing for the camera 25.8%
Ruth Graham looking at the camera 25.7%