Human Generated Data

Title

Jewish Grandmother, Ellis Island

Date

1926, printed later?

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosemblum, P1979.71

Human Generated Data

Title

Jewish Grandmother, Ellis Island

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1926, printed later?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Blonde 99.2
Teen 99.2
Kid 99.2
Female 99.2
Woman 99.2
Girl 99.2
Child 99.2
Human 99.2
Face 98.7
Clothing 98.6
Apparel 98.6
Person 92.1
Photo 68.6
Portrait 68.6
Photography 68.6
Man 63
Outdoors 59.6
Lady 58.9
Sleeve 57
Overcoat 56.9
Suit 56.9
Coat 56.9
Scarf 56.4

Imagga
created on 2021-12-14

white 71.7
person 56.1
man 42.4
male 39
portrait 33.7
adult 33.6
handsome 25.9
happy 25.1
people 23.4
businessman 23
face 20.6
black 20.4
business 19.4
senior 17.8
professional 17.7
looking 16
smiling 15.9
executive 15.6
monk 14.6
expression 14.5
confident 13.7
casual 13.6
mature 13
glasses 13
serious 12.4
job 12.4
hand 12.2
clothing 11.6
smile 11.4
one 11.2
old 11.2
occupation 11
work 11
alone 11
lifestyle 10.8
retired 10.7
elderly 10.5
human 10.5
attractive 10.5
standing 10.4
corporate 10.3
manager 10.2
20s 10.1
suit 9.9
formal 9.6
businesspeople 9.5
sitting 9.5
shirt 9.3
studio 9.1
robe 9.1
fashion 9
indoors 8.8
closeup 8.8
hands 8.7
men 8.6
ethnic 8.6
smart 8.5
relaxed 8.5
successful 8.2
life 8.1
office 8
worker 8
close 8
hair 7.9
love 7.9
look 7.9
vertical 7.9
40s 7.8
model 7.8
eyes 7.7
head 7.6
guy 7.5
one person 7.5
outdoors 7.5
grandfather 7.4
camera 7.4
cheerful 7.3
religion 7.2

Google
created on 2021-12-14

Wrap 89.7
Sleeve 87.2
Gesture 85.3
Shawl 77.4
Wrinkle 77.1
Stole 75.3
Beauty 75.2
Turban 75
Street fashion 74.9
Monochrome photography 66.2
Scarf 64.5
Stock photography 64.3
Art 63.1
Rectangle 62.4
Happy 61.7
Peach 60.6
Visual arts 58.9
Sitting 57.5
Portrait photography 57.2
Landscape 55.1

Microsoft
created on 2021-12-14

person 99.8
human face 98.8
man 97.8
text 94.5
clothing 92.7
portrait 90
black and white 56.1
old 45.8
head covering 40.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Female, 98.9%
Calm 34.8%
Confused 33%
Fear 15.2%
Sad 12.4%
Angry 1.5%
Disgusted 1.2%
Surprised 1.1%
Happy 0.9%

Microsoft Cognitive Services

Age 67
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.1%

Captions

Microsoft

a man wearing a hat 82.8%
a man looking at the camera 82.7%
an old photo of a man 82.5%