Human Generated Data

Title

Untitled (Rhoda Hoff de Terra in Tyrolean Costume, Innsbruck, Austria)

Date

1904

People

Artist: Leopold Otto Stieglitz, American 1867 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.189

Human Generated Data

Title

Untitled (Rhoda Hoff de Terra in Tyrolean Costume, Innsbruck, Austria)

People

Artist: Leopold Otto Stieglitz, American 1867 - 1956

Date

1904

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 100
Apparel 100
Bonnet 99.7
Hat 99
Human 91.9
Person 91.9
Sun Hat 85.8

Imagga
created on 2022-01-09

headdress 100
hat 100
cowboy hat 86.9
bonnet 80.9
clothing 72.8
consumer goods 35.4
covering 34.9
portrait 26.5
person 26
child 24.7
cute 23.7
people 22.3
hair 22.2
eyes 20.7
model 20.2
smile 20
face 19.9
pretty 19.6
kid 19.5
happy 18.8
attractive 17.5
sexy 16.1
fashion 15.8
children 14.6
blond 14.5
childhood 14.3
adult 14.2
boy 13.9
lady 13
smiling 12.3
human 12
old 11.8
senior 11.2
one 11.2
girls 10.9
lifestyle 10.8
studio 10.6
outdoors 10.5
expression 10.2
youth 10.2
dress 9.9
fun 9.7
little 9.7
look 9.6
looking 9.6
hairstyle 9.5
women 9.5
happiness 9.4
skin 9.3
sombrero 9.2
long 9.2
book 9.2
love 8.7
gesture 8.6
casual 8.5
care 8.2
teenager 8.2
spa 8.1
man 8.1
interior 8
brunette 7.8
life 7.8
male 7.8
ethnicity 7.7
summer 7.7
facial 7.7
healthy 7.6
head 7.6
horizontal 7.5
relaxation 7.5
adorable 7.4
black 7.2
body 7.2
holiday 7.2
posing 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.7
wall 98.9
indoor 96.7
human face 93.8
text 87.2
drawing 78
clothing 77.1
portrait 69.5
sketch 67.7
woman 66
dress 54.4

Face analysis

Amazon

Google

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Calm 62.5%
Angry 15.6%
Fear 6.3%
Surprised 4.2%
Sad 4%
Disgusted 3.1%
Happy 2.3%
Confused 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99%
Person 91.9%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 81.2%
a person standing in front of a mirror 80.9%
a person in front of a mirror posing for the camera 80.8%