Human Generated Data

Title

Untitled (Rhoda Hoff de Terra in Tyrolean Costume, Innsbruck, Austria)
Date

1904
People

Artist: Leopold Otto Stieglitz, American 1867 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.189

Human Generated Data

Title

Untitled (Rhoda Hoff de Terra in Tyrolean Costume, Innsbruck, Austria)

People

Artist: Leopold Otto Stieglitz, American 1867 - 1956

Date

1904

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 100
Apparel 100
Bonnet 99.7
Hat 99
Person 91.9
Human 91.9
Sun Hat 85.8

Imagga
created on 2022-01-09

hat 100
headdress 100
cowboy hat 86.9
bonnet 80.9
clothing 72.8
consumer goods 35.4
covering 34.9
portrait 26.5
person 26
child 24.7
cute 23.7
people 22.3
hair 22.2
eyes 20.7
model 20.2
smile 20
face 19.9
pretty 19.6
kid 19.5
happy 18.8
attractive 17.5
sexy 16.1
fashion 15.8
children 14.6
blond 14.5
childhood 14.3
adult 14.2
boy 13.9
lady 13
smiling 12.3
human 12
old 11.8
senior 11.2
one 11.2
girls 10.9
lifestyle 10.8
studio 10.6
outdoors 10.5
expression 10.2
youth 10.2
dress 9.9
fun 9.7
little 9.7
look 9.6
looking 9.6
hairstyle 9.5
women 9.5
happiness 9.4
skin 9.3
sombrero 9.2
long 9.2
book 9.2
love 8.7
gesture 8.6
casual 8.5
care 8.2
teenager 8.2
spa 8.1
man 8.1
interior 8
brunette 7.8
life 7.8
male 7.8
ethnicity 7.7
summer 7.7
facial 7.7
healthy 7.6
head 7.6
horizontal 7.5
relaxation 7.5
adorable 7.4
black 7.2
body 7.2
holiday 7.2
posing 7.1

Google
created on 2022-01-09

Sleeve 87.2
Art 83.3
Headgear 81
Hat 78.7
Vintage clothing 74.8
Victorian fashion 72.8
Headpiece 71.9
Costume hat 69.4
Visual arts 67.1
Stock photography 66.9
Illustration 66.4
Fashion accessory 65.1
Pattern 60.7
Sun hat 60.5
Fashion design 60.2
Necklace 58.3
Day dress 57.1
Retro style 55
Portrait 54.7
Rectangle 54.3

Microsoft
created on 2022-01-09

person 99.7
wall 98.9
indoor 96.7
human face 93.8
text 87.2
drawing 78
clothing 77.1
portrait 69.5
sketch 67.7
woman 66
dress 54.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Calm 62.5%
Angry 15.6%
Fear 6.3%
Surprised 4.2%
Sad 4%
Disgusted 3.1%
Happy 2.3%
Confused 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99%
Person 91.9%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 81.2%
a person standing in front of a mirror 80.9%
a person in front of a mirror posing for the camera 80.8%