Human Generated Data

Title

Untitled (Japanese Girl)
Date

1867-1877
People

Artist: Felice Beato, British 1832 - 1909

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of John and Ella Rosenfield, P1991.17

Human Generated Data

Title

Untitled (Japanese Girl)

People

Artist: Felice Beato, British 1832 - 1909

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911

Date

1867-1877

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Robe 98.8
Fashion 98.8
Gown 96.1
Kimono 94.8
Person 86.6
Human 86.6

Imagga
created on 2021-12-15

kimono 100
robe 100
garment 100
clothing 84.3
consumer goods 37.5
covering 37.1
fashion 22.6
people 20.1
dress 19.9
culture 19.6
costume 19.1
adult 18.8
person 18.5
portrait 18.1
style 17.8
clothes 17.8
traditional 16.6
religion 16.1
man 16.1
face 15.6
happy 13.2
art 12.4
studio 12.2
male 12.1
pretty 11.9
hair 11.9
model 11.7
gold 11.5
lady 11.4
religious 11.2
attractive 11.2
faith 10.5
smiling 10.1
lifestyle 10.1
smile 10
statue 9.7
prayer 9.7
black 9.6
sculpture 9.6
gift 9.5
holiday 9.3
tradition 9.2
old 9.1
human 9
interior 8.8
saint 8.7
spirituality 8.6
ethnic 8.6
hand 8.4
hat 8.2
celebrate 8.1
sexy 8
posing 8
celebration 8
cute 7.9
happiness 7.8
standing 7.8
color 7.8
men 7.7
expression 7.7
hairstyle 7.6
temple 7.6
child 7.5
holding 7.4
church 7.4
cheerful 7.3
decoration 7.2
body 7.2
women 7.1
vestment 7.1
travel 7
architecture 7

Google
created on 2021-12-15

Sleeve 87.2
Art 84.6
Headgear 82
Collar 81.8
Fashion design 77
Painting 76.3
Vintage clothing 68.9
Drawing 68.5
Fashion illustration 68
Uniform 67.7
Visual arts 66.9
Metal 64.2
Costume design 63.6
Paper 63.6
History 62.3
Illustration 62.1
Antique 61.6
Paper product 61.3
Costume 60.7
Self-portrait 58.6

Microsoft
created on 2021-12-15

wall 99.6
sketch 94.2
painting 92.2
drawing 90.4
clothing 90.1
person 88.2
text 85.2
fashion 73.1
human face 68.1
woman 51.5
costume design 50.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-26
Gender Female, 93.9%
Calm 80.1%
Sad 13.9%
Confused 1.6%
Angry 1.2%
Disgusted 1%
Surprised 0.9%
Fear 0.8%
Happy 0.5%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 86.6%

Captions

Microsoft

a person posing for the camera 90.7%
a person wearing a costume 68.9%
a person wearing a suit and tie 68.8%