Human Generated Data

Title

The Empress
Date

1872
People

Artist: Kyuichi Uchida, Japanese 1844 - 1875

Artist: Adolfo Farsari, American 1841 - 1898
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.3.3.1

Human Generated Data

Title

The Empress

People

Artist: Kyuichi Uchida, Japanese 1844 - 1875

Artist: Adolfo Farsari, American 1841 - 1898

Date

1872

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Apparel 98.5
Clothing 98.5
Art 91.9
Person 83.9
Human 83.9
Painting 76.7
Fashion 72.8
Cloak 68.2
Photography 60.5
Photo 60.5

Clarifai
created on 2018-03-16

illustration 99.7
art 98.9
people 97.9
veil 97.9
woman 97.4
painting 97.1
man 96.2
portrait 96.1
crown 92.8
adult 92.2
print 92.1
one 92
wear 90.7
picture frame 90.4
royalty 89.3
religion 88.7
vector 88.3
queen 85.3
god 85.1
retro 84.6

Imagga
created on 2018-03-16

prayer rug 100
rug 100
floor cover 87.1
furnishing 86.9
covering 58.4
religion 29.6
architecture 26.5
old 25.8
art 25.4
vintage 24
ancient 22.5
church 20.3
bell 19.4
structure 19
decoration 18.9
antique 18.2
altar 18.2
historic 15.6
retro 15.6
culture 15.4
religious 15
traditional 15
wall 14.5
travel 14.1
symbol 13.5
tourism 13.2
building 12.9
stamp 12.6
door 12.4
gold 12.3
window 12.1
detail 12.1
design 11.2
monument 11.2
ornament 11.2
house 10.9
frame 10.8
postage 10.8
history 10.7
prayer 10.6
palace 10.6
saint 10.6
mail 10.5
post 10.5
letter 10.1
city 10
postmark 9.8
style 9.6
cathedral 9.6
statue 9.5
golden 9.5
museum 9.4
grunge 9.4
texture 9
landmark 9
black 9
home 8.8
icon 8.7
entrance 8.7
holy 8.7
stained 8.6
spirituality 8.6
cross 8.5
brown 8.1
object 8.1
acoustic device 8
interior 8
masterpiece 7.9
shows 7.9
printed 7.9
renaissance 7.9
postal 7.8
painter 7.8
paintings 7.8
mosaic 7.8
envelope 7.8
medieval 7.7
god 7.7
sculpture 7.6
painted 7.6
stone 7.6
pattern 7.5
decorative 7.5
one 7.5
classic 7.4
tower 7.2

Google
created on 2018-03-16

picture frame 78.7
art 63.8
costume design 55.2
painting 52.4

Microsoft
created on 2018-03-16

wall 97.4
room 75.1
gallery 73.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Male, 52.6%
Disgusted 45.1%
Happy 45.1%
Angry 45.8%
Surprised 45.5%
Sad 46.3%
Calm 51.7%
Confused 45.5%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 83.9%
Painting 76.7%

Captions

Microsoft

a room with art on the wall 63.7%
an old photo of a person 44%
a picture of a room 43.9%