Human Generated Data

Title

Skating

Date

1877

People

Artist: Edouard Manet, French 1832 - 1883

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest from the Collection of Maurice Wertheim, Class of 1906, 1951.50

Human Generated Data

Title

Skating

People

Artist: Edouard Manet, French 1832 - 1883

Date

1877

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 99.4
Painting 99.4
Person 98.9
Human 98.9
Person 77

Clarifai
created on 2018-03-16

people 99.9
painting 99.7
adult 98.9
woman 98.9
group 98.8
wear 98.7
art 98.5
lid 97.4
man 94.8
illustration 93.5
veil 93
bonnet 91.8
religion 91.5
royalty 91.3
one 87.7
coat 87.4
costume 87.3
dress 85.8
child 85.5
print 85.3

Imagga
created on 2018-03-16

costume 35.9
person 34.8
fashion 34.7
dress 34.3
people 33.5
face 33.4
portrait 28.5
sexy 26.5
adult 26
attractive 23.8
model 23.3
pretty 21
hair 19.8
human 19.5
lady 18.7
black 18.6
brunette 18.3
clothing 17.8
makeup 17.4
posing 16.9
dark 16.7
armor 16.6
traditional 15.8
art 15.3
religion 15.2
women 15
clothes 15
eyes 14.6
elegant 14.6
sensual 14.5
make 14.5
cute 13.6
hairstyle 13.3
happy 13.2
expression 12.8
body 12.8
style 12.6
mask 12.4
culture 12
covering 11.7
interior 11.5
male 11.4
old 11.1
sensuality 10.9
chain mail 10.8
warrior 10.7
smile 10.7
vogue 10.6
hat 10.5
party 10.3
body armor 10.3
wall 10.3
decoration 10.2
smiling 10.1
lifestyle 10.1
man 10.1
head 10.1
fantasy 9.9
gold 9.9
witch 9.8
lovely 9.8
weapon 9.7
prayer 9.7
look 9.6
mystery 9.6
men 9.4
religious 9.4
lips 9.3
tradition 9.2
elegance 9.2
outfit 9.2
one 9
darkness 8.8
soldier 8.8
looking 8.8
evil 8.8
antique 8.8
military 8.7
war 8.7
golden 8.6
ethnic 8.6
casual 8.5
hand 8.4
protective covering 8.3
emotion 8.3
nice 8.2
girls 8.2
gorgeous 8.2
indoors 7.9
demon 7.9
devil 7.9
couple 7.8
shield 7.8
carnival 7.8
horror 7.8
fear 7.7
luxury 7.7
two 7.6
vintage 7.6
20s 7.3
protection 7.3

Google
created on 2018-03-16

painting 95.4
lady 85.6
art 82.2
impressionist 70.3
portrait 67.6
artwork 59.8
girl 59.5
modern art 59.2

Microsoft
created on 2018-03-16

person 94

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Female, 84.9%
Angry 2.9%
Sad 1.6%
Calm 29.8%
Disgusted 2.6%
Happy 43.3%
Surprised 8.4%
Confused 11.3%

AWS Rekognition

Age 27-44
Gender Female, 73.6%
Calm 92.4%
Angry 0.4%
Disgusted 0.3%
Happy 0.6%
Confused 1.1%
Surprised 1.2%
Sad 3.9%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Sad 46.3%
Confused 45.3%
Happy 45.5%
Disgusted 45.1%
Angry 45.4%
Surprised 45.7%
Calm 51.7%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.4%
Person 98.9%

Captions

Microsoft

a person wearing a costume 84.7%
a person wearing a costume 76.1%
a person standing next to a stuffed animal 46.3%