Human Generated Data

Title

The Hangover (Suzanne Valadon)

Date

1887-1889

People

Artist: Henri de Toulouse-Lautrec, French 1864 - 1901

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest from the Collection of Maurice Wertheim, Class of 1906, 1951.63

Human Generated Data

Title

The Hangover (Suzanne Valadon)

People

Artist: Henri de Toulouse-Lautrec, French 1864 - 1901

Date

1887-1889

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 99.6
Painting 99.6
Tile 75.2
Mosaic 75.2
Beverage 74.7
Drink 74.7
Human 68.2
Person 68.2
Bottle 67.5
Alcohol 63

Clarifai
created on 2018-03-16

painting 100
art 99.8
people 99.5
illustration 99.5
adult 99.1
print 99.1
one 98
religion 97.9
aura 96
woman 96
Renaissance 95.5
reclining 94.9
saint 93.9
man 93.4
veil 93.1
god 90.6
allegory 87.8
lithograph 87.2
kneeling 86.8
Mary 86.5

Imagga
created on 2018-03-16

mosaic 48
jigsaw puzzle 33.1
transducer 30.5
puzzle 27.1
art 24.7
old 23
electrical device 22.9
grunge 19.6
texture 19.4
ancient 19
antique 18.3
game 17.9
retro 17.2
vintage 16.5
brown 15.4
device 15.2
pattern 15
design 14.1
aged 13.6
dirty 12.6
damaged 12.4
rough 11.8
paper 11.8
surface 11.5
worn 11.4
textured 11.4
water 11.3
yellow 11.3
wall 11.2
color 11.1
space 10.9
sand 10.8
stained 10.6
travel 10.6
rock 10.4
stone 10.4
paint 10
wallpaper 10
sea 9.5
tree 9.3
outdoor 9.2
frame 9.2
ocean 9.1
graphic 8.8
light 8.7
weathered 8.5
grungy 8.5
male 8.5
park 8.2
backgrounds 8.1
history 8
detail 8
natural 8
aging 7.7
instrumentality 7.6
canvas 7.6
fun 7.5
outdoors 7.5
backdrop 7.4
style 7.4
earth 7.3
painting 7.2
wet 7.1
material 7.1

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

text 98

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 98.1%
Surprised 5.4%
Angry 5.9%
Sad 55.1%
Calm 21%
Disgusted 3%
Confused 5%
Happy 4.6%

Microsoft Cognitive Services

Age 76
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.6%
Person 68.2%

Captions

Microsoft

a close up of text on a white surface 26.8%
a close up of text on a black surface 26.7%
a close up of a bear 10%