Human Generated Data

Title

Brown and Gold: Lillie "In our Alley!"

Date

c. 1896

People

Artist: James Abbott McNeill Whistler, American 1834 - 1903

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.177

Human Generated Data

Title

Brown and Gold: Lillie "In our Alley!"

People

Artist: James Abbott McNeill Whistler, American 1834 - 1903

Date

c. 1896

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 97.3
Human 89.1
Person 89.1
Painting 87

Clarifai
created on 2020-04-24

painting 99.7
people 99.6
portrait 99.5
one 99.2
art 99.1
adult 97.5
man 93.9
woman 92.7
religion 88.9
wear 87.4
costume 86.8
lid 84.9
Renaissance 84.5
saint 80.5
veil 79.8
face 76.8
facial hair 74.5
no person 71.5
god 71.4
cross 68.2

Imagga
created on 2020-04-24

portrait 40.8
black 40.1
attractive 39.9
adult 36.2
person 35.6
sexy 33
face 32
fashion 30.2
model 29.6
hair 29.3
pretty 28.7
people 26.2
lady 22.7
smile 22.1
brunette 21.8
expression 21.3
cute 19.4
eyes 19
happy 18.8
look 18.4
dark 18.4
male 17.8
man 17.5
sensual 17.3
youth 17
casual 15.3
posing 15.1
smiling 14.5
lifestyle 14.5
looking 14.4
one 13.4
studio 12.9
body 12.8
alone 12.8
human 12.8
covering 12.7
world 12.7
style 12.6
head 11.8
guy 11.6
serious 11.5
cloak 11.3
women 11.1
make 10.9
eye 10.7
natural 10.7
handsome 10.7
love 10.3
lips 10.2
makeup 10.1
joy 10
pose 10
cool 9.8
cheerful 9.8
seductive 9.6
elegant 9.4
wall 9.4
elegance 9.2
gorgeous 9.1
costume 9
cipher 8.9
lovely 8.9
brown 8.8
sad 8.7
ethnic 8.6
hot 8.4
fun 8.2
outdoors 8.2
sensuality 8.2
dress 8.1
beard 8
clothing 8
couple 7.8
disk jockey 7.8
modern 7.7
skin 7.6
suit 7.6
hand 7.6
mouth 7.5
close 7.4
emotion 7.4
20s 7.3
friendly 7.3
happiness 7.1

Google
created on 2020-04-24

Portrait 96.7
Painting 96.4
Self-portrait 85.4
Art 81.6
Visual arts 72.2

Microsoft
created on 2020-04-24

painting 99.9
drawing 99.9
sketch 99.7
child art 96.3
human face 96.3
text 94.7
portrait 93.4
art 92.7
person 84.5
woman 81.5
self-portrait 54.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-21
Gender Female, 92%
Disgusted 0.1%
Fear 0.1%
Surprised 0.7%
Angry 0.4%
Happy 0.1%
Calm 97.3%
Confused 0.3%
Sad 1%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 89.1%
Painting 87%

Captions

Microsoft

a person looking at the camera 34.7%