Human Generated Data

Title

Breadline

Date

1915

People

Artist: Théophile-Alexandre Steinlen, French 1859 - 1923

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. Cameron Forbes, M12497

Human Generated Data

Title

Breadline

People

Artist: Théophile-Alexandre Steinlen, French 1859 - 1923

Date

1915

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. Cameron Forbes, M12497

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Art 98
Person 92
Human 92
Drawing 87
Painting 82.9
Sketch 65.4
Female 58.6
Girl 58.6

Clarifai
created on 2019-11-06

people 98.7
person 91
portrait 89.3
famous 88.4
woman 87.9
adult 87.7
art 85.9
print 84.3
man 84.2
pop 83.5
event 83.1
entertainment 76.4
beautiful 74.8
illustration 74.4
talent 74.4
two 74.1
lid 74.1
painting 73.5
family 72.3
scarf 71.4

Imagga
created on 2019-11-06

model 37.3
hair 37.3
portrait 36.9
sexy 35.4
attractive 35
pretty 34.3
adult 34.3
fashion 30.9
sensual 29.1
person 29.1
face 28.4
brunette 25.3
people 24.6
skin 24.1
lady 22.7
tattoo 21.1
body 20.8
sensuality 20
posing 19.6
hat 19.5
makeup 19.2
wig 19.1
cute 18.7
studio 17.5
erotic 17.5
gorgeous 17.2
clothing 16.9
make 16.3
happy 16.3
style 15.6
hairpiece 15.3
lovely 15.1
human 15
close 14.8
seductive 14.4
hairstyle 14.3
smile 14.3
one 14.2
eyes 13.8
women 13.4
sketch 13.3
lips 13
youth 12.8
black 12.7
dress 12.7
attire 12.6
hand 12.2
feminine 12.1
long 11.9
elegance 11.8
covering 11.4
book jacket 11
girls 10.9
decoration 10.9
design 10.8
closeup 10.8
look 10.5
elegant 10.3
20s 10.1
head 10.1
sombrero 10
jacket 9.9
drawing 9.6
dark 9.2
blond 9.1
stylish 9
eye 8.9
looking 8.8
lingerie 8.7
lifestyle 8.7
representation 8.6
cosmetic 8.6
relaxation 8.4
healthy 8.2
costume 8.2
pose 8.2
love 7.9
headdress 7.8
standing 7.8
expression 7.7
serious 7.6
females 7.6
top 7.5
care 7.4
man 7.4
cover girl 7.4
nice 7.3
consumer goods 7.2
happiness 7.1

Google
created on 2019-11-06

Drawing 89.5
Sketch 89.1
Hairstyle 84.7
Long hair 78.6
Art 77.7
Illustration 70.1
Painting 66.8
Outerwear 65.8
Portrait 58
Artwork 56.7
Child 52

Microsoft
created on 2019-11-06

sketch 99.8
drawing 99.8
painting 97.7
human face 96.9
child art 96.7
art 95.7
cartoon 90.1
person 85.6
woman 78.9
text 74.3
girl 56.2
portrait 51.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Female, 50.3%
Angry 9.2%
Happy 0.8%
Fear 1.5%
Surprised 7.1%
Confused 5.8%
Disgusted 1%
Calm 66.5%
Sad 8.2%

AWS Rekognition

Age 23-35
Gender Female, 53.5%
Fear 0.2%
Surprised 0.5%
Disgusted 2.6%
Calm 75.6%
Angry 9.2%
Happy 0.3%
Sad 8.4%
Confused 3.2%

AWS Rekognition

Age 13-25
Gender Female, 98.6%
Angry 11.7%
Calm 62.7%
Disgusted 0.5%
Fear 1.4%
Surprised 14.2%
Happy 1%
Sad 2.1%
Confused 6.3%

AWS Rekognition

Age 23-37
Gender Female, 60.7%
Confused 0%
Surprised 0%
Disgusted 0%
Calm 0%
Angry 0%
Fear 87.1%
Sad 12.8%
Happy 0%

AWS Rekognition

Age 18-30
Gender Female, 93.8%
Happy 13.7%
Fear 5.6%
Disgusted 6%
Angry 33.1%
Calm 14.6%
Sad 19.2%
Surprised 5.2%
Confused 2.5%

AWS Rekognition

Age 22-34
Gender Male, 55.1%
Surprised 21.1%
Confused 6.1%
Disgusted 5.2%
Happy 2.9%
Calm 47.7%
Sad 3.5%
Fear 1.3%
Angry 12.2%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92%
Painting 82.9%

Categories

Captions

Microsoft
created on 2019-11-06

a close up of a person 66%
a person taking a selfie 44.9%
a person posing for a picture 44.8%

Text analysis

Amazon

I.LAPINA.IMP.PARIS..
Steimbon
41
Voo

Google

Steinhan 1 1.LAPINA, Imp.PARIS
1
Imp.PARIS
Steinhan
1.LAPINA,