Human Generated Data

Title

Portrait of Elizabeth Arnold

Date

1837

People

Artist: Narcisse Othon, French active 1839–1847

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Misses Aimée and Rosamond Lamb, 1965.536

Human Generated Data

Title

Portrait of Elizabeth Arnold

People

Artist: Narcisse Othon, French active 1839–1847

Date

1837

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.4
Art 98.2
Drawing 98.2
Sketch 95
Person 87.5
Painting 85.2
Face 65.6
Photo 62.8
Portrait 62.8
Photography 62.8

Clarifai
created on 2018-02-10

people 99.8
portrait 99.6
one 99.4
adult 99.3
woman 97.5
wear 96.2
art 95.6
print 89.1
retro 88.7
engraving 88.5
vintage 85.6
hair 85.1
pensive 84
dress 83.8
sit 83.1
facial expression 79.3
model 77.8
girl 77.6
actress 74
administration 72.6

Imagga
created on 2018-02-10

pretty 46.2
attractive 45.5
portrait 40.8
lady 40.6
person 39.7
model 35.8
adult 35
hair 34.9
fashion 33.2
sexy 32.1
face 29.8
clothing 28.7
people 27.9
happy 26.9
garment 25.5
cute 23
makeup 22.9
smile 22.8
scarf 22.2
sensual 21.8
lovely 21.3
posing 20.4
skin 20.4
brunette 20
expression 19.6
poncho 18.4
stole 18.3
hairstyle 18.1
smiling 18.1
human 18
cloak 17.2
look 16.6
pose 16.3
dress 16.3
clothes 15.9
lips 15.7
black 15.5
make 15.4
wig 15.1
gorgeous 14.5
looking 14.4
body 14.4
elegance 14.3
one 14.2
healthy 13.9
lace 13.8
eyes 13.8
sensuality 13.6
style 13.4
elegant 12.8
nice 12.8
wearing 12.4
covering 12.2
cardigan 12
youth 11.9
casual 11.9
happiness 11.8
lifestyle 11.6
joy 10.9
stylish 10.9
studio 10.6
hairpiece 10.6
modern 10.5
women 10.3
blond 10.3
closeup 10.1
cheerful 9.8
cosmetic 9.6
sweater 9.5
relaxed 9.4
head 9.2
pink 9.2
confident 9.1
eye 8.9
close 8.6
costume 8.5
feminine 8.4
hot 8.4
health 8.3
friendly 8.2
care 8.2
attire 7.9
sketch 7.7
sitting 7.7
jacket 7.7
seductive 7.6
hand 7.6
openwork 7.6
fun 7.5
20s 7.3
wellness 7.3

Google
created on 2018-02-10

portrait 92
drawing 78.6
sketch 70.1
artwork 69.8
girl 69.7
art 64.8
self portrait 64.4
figure drawing 62
visual arts 61.2
long hair 59.4
neck 55.8
painting 53.4
watercolor paint 51.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 87.4%
Surprised 7.1%
Happy 1%
Disgusted 5.7%
Confused 12.2%
Calm 63.5%
Angry 5.5%
Sad 5%

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 87.5%
Painting 85.2%

Captions

Microsoft

a person taking a selfie 66%
a close up of a person 65.9%
close up of a person 65.8%

Text analysis

Amazon

phon
phon ZR37,
ZR37,