Human Generated Data

Title

Self-Portrait in a Velvet Cap with Plume
Date

1638
People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gray Collection of Engravings Fund, G4910

Human Generated Data

Title

Self-Portrait in a Velvet Cap with Plume

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

1638

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Art 97.3
Drawing 94.9
Human 94.9
Person 94.1
Sketch 80.4
Hat 69.1
Apparel 69.1
Clothing 69.1
Painting 62.4

Clarifai
created on 2019-08-06

engraving 99.8
print 99.8
people 99.7
art 99.7
portrait 99.7
antique 99.4
old 99.3
mustache 99.1
illustration 98.9
vintage 98.6
facial hair 98.5
lid 98.2
one 97.6
man 96.8
painting 96.2
beard 96.1
adult 95.6
historic 94.5
ancient 93.6
leader 93.6

Imagga
created on 2019-08-06

sketch 37.3
book jacket 36.5
jacket 28.4
representation 27.9
drawing 27.1
portrait 24.6
art 23.7
wrapping 21.6
face 19.2
money 18.7
vintage 17.4
person 17.1
model 17.1
currency 17.1
fashion 16.6
close 16.6
cash 16.5
covering 16.4
black 15.7
people 15.1
hair 15.1
sculpture 14.9
sensual 14.6
sexy 14.5
bill 14.3
one 14.2
culture 13.7
dollar 13
banking 12.9
decoration 12.9
man 12.8
museum 12.5
adult 12.3
body 12
makeup 11.9
icon 11.9
old 11.8
bank 11.7
masterpiece 10.9
religion 10.8
artist 10.6
antique 10.6
figure 10.5
style 10.4
golden 10.3
economy 10.2
church 10.2
finance 10.1
closeup 10.1
bust 10
mosaic 10
retro 9.8
financial 9.8
pretty 9.8
attractive 9.8
human 9.8
lady 9.7
banknote 9.7
brunette 9.6
paper 9.5
ancient 9.5
symbol 9.4
skin 9.3
painter 9.3
head 9.2
make 9.1
posing 8.9
postmark 8.9
mug shot 8.7
stamp 8.7
mail 8.6
god 8.6
cute 8.6
fine 8.6
luxury 8.6
design 8.6
male 8.5
erotic 8.5
letter 8.3
dress 8.1
wealth 8.1
envelope 8
business 7.9
love 7.9
printed 7.9
postage 7.9
renaissance 7.9
postal 7.9
creation 7.7
dollars 7.7
holy 7.7
painted 7.6
post 7.6
hairstyle 7.6
studio 7.6
savings 7.5
mask 7.5
crown 7.4
statue 7.2
romantic 7.1
architecture 7

Google
created on 2019-08-06

Self-portrait 83.3
Art 82.6
Portrait 79.5
Drawing 74.6
Painting 72.4
Facial hair 68.1
Illustration 68.1
Printmaking 57.9
Artwork 56.7
Visual arts 55
Sketch 54.4
Beard 52.9

Microsoft
created on 2019-08-06

drawing 99.7
sketch 99.6
text 98.9
human face 93.7
book 91.4
art 89.8
person 78.4
clothing 72.9
hat 63.8
painting 59.8
man 54.7
portrait 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 82.1%
Disgusted 1.4%
Sad 3.7%
Surprised 3.1%
Angry 10.4%
Calm 74.2%
Confused 3.4%
Happy 3.8%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.1%
Hat 69.1%
Painting 62.4%

Captions

Microsoft

a close up of a book 34%
close up of a book 28.5%
a hand holding a book 28.4%

Text analysis

Amazon

rnoraper
G

Google

25
25