Human Generated Data

Title

Self-Portrait with Saskia
Date

1636
People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3221

Human Generated Data

Title

Self-Portrait with Saskia

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

1636

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3221

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Clothing 98
Hat 98
Apparel 98
Human 95.2
Drawing 95.2
Art 95.2
Person 90.8
Sketch 87.8
Person 79.4
Painting 68.2

Clarifai
created on 2019-08-06

people 99.8
art 99.7
print 99.6
illustration 99.5
portrait 99.5
vintage 98.8
man 98.7
painting 98.6
adult 98.4
old 98
antique 97.8
engraving 97.6
retro 97.1
one 95.8
two 95.1
ancient 93.2
leader 92.9
visuals 92.2
paper 92.2
wear 87.7

Imagga
created on 2019-08-06

book jacket 66
jacket 51.4
wrapping 39
money 38.4
currency 36.9
cash 35.8
sketch 31.2
paper 30.6
dollar 28.8
covering 28
stamp 27.5
vintage 27.3
finance 27.1
banking 26.7
bank 26
bill 25.7
drawing 25.3
mail 24.9
wealth 24.3
close 23.4
financial 23.2
postmark 22.7
savings 22.4
ancient 20.8
old 20.2
business 20.1
representation 19.9
postage 19.7
envelope 19.7
dollars 19.4
letter 19.3
retro 18.9
one 18.7
postal 18.7
exchange 18.2
art 18.1
us 17.4
rich 16.8
banknote 16.5
economy 15.8
banknotes 15.7
culture 15.4
pay 15.4
bills 14.6
philately 13.8
circa 13.8
printed 13.8
investment 13.8
hundred 13.6
finances 13.5
closeup 13.5
loan 13.4
post 13.4
note 12
shows 11.8
history 11.6
market 11.6
payment 11.6
notes 11.5
symbol 11.5
aged 10.9
stamps 10.9
card 10.8
binding 10.8
mosaic 10.4
portrait 10.4
message 10.1
creation 9.9
franklin 9.9
twenty 9.9
funds 9.8
profit 9.6
face 9.3
book 9.2
global 9.1
religion 9
masterpiece 8.9
antique 8.8
economic 8.7
statue 8.7
debt 8.7
great 8.6
united 8.6
capital 8.6
commerce 8.4
museum 8.3
product 8.2
sculpture 8.2
man 8.1
success 8.1
address 7.9
value 7.8
states 7.7
pound 7.7
grunge 7.7
texture 7.7
painted 7.6
fine 7.6
england 7.6
painter 7.3
icon 7.1
concepts 7.1
architecture 7

Google
created on 2019-08-06

Head 87.6
Art 83.1
Drawing 82.8
Painting 77.8
Illustration 73.2
Facial hair 73.1
Self-portrait 70
Portrait 65.1
Artwork 63.5
Printmaking 63.2
Sketch 61.4
Paper 51
Beard 50.4

Microsoft
created on 2019-08-06

text 99.9
sketch 99.5
drawing 99.5
book 99.3
human face 91.3
person 74.7
painting 73.9
illustration 70.9
child art 68.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 53.8%
Angry 5.2%
Happy 2.3%
Sad 70.1%
Calm 18.2%
Disgusted 0.8%
Confused 1.6%
Surprised 1.8%

AWS Rekognition

Age 26-43
Gender Male, 85.5%
Sad 28%
Angry 4%
Confused 3.2%
Disgusted 1.3%
Surprised 1.7%
Calm 60.1%
Happy 1.7%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 98%
Person 90.8%

Categories

Imagga

paintings art 99.8%

Text analysis

Amazon

6
/636
/636 G 6
Renbroondt f
G

Google

A
A