Human Generated Data

Title

Jan Cornelis Sylvius
Date

1633
People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arnold Knapp, M12905

Human Generated Data

Title

Jan Cornelis Sylvius

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

1633

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arnold Knapp, M12905

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Art 98.9
Human 92.6
Person 92.6
Painting 89.8
Drawing 74.4
Sketch 56

Clarifai
created on 2019-08-06

people 100
portrait 99.9
engraving 99.9
print 99.9
art 99.7
old 99.2
one 99.1
leader 98.8
antique 98.7
illustration 98.4
adult 98.3
man 98.2
facial hair 97.8
scientist 97.8
mustache 97.3
poet 96.2
vintage 95.2
writer 94.8
etching 93
painting 92.3

Imagga
created on 2019-08-06

money 41.7
currency 38.6
cash 38.4
dollar 38.1
banking 31.3
finance 27.9
bank 27.8
financial 26.7
bill 25.7
wealth 23.3
book jacket 23.1
paper 23
close 22.8
business 22.5
face 21.3
dollars 21.3
one 20.9
banknote 20.4
us 20.2
art 19
savings 18.6
closeup 18.2
jacket 18
pay 17.3
statue 16.9
portrait 16.8
president 15.7
note 14.7
culture 14.5
hundred 14.5
payment 14.4
franklin 13.8
wrapping 13.6
religion 13.4
loan 13.4
rich 13
covering 12.8
banknotes 12.7
exchange 12.4
religious 12.2
commerce 12.1
economy 12.1
temple 12
bills 11.7
finances 11.6
god 11.5
symbol 11.4
famous 11.2
stone 11.2
funds 10.8
man 10.8
concepts 10.7
economic 10.7
capital 10.6
ancient 10.4
investment 10.1
sculpture 10.1
success 9.7
holy 9.6
ruler 9.3
church 9.2
head 9.2
old 9.1
masterpiece 8.9
market 8.9
detail 8.9
museum 8.7
states 8.7
architecture 8.7
vintage 8.3
history 8.1
black 7.9
twenty 7.9
printed 7.9
debt 7.7
sales 7.7
price 7.7
notes 7.7
fine 7.6
united 7.6
save 7.6
monument 7.5
historic 7.3
people 7.3
male 7.2

Google
created on 2019-08-06

Painting 87.5
Self-portrait 85.7
Portrait 85.2
Facial hair 84.9
Art 82.2
Picture frame 80.8
Beard 69.2
Stock photography 65.4
Illustration 60.2
Visual arts 59.3
History 54.1
Gentleman 51.3
Historian 50.7
Physicist 50.6

Microsoft
created on 2019-08-06

text 100
book 98.7
drawing 97
sketch 96.1
human face 94.9
person 94.8
man 89.4
painting 76.1
clothing 73.1
portrait 52.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 66.8%
Disgusted 0.4%
Sad 90.3%
Surprised 0.5%
Angry 1.3%
Calm 4%
Confused 2.4%
Happy 1%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.6%
Painting 89.8%

Categories

Imagga

pets animals 77.4%
paintings art 12.5%
streetview architecture 9.2%

Captions

Microsoft
created on 2019-08-06

a close up of a book 64.3%
close up of a book 59.1%
a person sitting on a book 40.6%