Human Generated Data

Title

Melancholy
Date

16th-17th century
People

Artist: Pieter de Jode, the Elder, Flemish 1570 - 1634

Artist after: Maerten de Vos, Netherlandish 1532 - 1603
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1149NA

Human Generated Data

Title

Melancholy

People

Artist: Pieter de Jode, the Elder, Flemish 1570 - 1634

Artist after: Maerten de Vos, Netherlandish 1532 - 1603

Date

16th-17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1149NA

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Human 98.7
Person 98.7
Person 98.2
Art 94.6
Text 80.9
Painting 73.7
Archaeology 63.7
Newspaper 58.6

Clarifai
created on 2019-08-10

people 100
illustration 99.6
group 99.4
print 99
art 98.6
adult 98.2
man 97.4
child 96.5
engraving 96.1
two 94.5
son 94.2
woman 94.1
administration 93.9
baby 93.5
leader 91.6
lithograph 91
several 90.8
one 89.4
veil 88.9
portrait 88.2

Imagga
created on 2019-08-10

sketch 77.8
drawing 60.8
representation 49.2
currency 36.8
money 34.9
paper 32.9
dollar 30.6
cash 30.2
finance 27
book jacket 25
wealth 24.3
bank 24.2
vintage 24
comic book 24
dollars 23.2
business 23.1
art 22.4
banking 22.1
bill 20
ancient 19.9
retro 19.7
jacket 19.4
financial 18.7
savings 18.7
hundred 18.4
old 18.1
rich 17.7
us 17.4
loan 17.3
stamp 16.5
mail 15.3
one 14.9
postmark 14.8
wrapping 14.8
bills 14.6
antique 14.5
exchange 14.3
history 14.3
franklin 13.8
letter 13.8
investment 13.8
close 13.7
pay 13.4
economy 13
symbol 12.8
sign 12.8
postage 12.8
postal 12.8
banknotes 12.7
post 12.4
global 11.9
finances 11.6
capital 11.4
envelope 11.1
grunge 11.1
newspaper 10.9
printed 10.8
states 10.6
success 10.5
culture 10.3
closeup 10.1
note 10.1
covering 10.1
shows 9.9
design 9.6
print media 9.6
product 9.4
sculpture 9.3
religion 9
pattern 8.9
funds 8.8
daily 8.8
banknote 8.7
economic 8.7
profit 8.6
united 8.6
texture 8.3
church 8.3
creation 8.3
treasury 8.2
aged 8.1
museum 8
stamps 7.9
frame 7.9
wages 7.8
black 7.8
debt 7.7
commerce 7.5
gold 7.4
man 7.4
market 7.1

Google
created on 2019-08-10

Painting 87.2
Art 81.6
Illustration 76.8
Stock photography 66.6
Drawing 63.2
Visual arts 55
Artwork 52.3

Microsoft
created on 2019-08-10

text 100
book 99.9
clothing 97.4
person 97.2
drawing 82.8
sketch 74.4
cartoon 70.4
man 67.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 6-16
Gender Female, 57.2%
Happy 1.1%
Angry 0.3%
Confused 0.2%
Disgusted 0.3%
Sad 2.7%
Fear 0.4%
Calm 94.2%
Surprised 0.8%

AWS Rekognition

Age 51-69
Gender Male, 59.6%
Angry 1.6%
Disgusted 0.3%
Sad 1.2%
Fear 0.4%
Surprised 1.3%
Happy 0.8%
Calm 94.3%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 73.7%

Categories

Imagga

paintings art 97.9%

Captions

Microsoft
created on 2019-08-10

a close up of a book 56.2%
close up of a book 51%
a hand holding a book 50.9%

Text analysis

Amazon

MELANCHOLICVS
bilis
violento
agitant
torpent
metu,
nimis
atra
curas
atro
anxietate,
calatore
examine
ore
ab
fua
premit
quos
Jeuerus
et
Mole
ngredine
Atgue Jeuerus atro metu, manat ab ore torpent Furors: Mole fua bilis nimis atra premit
Sris Fristicia, anxietate, et ngredine Jjfoinnesgue agitant violento examine curas
manat
Martine
Jjfoinnesgue
Fristicia,
Atgue
Criffianns
Martine velie imuentore Petro Jedao calatore quos Criffianns alig imprimit.
Petro
alig
Jedao
imuentore
imprimit.
Sris
Furors:
velie

Google

MELANCHOLICVS
Iuomnesque
agitant
violento
examine
curas,
Mole
fua
jmuentore
Jedeo
MELANCHOLICVS Iuomnesque agitant violento examine curas, Mole fua bilis quos nimis atra premit. Jris ticia, ansietate, metu, et migredine torpent, Atque Jeuerus atro manat ab ore furor: Martino Veffie jmuentore Crifianus 2aflia, imprimi . Petro Jedeo calatere
bilis
quos
nimis
atra
premit.
Jris
ticia,
ansietate,
metu,
et
migredine
torpent,
Atque
Jeuerus
atro
manat
ab
ore
furor:
Martino
Veffie
Crifianus
2aflia,
imprimi
.
Petro
calatere