Human Generated Data

Title

The Eaters of Sausages and Fat
Date

16th century
People

Artist: Joannes van Doetecum, Netherlandish 1528/32 - 1605

Artist: Lucas van Doetecum, Netherlandish active 1554 - 1579/89

Publisher: Hieronymus Cock, Netherlandish 1510 - 1570

Artist: Hieronymus Bosch, Netherlandish c. 1450 - 1516
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Hope R. Edison '56 in memory of Julian I. Edison '51, MBA '53, 2019.133

Human Generated Data

Title

The Eaters of Sausages and Fat

People

Artist: Joannes van Doetecum, Netherlandish 1528/32 - 1605

Artist: Lucas van Doetecum, Netherlandish active 1554 - 1579/89

Publisher: Hieronymus Cock, Netherlandish 1510 - 1570

Artist: Hieronymus Bosch, Netherlandish c. 1450 - 1516

Date

16th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Hope R. Edison '56 in memory of Julian I. Edison '51, MBA '53, 2019.133

Machine Generated Data

Tags

Amazon
created on 2019-07-28

Human 98.2
Person 98.2
Person 97.2
Art 95.7
Painting 87.5
Person 81.2
Person 77.4
Person 75
Drawing 67.5

Clarifai
created on 2019-07-28

people 100
art 99.9
group 99.8
painting 99.6
man 99.4
adult 99.4
illustration 99.3
print 99.2
engraving 97.5
kneeling 97.5
many 97
furniture 96
facial hair 95.3
leader 94.7
woman 94.4
seat 94.2
position 92.9
son 92.2
pain 91.7
Renaissance 91.6

Imagga
created on 2019-07-28

graffito 38.6
ancient 32.9
old 32.1
decoration 31.1
art 28.6
currency 26.9
money 25.5
paper 25.1
history 25.1
cash 24.7
vintage 23.2
carving 23.2
mosaic 22.8
antique 22.2
finance 22
sculpture 21.4
bank 20.6
tile 18.8
dollar 17.7
retro 17.2
bill 17.1
grunge 17
financial 16.9
religion 16.2
banking 15.6
temple 15.3
note 14.7
wall 14.6
culture 14.5
wealth 14.4
travel 14.1
architecture 14.1
stone 13.9
transducer 13.4
close 13.1
business 12.8
structure 12.5
texture 12.5
exchange 12.4
statue 12.4
stamp 12.2
economy 12.1
historic 11.9
aged 11.8
dollars 11.6
pay 11.5
banknotes 10.8
bills 10.7
banknote 10.7
god 10.5
savings 10.3
representation 10.3
electrical device 10.1
traditional 10
hundred 9.7
spirituality 9.6
memorial 9.6
sketch 9.4
historical 9.4
drawing 9.4
monument 9.4
rich 9.3
brass 9.3
investment 9.2
landmark 9
design 9
one 9
binding 9
pattern 8.9
detail 8.9
carved 8.8
symbol 8.8
heritage 8.7
us 8.7
profit 8.6
famous 8.4
church 8.3
figure 8.2
collection 8.1
value 7.8
payment 7.7
device 7.5
artwork 7.3
painting 7.2

Google
created on 2019-07-28

Art 88.5
Illustration 75.4
Painting 71.4
Visual arts 71.1
Drawing 69.1
Mythology 61.3
Stock photography 59.4
History 57.6
Printmaking 55.4
Artwork 52.3

Microsoft
created on 2019-07-28

drawing 99.1
text 98.3
sketch 98
person 95.6
illustration 89.4
book 83.3
cartoon 78
engraving 77.8
painting 69.2
clothing 68
man 67

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 93.7%
Calm 48.3%
Sad 14.1%
Happy 2.3%
Confused 5.3%
Angry 11.6%
Disgusted 14.4%
Surprised 3.9%

AWS Rekognition

Age 35-53
Gender Male, 97.4%
Disgusted 3.1%
Happy 1.1%
Sad 16.1%
Calm 49.6%
Surprised 6.7%
Angry 7.1%
Confused 16.4%

AWS Rekognition

Age 35-55
Gender Male, 95.2%
Angry 14.2%
Surprised 8.1%
Confused 16%
Sad 15%
Calm 38.7%
Disgusted 3.2%
Happy 4.8%

AWS Rekognition

Age 35-52
Gender Male, 90.2%
Angry 6.9%
Surprised 5.4%
Sad 20.5%
Happy 2.6%
Confused 6.4%
Disgusted 42.8%
Calm 15.4%

AWS Rekognition

Age 26-43
Gender Male, 97.7%
Confused 12.2%
Angry 12.8%
Disgusted 2.8%
Happy 3.6%
Calm 15.7%
Surprised 11.5%
Sad 41.4%

AWS Rekognition

Age 26-43
Gender Male, 96.1%
Calm 75.6%
Disgusted 1%
Surprised 3.3%
Confused 5.9%
Happy 1.3%
Angry 6.7%
Sad 6.3%

AWS Rekognition

Age 35-52
Gender Male, 74.4%
Surprised 1%
Sad 86.2%
Calm 8.5%
Disgusted 0.4%
Confused 1.3%
Happy 0.9%
Angry 1.7%

AWS Rekognition

Age 35-52
Gender Male, 94.1%
Disgusted 1.7%
Surprised 4.3%
Sad 5%
Angry 49.8%
Confused 2.5%
Calm 35%
Happy 1.6%

AWS Rekognition

Age 23-38
Gender Male, 82.7%
Confused 5.3%
Sad 47.1%
Disgusted 1.6%
Calm 33.9%
Happy 2.8%
Surprised 4.2%
Angry 5%

AWS Rekognition

Age 26-43
Gender Male, 66.7%
Calm 27.8%
Angry 33%
Confused 2.4%
Happy 0.8%
Disgusted 0.3%
Surprised 1.8%
Sad 34%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Painting 87.5%

Categories

Imagga

paintings art 74.4%
streetview architecture 12.9%
beaches seaside 12.1%

Captions

Microsoft
created on 2019-07-28

a close up of a book 37.8%
close up of a book 32.4%
a hand holding a book 32.3%

Text analysis

Amazon

Lippm
In
al
mackt
ourr
hrbbirk
brt.
is
am
net
liedrkr te
cuiloen
danfm
daerfr
prl
de
argnmn
bugl
her
lorr,
Seo cbuyfang Buplfayfoo.whle de argnmn plarfen In cuiloen prl Madk bugl mackt brt. Lippm lorr, ba blnfa ourr her am mens danfm oe liedrkr te pupe hrbbirk mir hiry gf daerfr al buylf is nrymant net
ba
Madk
plarfen
EXCNDE
Seo
buylf
hiry
nrymant
mir
mens
COCR EXCNDE
oe
pupe
COCR
gf
Buplfayfoo.whle
en
blnfa
fafe
cbuyfang

Google

SACK EXCNDE Lipm lorr fal va afa danfn, o r liedeki t pypf hebbik mn hier gefet, daerfe al vuylfis nymant ne Sco ouae foo Wil due acyrn els Mackt buyl markt ort planen In oen ber ary 1S ourY Ctns CAVNENRCEO
SACK
EXCNDE
Lipm
lorr
fal
va
afa
danfn,
o
r
liedeki
t
pypf
hebbik
mn
hier
gefet,
daerfe
al
vuylfis
nymant
ne
Sco
ouae
foo
Wil
due
acyrn
els
Mackt
buyl
markt
ort
planen
In
oen
ber
ary
1S
ourY
Ctns
CAVNENRCEO