Human Generated Data

Title

The Jewel Box Hoax
Date

19th century
People

Artist: Honoré-Victorin Daumier, French 1808-1879
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Acquisition Fund for Prints, 2019.209

Human Generated Data

Title

The Jewel Box Hoax

People

Artist: Honoré-Victorin Daumier, French 1808-1879

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Acquisition Fund for Prints, 2019.209

Machine Generated Data

Tags

Amazon
created on 2020-01-25

Person 99.6
Human 99.6
Art 95.5
Text 94.8
Drawing 91.1
Painting 75.7
Sketch 71.9
Page 59.1

Clarifai
created on 2020-01-25

people 99.9
print 99.6
engraving 98.8
art 98.7
adult 98.7
one 96.8
illustration 96.2
portrait 96.2
woman 94.7
vintage 94.5
man 90.3
book bindings 89.6
old 88.7
group 87.9
retro 87.5
writer 87.5
wear 86.8
leader 86.1
painting 86
antique 85.9

Imagga
created on 2020-01-25

newspaper 60
product 56.3
creation 44.6
sketch 27.7
money 25.5
book jacket 24.3
paper 23.6
dollar 23.2
drawing 22.9
cash 22.9
currency 21.5
bank 20.6
business 20
jacket 19.8
daily 19.2
bill 19
banking 18.4
representation 16.8
dollars 16.4
exchange 16.2
wealth 16.2
finance 16.1
financial 16
us 15.4
old 15.3
vintage 14.9
wrapping 14.3
closeup 14.1
savings 14
man 12.8
one 12.7
close 12.6
pay 12.5
book 12.4
franklin 11.8
hundred 11.6
states 11.6
loan 11.5
rich 11.2
art 10.8
bills 10.7
market 10.7
capital 10.4
covering 10.1
retro 9.8
legal 9.8
finances 9.6
united 9.5
people 9.5
symbol 9.4
history 8.9
success 8.9
antique 8.8
male 8.5
black 8.5
funds 7.8
banknotes 7.8
ancient 7.8
stamp 7.7
person 7.7
grunge 7.7
mail 7.7
design 7.5
commerce 7.5
economy 7.4
letter 7.3
investment 7.3
portrait 7.1
adult 7.1
sculpture 7
treasury 7

Google
created on 2020-01-25

Photograph 95.7
Snapshot 82.5
Vintage clothing 68.3
Illustration 66.9
Stock photography 62.1
Picture frame 59.9
Art 58.1
Drawing 53.7

Microsoft
created on 2020-01-25

text 99.8
drawing 98.9
sketch 97.6
book 96.2
person 93.3
clothing 93.3
painting 80.1
woman 50.6
old 45.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 44-62
Gender Male, 88.5%
Disgusted 0.3%
Happy 0.5%
Angry 3.6%
Fear 0.3%
Calm 80.7%
Confused 3.8%
Surprised 0.7%
Sad 10%

AWS Rekognition

Age 19-31
Gender Female, 56.4%
Angry 0.8%
Fear 0.3%
Surprised 10%
Disgusted 0.3%
Sad 0.8%
Happy 9.7%
Calm 77.8%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

paintings art 97.5%

Text analysis

Amazon

Caotte
conery
mo
t'r
cone
n
Jravama
mo toait .
(10
ga
u Caotte
rou
o'oe
.
aiot . t'r
aiot
i o'oe ga
conery Ange Jravama Courule D.
Inue
d.'
itr
toait
d.i!
cone ava's eo ewr d.i!
D.
Courule
nouv Inue @romnnns
a'di'gnt
i
@romnnns
OLG
rou itr eor a1.' d.' a'di'gnt iipaitow
nouv
OLG L letr n
eo
u
ava's
iipaitow
Ange
letr
ewr
eor
a1.'
L

Google

Cantes
to
caiotte
Peetin
Courullen
d.
0.4
Conureyroue
Qane
te
n'oa
Yome
pretaw
a'aie
Jrar
?.dremant
rou
ald.
in!
araid
oie
commme
Cantes to caiotte d. Peetin Courullen ile nge Imadame d. 0.4 ange? Conureyroue ware lal. Qane te monde Tarigon n'oa troure Yome tu pretaw inoui a'aie Jrar ?.dremant rou ald. in! araid oie commme
ile
nge
Imadame
ange?
ware
lal.
monde
Tarigon
troure
tu
inoui