Human Generated Data

Title

Salt Cellar with Episodes from the Life of Hercules
Date

c. 1550
People

Artist: Unidentified Artist,

Classification

Vessels
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.209

Human Generated Data

Title

Salt Cellar with Episodes from the Life of Hercules

People

Artist: Unidentified Artist,

Date

c. 1550

Classification

Vessels

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 86.9
Person 86.9
Person 83.2
Box 80.3
Tin 75.2
Drum 63.5
Musical Instrument 63.5
Percussion 63.5
Trash Can 62.5
Can 62.5

Clarifai
created on 2018-03-16

container 99.8
no person 99.5
box 98.6
one 97.6
decoration 95.4
art 93.7
metalwork 93.6
cutout 93.2
sculpture 92.5
lid 91.1
still life 89.2
ancient 88.5
retro 88
people 87.7
vintage 87.5
disjunct 87.2
ornate 86.7
indoors 86.6
old 85.7
design 85.2

Imagga
created on 2018-03-16

container 97.4
thimble 69.4
cap 53.5
protective covering 42.5
covering 28.6
saltshaker 24.5
shaker 20.5
object 19.8
glass 19.6
money 18.7
currency 17.9
drink 17.5
box 17
metal 16.9
wealth 16.2
dollar 15.8
paper 15.7
bin 15.2
cup 14.4
ashcan 14.1
finance 13.5
bank 13.4
investment 12.8
decoration 12.3
liquid 12.2
device 11.9
reflection 11.4
cash 11
beverage 10.9
lighter 10.9
hundred 10.7
loan 10.5
business 10.3
close 10.3
food 10.2
gold 9.9
transparent 9.8
sign 9.8
tin 9.7
home 9.6
celebration 9.6
exchange 9.5
gift 9.5
golden 9.5
closeup 9.4
culture 9.4
antique 9.2
banking 9.2
single 9
water 8.7
cold 8.6
jar 8.5
design 8.4
one 8.2
ice 8.1
binding 7.9
ancient 7.8
dollars 7.7
coin 7.6
bill 7.6
jug 7.6
commercial 7.5
bar 7.4
new 7.3
vessel 7.3
can 7.2
financial 7.1
market 7.1

Microsoft
created on 2018-03-16

container 74.3

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 65.9%
Surprised 3%
Happy 0.4%
Angry 4.4%
Sad 67.2%
Calm 19.5%
Confused 4.3%
Disgusted 1.3%

AWS Rekognition

Age 38-59
Gender Male, 52.7%
Surprised 45.3%
Confused 45.6%
Calm 46%
Sad 52.4%
Happy 45%
Disgusted 45.1%
Angry 45.6%

Feature analysis

Amazon

Person 86.9%
Box 80.3%

Captions

Microsoft

a can next to a clock 29.1%
a can of soda 29%
a can sitting on a table 28.9%

Text analysis

Amazon

PVISAN
AN
EROOVTES*ET
LIDRAN
EROOVTES*ET VLES*ET
VLES*ET
FRCVILS
LID LIDRAN AN FRCVILS
LID