Human Generated Data

Title

Salt Cellar with Hercules Motifs
Date

c. 1550
People

Artist: Unidentified Artist,

Classification

Vessels
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.207

Human Generated Data

Title

Salt Cellar with Hercules Motifs

People

Artist: Unidentified Artist,

Date

c. 1550

Classification

Vessels

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.207

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Art 99.9
Porcelain 99.9
Pottery 99.9
Person 98.6
Person 98.4
Person 95.4
Treasure 91
Face 81.2
Head 81.2
Person 61.2
Tin 57
Painting 56.2
Box 56.2
Archaeology 55.3
Bronze 55.2

Clarifai
created on 2023-11-01

container 99.1
no person 98.5
one 97.6
box 96.9
art 95.5
people 94.5
illustration 92
retro 90.2
wealth 88.2
old 87.4
antique 87.3
jewelry 83.3
still life 82
ancient 81.7
sculpture 81.2
isolated 81
business 80.9
indoors 80.8
lid 78.9
cutout 78.8

Imagga
created on 2018-12-21

container 67
ashcan 61.5
box 58.4
bin 49.9
chest 35.9
money 28.9
currency 27.8
birdhouse 25.2
wealth 24.2
bank 22.4
paper 21.2
shelter 20
finance 19.4
dollar 18.6
investment 18.3
business 18.2
loan 18.2
exchange 18.1
old 16.7
device 16.2
bill 16.2
house 15.9
protective covering 15.7
banking 15.6
object 15.4
home 15.2
hundred 14.5
decoration 14.5
cash 13.7
gold 13.1
new 13
dollars 12.6
vintage 12.4
antique 12.1
savings 12.1
metal 12.1
mortgage 11.7
insurance 11.6
treasure 11.6
close 11.4
ideas 11.2
furniture 11.2
gift 11.2
sale 11.1
housing 10.7
financial 10.7
concepts 10.7
price 10.6
seat 10
sign 9.8
selling 9.8
brown 9.6
building 9.5
economy 9.3
lighter 9
retro 9
reflection 8.9
market 8.9
celebration 8.8
package 8.8
closeup 8.8
paying 8.7
debt 8.7
ancient 8.6
capital 8.5
commercial 8.5
stock 8.4
rich 8.4
wood 8.3
present 8.2
wooden 7.9
holiday 7.9
president 7.9
deposit 7.8
case 7.8
golden 7.7
us 7.7
finances 7.7
residential 7.7
coin 7.6
development 7.6
estate 7.6
buy 7.5
open 7.2
structure 7.1
silver 7.1

Google
created on 2018-12-21

black and white 87.4
monochrome photography 60.9
monochrome 59.4
artifact 54.7
product 50.2

Microsoft
created on 2018-12-21

container 81.1
box 67.5
old 65.5
can 26.3
book 18.1
art 6.3
black and white 4.7
monochrome 3.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 55.6%
Calm 97.6%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Disgusted 0.5%
Happy 0.2%
Angry 0.2%
Confused 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Categories

Imagga

paintings art 97.2%
interior objects 2.3%

Captions

Microsoft
created on 2018-12-21

a clock attached to a can 50.7%
a clock is attached to a can 45%

Text analysis

Amazon

CACVS
HERCVLES
IW IT CACVS
ALEK
LI;
APROVELS
IW IT