Human Generated Data

Title

Salt Cellar with Hercules Motifs
Date

c. 1550
People

Artist: Unidentified Artist,

Classification

Vessels
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.208

Human Generated Data

Title

Salt Cellar with Hercules Motifs

People

Artist: Unidentified Artist,

Date

c. 1550

Classification

Vessels

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.208

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Baby 98.3
Person 98.3
Jar 97.8
Baby 96.4
Person 96.4
Art 93.9
Porcelain 93.9
Pottery 93.9
Face 87.7
Head 87.7
Painting 86.4
Baby 63
Person 63
Furniture 57.9
Cup 57
Archaeology 56.7

Clarifai
created on 2023-11-01

container 99.8
no person 99
art 98.7
one 97.4
antique 95.4
people 95.1
retro 94.7
still life 93.6
old 92.4
ancient 91.8
pottery 90.7
vase 87.7
urn 87.6
painting 86.8
lid 86.3
illustration 86.1
sculpture 85.9
box 85.8
indoors 84.9
vintage 82.2

Imagga
created on 2018-12-21

container 78.9
pedestal 59
cup 47.4
support 44.9
supporting structure 35.5
glass 32.8
drink 26.7
vessel 26.6
object 26.4
bin 25.4
structure 22.5
jar 22.4
ashcan 22
vase 21.7
pitcher 21.7
tableware 21.2
beverage 20.1
liquid 18.3
cold 17.2
ware 16.5
water 16
earthenware 16
alcohol 15.2
ceramic ware 15.2
utensil 13.9
jug 13.5
ice 13.4
refreshment 12.7
close 12.6
transparent 12.5
nobody 12.4
single 12.3
decoration 12.3
lid 11.8
can 11.7
tea 11.6
cool 11.5
plastic 11
food 10.9
clean 10.9
garbage 10.8
wet 10.7
reflection 10.6
clear 10.5
fresh 10.5
metal 10.5
antique 10.4
paper 10.2
bar 10.2
life 10.2
pottery 10.1
old 9.8
ceramic 9.7
cube 9.7
objects 9.6
bottle 9.2
full 9.1
drop 9.1
health 9
celebration 8.8
closeup 8.8
empty 8.6
business 8.5
pure 8.3
majolica 8.2
healthy 8.2
kitchen 8
trash 7.8
alcoholic 7.8
culture 7.7
cocktail 7.7
money 7.7
pot 7.6
splash 7.5
traditional 7.5
one 7.5
vintage 7.4
dollar 7.4
domestic 7.2
china 7.2
wealth 7.2
currency 7.2
home 7.2
shiny 7.1

Google
created on 2018-12-21

black and white 90.3
monochrome photography 74.4
monochrome 68.5
still life photography 63.4

Microsoft
created on 2018-12-21

wall 96
vessel 80.8
art 20.9
ceramic ware 20.9
black and white 9.8
ceramic 8.3
pottery 5.8
flower 4.3
vase 4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 98%
Sad 27.8%
Calm 27.8%
Angry 23.5%
Surprised 12.9%
Confused 12.2%
Fear 7.1%
Disgusted 3.3%
Happy 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Baby 98.3%
Person 98.3%

Captions

Microsoft

a can of food 34.2%
a can sitting on a table 25.1%

Text analysis

Amazon

RA
S
E:DIA
NT
NBD E:DIA NT
LERAVICEMA :HERCVLE S
:HERCVLE
LERAVICEMA
NBD

Google

AVICEMAKHERCVLES RA
AVICEMAKHERCVLES
RA