Human Generated Data

Title

Salt Cellar with Allegorical Scenes

Date

c. 1550

People

Artist: Unidentified Artist,

Classification

Vessels

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.210

Human Generated Data

Title

Salt Cellar with Allegorical Scenes

People

Artist: Unidentified Artist,

Date

c. 1550

Classification

Vessels

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Jesse Isidor Straus in memory of her husband, Jesse Isidor Straus, Class of 1893, 1957.210

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Jar 91.6
Pottery 84.3
Human 81.3
Person 81.3
Tin 80.1
Person 78.8
Painting 77.1
Art 77.1
Vase 72
Person 68.6
Potted Plant 64.5
Plant 64.5
Can 63.8
Trash Can 62.2
Box 60.3

Clarifai
created on 2018-03-16

container 99.7
no person 98.7
art 98.3
metalwork 98
sculpture 96.6
veil 94.3
one 94.1
lid 93.3
ancient 92.9
religion 92.3
old 90.2
decoration 89.3
box 89.3
symbol 89.3
museum 88.8
still life 87.8
people 87.8
illustration 87.6
painting 87.5
cutout 86.7

Imagga
created on 2018-03-16

container 83
pedestal 44.7
support 34.2
bin 28.5
ashcan 28.4
supporting structure 26.9
jar 25.3
glass 24.9
vessel 24.5
cup 24.5
object 23.4
vase 20.7
can 19.7
structure 19.2
ceramic ware 18.7
drink 18.4
pottery 15.9
paper 14.9
earthenware 14.7
milk can 14.3
utensil 14.2
antique 14
single 14
pitcher 14
old 13.9
money 13.6
currency 12.6
decoration 12.3
liquid 12.2
jug 12.1
dollar 12.1
close 12
bottle 11.6
box 11.5
alcohol 11.2
ancient 11.2
china 11.1
beverage 10.9
lid 10.8
wealth 10.8
vintage 10.7
metal 10.5
nobody 9.3
finance 9.3
business 9.1
food 9.1
design 9
bank 9
transparent 8.9
brown 8.8
closeup 8.8
hundred 8.7
water 8.7
thimble 8.5
banking 8.3
cash 8.2
retro 8.2
reflection 8.1
ware 7.9
saltshaker 7.9
tin 7.8
cold 7.7
ceramic 7.7
culture 7.7
loan 7.7
cap 7.5
tableware 7.5
gold 7.4
ice 7.4
investment 7.3
color 7.2
black 7.2
celebration 7.2
art 7.2

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

container 63.8
box 59.7
ceramic ware 30.7
several 12.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Female, 54.8%
Angry 45.3%
Disgusted 45.1%
Happy 45.1%
Sad 53.9%
Calm 45.4%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Surprised 45.7%
Sad 46.2%
Happy 45.7%
Disgusted 45.1%
Angry 45.7%
Calm 49.6%
Confused 46.9%

Feature analysis

Amazon

Person 81.3%
Painting 77.1%
Box 60.3%

Categories

Imagga

paintings art 99.9%
food drinks 0.1%

Captions

Microsoft
created on 2018-03-16

a statue of a box 62%
a statue in front of a box 61.9%
a statue of a person 53.8%

Azure OpenAI

Created on 2024-01-27

The image shows a hexagonal container with a tapered form and a sloped lid embossed and painted with decorative motifs. The body of the container demonstrates elaborate artwork featuring a skeleton draped in cloth, standing in a dynamic pose with one hand raised. Opposite the skeleton, two figures appear engaged in some form of interaction with an apparent gloomy demeanor. The background is dark, possibly black, providing stark contrast to the lighter-colored artwork. The container's lid and base are adorned with a border featuring a twisted rope-like design in a golden hue. The top rim and lid display intricate scrollwork patterns accented with lighter paint.

Anthropic Claude

Created on 2024-03-29

The image shows a decorative black box or container. The surface of the box is decorated with intricate designs and imagery. The main imagery depicts several skeletal figures and humanoid creatures in a fantastical scene. The figures appear to be engaged in some sort of supernatural or allegorical activity. The overall style and imagery convey a dark, macabre, and otherworldly aesthetic.

Text analysis

Amazon

2