Human Generated Data

Title

Sherd

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.117

Human Generated Data

Title

Sherd

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.117

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Food 100
Bread 100
Plant 88
Confectionery 78.8
Sweets 78.8
Dessert 72.7
Produce 61
Fruit 58.2
Pastry 57.9
Bun 57.7
French Toast 56.9
Toast 56.9

Clarifai
created on 2019-07-08

food 99.5
no person 97.4
refreshment 96.7
sweet 96.2
stranded 94.8
breakfast 94.7
delicious 94
tasty 93.9
bread 93.8
pastry 91.4
fruit 90.8
meal 90.5
slice 90.4
desktop 90.4
nutrition 87.8
cookie 87.7
healthy 87
cake 85.9
bakery 84.7
closeup 84.2

Imagga
created on 2019-07-08

toast 100
bread 54.9
food 51.1
baked 35.6
brown 34.6
wheat 34.4
breakfast 32.9
snack 32.5
meal 31.8
slice 31
loaf 28.2
bakery 27.9
crust 24.2
healthy 24
eating 23.6
delicious 23.1
tasty 21.8
fresh 21.6
diet 21
nutrition 21
pastry 20.8
sandwich 20.3
dinner 20.2
gourmet 18.7
grain 18.5
lunch 18
eat 17.6
close 16.6
sliced 16.4
nobody 16.3
organic 16
dessert 15.9
sweet 14.2
bake 13.5
piece 13.3
cake 13.2
butter 12.1
cut 11.7
homemade 11.6
whole 11.5
closeup 11.5
studio 11.4
objects 11.3
object 11
baker 10.8
flour 10.7
yellow 10.6
chip 10.5
cheese 10.5
nutritious 10.5
fat 10.3
traditional 10
meat 9.9
baking 9.7
slices 9.7
plate 9.3
cutout 9.3
kitchen 9
crusty 8.9
toasted 8.9
carbohydrates 8.9
bun 8.8
sugar 8.8
cereal 8.8
dough 8.8
chocolate 8.6
color 8.4
appetizer 8.1
carbohydrate 7.9
cooking 7.9
crunchy 7.8
crisp 7.8
rye 7.8
restaurant 7.8
portion 7.8
horizontal 7.5
freshness 7.5
single 7.4
detail 7.2

Google
created on 2019-07-08

Food 80.6
Dish 69
Cuisine 61.5
Beige 54.8
Side dish 53.1
Baked goods 51.1

Microsoft
created on 2019-07-08

piece 98.1
slice 93.7
food 92.1
bread 82.7
baked goods 64.6
dessert 57.4
half 50.7
sliced 15.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-45
Gender Female, 77.1%
Sad 9.4%
Surprised 6.4%
Angry 7.4%
Disgusted 11.1%
Calm 49.8%
Confused 5.2%
Happy 10.7%

Feature analysis

Amazon

Bread
Bread 100%

Categories

Imagga

food drinks 99.1%

Captions

Microsoft
created by unknown on 2019-07-08

a piece of bread on a plate 90.7%
a piece of bread 90.6%
a piece of bread with a dessert on a plate 87%

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a piece of fruit on a white surface -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a roughly-shaped natural rock or mineral specimen with a concave surface. The exterior has a reddish-brown texture, resembling sandstone or a similar material, while the interior features a polished section with embedded crystals, including small, shiny rounded formations. These embedded portions appear to be a mix of translucent and opaque minerals with blue, gray, and brown tones. The rock is displayed against a plain white background, emphasizing its natural texture and crystalline details.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows a piece of rock that has been split in half to reveal its inner structure. The rock's outer surface is rough and brownish, while the inner surface has a smoother, yellowish appearance. Embedded within the rock's core are several rounded formations that seem to be mineral deposits or crystals. These formations vary in color, including shades of bluish-gray, pink, and brown, and have a glossy or shiny appearance due to the cut and polish they appear to have undergone. The rock is displayed against a plain white background, highlighting its unique geological features.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a piece of rock or mineral with an interesting geological formation. The surface of the rock appears to be rough and textured, with various colors and patterns visible. The rock has a yellowish-brown hue and contains small, irregular-shaped inclusions or formations that appear to be different minerals or crystals embedded within the rock. The overall shape of the rock fragment is irregular and asymmetrical, suggesting it may have been broken or chipped off from a larger rock formation.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This image shows what appears to be a cross-section or half of a rotten or spoiled potato. The inside of the potato has a yellowish-beige color and shows signs of decay, with some darker spots and discolored areas. The potato's flesh appears soft and deteriorated, with some small cavities or holes visible. The outer skin is brownish in color. The image is taken against a plain white background, showing the potato specimen in clear detail.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts a slice of amber with various objects embedded within it.

The amber slice is positioned horizontally in the center of the image, with its top surface facing upwards. It has a light yellow color and a rough, irregular shape. The edges of the slice are darker brown and appear to be rough and uneven.

Embedded within the amber are several small objects, including what appear to be insects or other small creatures. These objects are dark brown or black in color and have a shiny appearance. They are scattered throughout the amber, with some of them appearing to be partially preserved or fossilized.

The background of the image is white, suggesting that the amber slice is being displayed against a plain backdrop. Overall, the image provides a detailed view of the amber slice and its contents, highlighting the unique characteristics of this natural material.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image depicts a ceramic bowl with a face painted on it, set against a white background. The bowl is positioned centrally in the frame and appears to be made of clay or ceramic material. It has a rough, uneven edge and a flat bottom, suggesting that it may have been handmade.

The face painted on the bowl is simple yet expressive, with a few bold brushstrokes used to define the features. The eyes are large and round, with dark pupils that seem to stare out from the bowl. The nose is small and slightly upturned, giving the face a playful appearance. The mouth is a thin line that curves downward slightly, suggesting a hint of sadness or melancholy.

The overall effect of the image is one of whimsy and charm, as if the bowl has come to life and is gazing out at the viewer. The use of a plain white background helps to focus attention on the bowl and its painted face, creating a sense of intimacy and connection between the viewer and the object.

It's worth noting that the image may be a photograph of an art piece or a craft project, rather than a real bowl with a face painted on it. The level of detail and the quality of the image suggest that it may have been taken by a professional photographer or artist, rather than a casual snapshot.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image features a ceramic bowl with a unique design. The bowl is irregular in shape, resembling a natural, rough stone. It is made of a mixture of yellow and red glazes, giving it a rustic and earthy appearance. The bowl has a concave shape, with a wide opening and a slightly curved rim. The glaze on the bowl has a slightly cracked and weathered look, adding to its natural and organic feel.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image shows a piece of pottery on a white background. It is a flat, circular object with a rough, uneven surface and a slightly curved edge. The pottery appears to be made of clay, with a brownish-yellowish color and some dark spots. The surface of the pottery has a few small holes, and there are some small stones or pebbles embedded in it. The overall appearance of the pottery suggests that it is handmade and has a rustic, earthy feel.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-15

Here's a description of the image:

The image showcases a fragment of a ceramic object, possibly a bowl or a plate. The fragment has an irregular, organic shape with a reddish-brown, rough exterior. The interior surface is smooth and a light tan or beige color, with a subtle crackled texture. Embedded within the center are small, seemingly decorative elements: a few small, irregularly shaped pebbles or spots of various colors, including black, gray, and pinkish-brown. The surface appears slightly glossy, with some areas that look wet or glazed. The background is a clean, bright white, emphasizing the object's details and isolating it for observation.

Created by gemini-2.0-flash on 2025-05-15

Here's a description of the image:

The image shows a broken piece of ceramic pottery or tile, displayed against a plain white background. The fragment is irregularly shaped and roughly triangular. The outer rim is a reddish-brown color with a rough, textured surface.

The inner surface of the fragment has a glazed finish in a light yellowish-tan color. Within the glazed area are several darker spots or imperfections in varying shades of brown, gray, and black. The surface of the glaze is cracked and has a slightly uneven texture.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image shows a piece of pottery, specifically a fragment of a ceramic bowl. The fragment is roughly triangular in shape and appears to have been broken off from a larger vessel. The interior surface of the fragment is glazed with a yellowish-green color, which shows signs of wear and discoloration. There are also some darker spots and patches, possibly indicating areas where the glaze has deteriorated or where the pottery has been damaged. The exterior of the fragment is unglazed and has a reddish-brown color, suggesting that it is made of terracotta or a similar type of clay. The edges of the fragment are rough and uneven, indicating that it has been broken rather than cut. The overall condition of the piece suggests it may be an artifact or an old, possibly archaeological, item.