Human Generated Data

Title

Sherd

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.184

Human Generated Data

Title

Sherd

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.184

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Food 96.8
Sweets 93
Confectionery 93
Cracker 92.1
Bread 76
Cookie 58.9
Biscuit 58.9

Clarifai
created on 2019-07-08

no person 98.8
one 97.3
food 94.7
still life 93
cutout 91.4
grow 90.9
desktop 90.5
abstract 89
texture 86.8
text 84.8
nature 82.9
two 80.6
medicine 80
bread 78.6
shape 78.5
symbol 78.1
disjunct 76.9
simplicity 76.5
closeup 76.1
three 75.8

Imagga
created on 2019-07-08

fastener 38.3
restraint 27.5
screw 23.7
latch 21.5
cap 19.8
stamp 19.7
ring 19
catch 18.2
brown 17.7
food 17.2
close 16.5
die 15.3
top 14.1
stone 13.5
gold 13.1
device 12.4
closeup 12.1
shaping tool 11.5
rock 11.3
metal 11.3
money 11.1
health 10.4
stones 10.4
sweet 10.3
love 10.3
rubber eraser 10.2
covering 10.2
candy 9.6
symbol 9.4
nut 9.2
business 9.1
pistachio 9
jewelry 9
golden 8.6
finance 8.4
texture 8.3
eraser 8.1
tool 8.1
spa 8.1
detail 8
life 7.8
old 7.7
cake 7.5
tasty 7.5
chocolate 7.5
delicious 7.4
coffee 7.4
edible nut 7.3
valentine 7.3
currency 7.2
seed 7.2
band 7.2
romance 7.1
dessert 7.1
decoration 7

Google
created on 2019-07-08

Food 83.9
Cuisine 70.6
Snack 68.4
Dish 64.1
Baked goods 63.8
Finger food 62.4
Cookie 60

Microsoft
created on 2019-07-08

food 93.9
baked goods 79.6
piece 78
snack 71.7
fast food 64
dessert 52.3
half 48

Color Analysis

Feature analysis

Amazon

Bread
Bread 76%

Captions

Microsoft
created by unknown on 2019-07-08

a piece of cake 52.3%
a piece of food 52.2%
a piece of cake on a plate 29.2%

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a small piece of food on a white surface -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image features a small object that looks like a fragment of a rock or mineral on a plain white background. The object has an irregular, angular shape and appears to consist of two distinct parts. One side has a tan or beige, porous texture reminiscent of sandstone or another sedimentary material, while the other side includes a white crystalline portion with a dark purple or black streak running through it. The background is minimal, showing faint specks and marks, emphasizing the isolated position of the object.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows a single flaky pastry on a plain white background. The pastry appears to have a small amount of a white icing or glaze on top, with a visible layer of dark filling, possibly a fruit preserve or chocolate, inside. The pastry itself is a golden-brown color, indicating it has been baked. The surrounding white background has some faint speckles and marks, giving it a slightly textured look. The pastry is positioned towards the center of the image and is the main focus, providing a sense of simplicity and minimalism.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a partially eaten pastry or baked good. It appears to be a golden-brown crust or shell with a dark filling or center visible. The item is resting on a plain, light-colored surface, possibly a table or countertop. The background is mostly white, with some small specks or speckles visible.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This image shows what appears to be a partially eaten cookie or pastry with white icing or frosting on top. There's a dark filling visible where a bite has been taken, suggesting it might be a jelly-filled or cream-filled cookie. The cookie itself appears to be a light golden-brown color, and it's photographed against a plain white background.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image presents a small, irregularly shaped object with a light brown hue and a darker brown stripe running through its center. The object is positioned centrally in the frame, set against a white background that appears to be slightly dirty or stained. The overall atmosphere of the image suggests that it may be a product photo or an illustration for educational purposes, possibly related to geology or natural history.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image presents a close-up view of a small, irregularly shaped piece of food, possibly a cookie or cracker, with a white and purple filling. The object is positioned in the center of the frame, set against a white background that appears to be a table or countertop. The surface exhibits minor imperfections, including small marks and scratches.

The object itself has a light beige color with a rough, irregular edge, suggesting it may have been broken or torn from a larger piece. The filling, which is visible through a small tear in the object's surface, is white on one side and purple on the other, with a darker purple stripe running through the middle. The overall appearance of the object is that of a small, broken piece of food, possibly a cookie or cracker, with a distinctive filling.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The image shows a small object on a white surface, possibly a piece of paper. The object appears to be a small rock or stone, with a rough surface and a unique shape. The stone has a combination of brown and white colors, with a dark brown or black spot in the middle. The stone is placed on the white surface, and it seems to be the only object in the frame.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image features a small, irregularly shaped object that appears to be a piece of a rock or mineral. The object is placed on a plain, white surface, which could be a table or a countertop. The rock has a light brown or beige color, with a slightly shiny and smooth texture. The edges of the rock are uneven and jagged, suggesting that it has been broken or chipped. The rock has a small, darker area on one side, which could be a mineral inclusion or a natural feature of the rock.

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

Here's a description of the image:

The image features a small, irregularly shaped stone lying on a white surface. The stone has a dual-tone appearance, with a tan or beige outer layer encompassing a section of white crystal. A dark band, possibly deep purple, separates the beige and white sections. The white surface has a slightly textured appearance, possibly due to it being concrete or another similar material. There are also some small specks and faint marks scattered across the white surface, adding to its imperfect nature. The stone is positioned relatively centrally in the frame, with ample white space around it.

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

The image features a small, light-colored rock or mineral specimen resting on a white surface. The rock has a jagged, irregular shape with a section of a darker, possibly purple, material visible within it. The background is a plain, slightly textured white, and the object is positioned towards the center of the frame. The lighting appears to be soft and even, illuminating the object with minimal shadows. The composition is simple, emphasizing the object against the clean backdrop.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image shows a partially eaten cookie with a visible filling. The cookie appears to be triangular in shape and has a light brown, slightly textured exterior. The filling inside the cookie is a combination of two layers: a darker, purplish layer on the bottom and a lighter, whitish layer on top. The darker layer could be a type of fruit jam or preserve, while the lighter layer might be a cream or frosting. The cookie is placed on a plain, light-colored surface, possibly a table or countertop. There are a few small marks or specks on the surface around the cookie.