Human Generated Data

Title

SHERD

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Miss Bettina J. Kahnweiler, 1935.35.71.H

Human Generated Data

Title

SHERD

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Miss Bettina J. Kahnweiler, 1935.35.71.H

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Food 98.4
Triangle 97
Slate 94.1
Rock 89.9
Arrowhead 58

Clarifai
created on 2019-07-07

no person 99.8
triangle 98.6
still life 97.6
candy 97.3
food 97.3
geology 94.9
chocolate 94.8
one 94.7
rock 94.5
sugar 93.4
mine 93.4
disjunct 90.8
texture 90
sweet 89.6
stone 89
delicious 89
stranded 88.5
ore 88.1
slice of 85.8
pyramid 85.7

Imagga
created on 2019-07-07

chocolate 80.8
food 71.4
toast 53.7
brown 33.9
candy 32.4
bread 31.4
sugar 28.5
delicious 26.4
slice 25.5
meal 23.5
dessert 23.3
tasty 20.9
baked 20.6
bakery 20
piece 20
sweet 19.8
loaf 19.4
close 18.8
healthy 18.3
diet 17.8
eat 17.6
snack 17.1
closeup 16.8
fat 16.8
nutrition 15.9
nobody 15.6
pastry 15.4
wheat 15.2
fresh 15
cake 14.1
eating 13.5
breakfast 13.3
gourmet 12.7
crust 12.6
cut 12.6
detail 12.1
grain 12
sliced 11.5
lunch 11.1
object 11
kitchen 10.7
organic 10.1
natural 10
bake 9.6
cream 9.4
dinner 9.3
texture 9
black 9
cuisine 8.9
baker 8.8
baking 8.7
whole 8.6
plate 8.5
dark 8.4
health 8.3
traditional 8.3
ingredient 8.1
confectionery 8
cooking 7.9
paper 7.8
fattening 7.8
color 7.8
cereal 7.7
sandwich 7.7
leather 7.6
wallet 7.5
product 7.5
meat 7.2

Google
created on 2019-07-07

Rock 84.3
Mineral 71.4
Artifact 56.8

Microsoft
created on 2019-07-07

chocolate 89.6
slice 85.1
piece 77.5
rock 64.3
dessert 43.4

Color Analysis

Feature analysis

Amazon

Bread

Clarifai

Food

AWS Rekognition

Bread 98.4%

Clarifai

Food 38.7%

Categories

Imagga
created on 2019-07-07

nature landscape 60.8%
food drinks 35.1%
pets animals 3.2%

Captions

Microsoft
created by unknown on 2019-07-07

a piece of cake covered in chocolate 64.1%
a piece of chocolate cake 57.5%
a piece of cake 57.4%

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a triangle shaped object with a triangle shaped object

Created by general-english-image-caption-blip-2 on 2025-07-03

a small piece of stone with a brown color

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image shows a triangular-shaped piece of dark, opaque material, possibly stone or rock. The surface appears rough and matte, with uneven edges. The coloration is predominantly brown with subtle variations in tone, suggesting it might be natural or weathered. It is placed against a plain white background, emphasizing its shape and texture.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a piece of dark brown pottery that is triangular in shape, resting upright against a plain white background. The pottery shard appears to have a slightly uneven surface and edges, suggesting it might be an ancient artifact or a fragment of a larger ceramic object. The lighting highlights the texture and some surface scratches on the pottery, indicating wear and age.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a large, irregularly shaped rock or stone. The rock has a dark, earthy brown color and appears to have a rough, textured surface with some visible cracks or fractures. The rock is positioned on a plain, white background, allowing the details of its surface to be clearly visible.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The image shows a single, dark-colored rock against a plain white background. The rock has an irregular, roughly triangular shape with a pointed tip. Its surface appears rough and pitted, likely weathered over time. The rock seems to be a natural, unpolished specimen, possibly a fragment from a larger rock formation or meteorite. Without additional context, it's difficult to determine the exact type of rock or mineral, but the image provides a clear, close-up view of this intriguing geological sample.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This image shows a triangular-shaped fragment or shard of what appears to be dark brown pottery or ceramic material. The piece has rough, broken edges and appears to be relatively flat. The surface shows some scratches and wear marks, suggesting it's an archaeological artifact or ancient pottery fragment. The object is photographed against a plain white background, which helps highlight its shape and texture. The material has a somewhat matte finish and appears to be made of earthenware or similar clay-based material.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-08

The image features a dark brown, rough-hewn rock or stone, characterized by its irregular shape and jagged edges. The surface of the object exhibits a mottled appearance, with lighter and darker shades of brown visible throughout.

The rock is positioned centrally in the frame, set against a plain white background that provides a stark contrast to the object's earthy tones. The overall effect is one of simplicity and clarity, allowing the viewer to focus on the texture and form of the rock.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-08

This image depicts a rough, dark brown rock with a triangular shape. The rock's surface is rough and uneven, featuring small cracks and crevices. It appears to be made of a dense, heavy material, possibly a type of stone or mineral.

The rock is positioned on a plain white background, which suggests that it may be a product photo or a scientific illustration. The lighting is even and neutral, which helps to highlight the texture and color of the rock.

Overall, the image presents a clear and detailed view of the rock, allowing the viewer to examine its shape, size, and surface features.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image depicts a single, irregularly shaped dark brown stone resting on a white surface. The stone has a rough texture with visible striations and uneven edges, suggesting it has been naturally weathered or possibly hand-polished. The edges of the stone are slightly chipped, indicating its rough and rugged appearance. The stone appears to be a piece of natural rock, possibly basalt or another type of volcanic rock, given its color and texture. It is placed centrally in the image, with ample space around it, allowing for a clear view of its texture and contours. The lighting in the image is soft and even, highlighting the stone's surface without any harsh shadows.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image shows a brown stone, which appears to be a rock. It is a triangular-shaped rock with a flat surface. The rock is placed on a white surface, which could be a table. The rock has a rough texture, and it seems to be a piece of a larger rock. The rock has a dark brown color, and it has some scratches on it.

Google Gemini

Created by gemini-2.0-flash on 2025-05-14

Here's a description of the image:

The image shows a fragment of rock, roughly triangular in shape, resting on a white surface. The rock is a deep brown color and has a slightly rough texture. The edges of the triangle are uneven and somewhat jagged. The rock is casting a subtle shadow on the surface below.

Created by gemini-2.0-flash-lite on 2025-05-14

Here is a description of the image:

The image shows a single, triangular-shaped piece of dark brown rock. The rock has a rough, textured surface with some visible scratches and imperfections. The edges of the rock are uneven and irregular, suggesting it is a broken fragment. The rock is positioned in the center of the frame and casts a slight shadow beneath it. The background is plain white, providing a clean contrast to the dark-colored rock.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a triangular piece of dark-colored material, likely a fragment of pottery or a similar artifact. The surface appears to be rough and uneven, with some visible scratches and imperfections. The edges are slightly rounded, suggesting it may have been broken or worn down over time. The color is a deep brown or reddish-brown, which is typical of certain types of clay or ceramic materials. The fragment is set against a plain, light-colored background, which contrasts with the dark color of the object, making it stand out clearly.

Qwen