Human Generated Data

Title

Marble Fragment

Date

-

People

-

Classification

Material Specimens

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University; deposited by Professor J. M. Paton, 1977.216.2123.92

Human Generated Data

Title

Marble Fragment

Classification

Material Specimens

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University; deposited by Professor J. M. Paton, 1977.216.2123.92

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Food 99.9
Rock 99.5
Soil 98.7
Mineral 96.4
Crystal 84.4
Accessories 71.2
Accessory 71.2
Ornament 64.2
Limestone 63.2
Jewelry 61.6
Gemstone 60.9

Clarifai
created on 2023-10-26

no person 99.4
food 91.8
one 86.8
slice 84.2
geology 83.8
nature 79.1
quartz 77.6
fish 76.4
rock 75.8
prehistoric 75.6
meat 75.2
paleontology 74.4
still life 73.5
stone 71.4
delicious 69.7
ore 67.9
pork 65.3
dry 64.6
art 64.5
cutout 62.2

Imagga
created on 2022-01-22

toast 100
bread 65.8
food 52.1
breakfast 44.3
loaf 42.8
brown 38.3
baked 37.6
bakery 37.5
wheat 36.7
slice 33.7
chip 33.4
meal 33.3
crust 33
snack 30
healthy 27.1
pastry 26.2
delicious 25.6
tasty 25.1
fresh 24.2
nutrition 22.7
diet 22.7
eating 21.9
close 21.7
grain 21.3
eat 20.2
piece 20.1
bake 19.3
dinner 18.6
sandwich 18.4
sweet 18.2
sliced 17.4
whole 17.2
cut 17.1
gourmet 16.2
dessert 16.1
studio 16
slices 15.5
lunch 15.5
closeup 14.9
rye 14.7
cereal 14.7
baker 13.7
bun 13.6
organic 13.5
cake 13.2
candy 12.7
homemade 12.5
traditional 12.5
tea 12.4
flour 11.9
crusty 11.9
crisp 11.8
baking 11.7
natural 11.4
kitchen 10.8
butter 10.5
texture 10.4
dough 10
carbohydrates 9.8
fat 9.3
backgrounds 8.9
yeast 8.9
cuisine 8.9
objects 8.7
nutritious 8.6
two 8.5
detail 8.1
yellow 8
baguette 7.9
life 7.8
culture 7.7
health 7.7
seed 7.6
dark 7.5
freshness 7.5
cook 7.3
cheese 7.3
morning 7.2
color 7.2
sugar 7
nobody 7
cooking 7

Google
created on 2022-01-22

Natural material 85.9
Bedrock 85.8
Amber 82.7
Artifact 82.4
Wood 73.8
Brick 67.7
Fashion accessory 67.2
Peach 66.8
Metal 65.7
Rock 65.4
Font 64.8
Stone tool 63.5
Limestone 63.1
Quartz 62.7
Igneous rock 59.3
Rubble 59
Chemical compound 58.4
Mineral 57.9
Art 54.2
Triangle 53.7

Microsoft
created on 2022-01-22

food 91.3
rock 89.1
piece 82
mineral 78.9
stone tool 64.8
igneous rock 51.8
bread 48.4
half 45.3
snack food 22.6

Color Analysis

Feature analysis

Amazon

Bread

Clarifai

No features identified

AWS Rekognition

Bread 99.9%

Categories

Imagga
created on 2022-01-22

food drinks 92%
paintings art 7%

Captions

Microsoft
created by unknown on 2022-01-22

a piece of bread 90.7%
a close up of a piece of bread 86.6%
a piece of food 85%

Salesforce

Created by general-english-image-caption-blip on 2025-05-23

a photograph of a rock with a large rock face on it

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image shows a piece of reddish-brown rock with an irregular, jagged form. The rock has uneven surfaces and edges, reflecting natural fractures and rough textures. The coloration varies slightly, ranging from reddish hues to earth tones, with subtle variations in shades. The overall appearance suggests a mineral-rich rock that could belong to sedimentary or metamorphic classifications. The background is a plain, light gray or white, which highlights the rock's details.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image shows a piece of jasper, which is an opaque, impure variety of silica, usually red, yellow, brown, or green in color. The piece in the image has a predominantly reddish-brown hue with some lighter areas and subtle variations in color. The surface appears rough and unpolished, exhibiting natural cracks and fractures. Jasper is often used as a gemstone and can be found in various geological environments. The image captures the irregular shape and texture of the stone, emphasizing its raw, natural state.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image shows a large, irregularly shaped rock or mineral specimen. The rock has a reddish-brown color with a rough, textured surface. It appears to be a natural, uncut piece of rock with distinct layers and fractures visible. The overall shape of the rock is angular and jagged, suggesting it may be a piece of sedimentary or metamorphic rock. The image provides a clear and detailed view of the rock's distinctive features and natural characteristics.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This image shows a chunk or specimen of raw feldspar, which is a common rock-forming mineral. The sample has a pinkish-orange to salmon color typical of orthoclase feldspar. It displays characteristic angular cleavage planes that intersect at roughly 90-degree angles, creating flat, smooth surfaces where the mineral has broken. The specimen appears to be a rough, unpolished piece with a somewhat matte surface texture. The lighting in the photo highlights the mineral's natural luster and the subtle variations in its coloring.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a rough, brown rock with a flat top and a jagged edge on the right side. The rock is positioned at an angle, with its left side closer to the viewer than its right side. It has a light-brown color with darker brown patches and a rough texture.

The background of the image is white, suggesting that it may be a product photo or a scientific illustration. The rock appears to be a type of sedimentary rock, possibly sandstone or shale, based on its texture and color. However, without more information, it is difficult to determine the exact type of rock or its origin.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a rock with a rough, irregular shape and a light brown color. The rock is positioned at an angle, with its left side facing the viewer and its right side angled away. It has a rough texture, with visible cracks and crevices on its surface. The rock's color is a muted brown hue, with some lighter and darker shades visible throughout.

The background of the image is a plain white surface, which provides a clean and neutral backdrop for the rock. There are no other objects or features visible in the image, allowing the viewer to focus solely on the rock.

Overall, the image presents a simple yet detailed view of a rock, highlighting its unique shape, texture, and color.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image shows a large, irregularly shaped rock with a reddish-brown color and a smooth, polished surface. The rock appears to be a type of sedimentary rock, possibly sandstone or shale, based on its texture and appearance. The rock has a rough, uneven surface with some small cracks and indentations, and it appears to have been cut or sliced from a larger piece. The rock is placed on a white background, which makes its color and texture stand out.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image shows a close-up view of a piece of rock. The rock is brown, and it has a rough surface with some parts having a shiny appearance. It has some cracks and uneven edges, giving it a rugged look. The rock is placed on a white surface, which highlights its natural colors and textures. The image captures the intricate details of the rock, showcasing its unique patterns and formations.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

The image shows a large, irregular rock fragment. The rock is primarily a warm reddish-brown color, with variations in tone and some areas of lighter, yellowish-brown. It appears to have a rough, textured surface with visible cracks and imperfections. The shape is somewhat angular, with a few flat, planar faces and several broken, uneven edges. The background is a plain, light-colored surface, likely white or off-white, allowing the rock to be the main focus. The lighting appears to be soft and even, casting subtle shadows and highlighting the texture of the rock.

Created by gemini-2.0-flash on 2025-05-16

The image shows a reddish-brown rock on a white background. The rock has a roughly cuboid shape but with broken and uneven edges. The rock's surface has variations in color, with some areas lighter and others darker, and some spots showing a hint of greenish-yellow. There are also visible cracks and textures on its surface, suggesting a natural, weathered appearance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image shows a piece of rock with a reddish-brown hue. The rock appears to have a rough, uneven surface with visible fractures and layers. The texture suggests that it might be a sedimentary rock, possibly a type of sandstone or shale, which often exhibit such layering and coloration due to the presence of iron oxides. The edges of the rock are irregular, indicating it might have been naturally broken or weathered. The overall appearance of the rock suggests it could be used for geological study or as a decorative element.

Qwen