Human Generated Data

Title

Multi-colored Stone Fragment

Date

-

People

-

Classification

Material Specimens

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University; deposited by Professor J. M. Paton, 1977.216.2123.332

Human Generated Data

Title

Multi-colored Stone Fragment

Classification

Material Specimens

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University; deposited by Professor J. M. Paton, 1977.216.2123.332

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Rock 100
Food 99.7
Rubble 94.5
Walkway 93.9
Path 93.9
Mineral 90.9
Crystal 56.9

Clarifai
created on 2019-07-07

rock 99.7
stone 99.2
geology 97.7
snow 97.5
nature 96.7
no person 96.5
winter 96.4
mine 95.3
granite 94.5
ice 93.7
cold 91.9
quartz 91.8
desktop 90.8
crystal 90.3
landscape 90.1
mountain 89.9
ore 86.2
one 84.4
texture 83.9
boulder 83.8

Imagga
created on 2019-07-07

shovel 60.6
hand tool 37
tool 34
brown 33.1
food 30.9
bread 28.7
loaf 23.3
bakery 22
delicious 20.6
baked 20.6
slice 20
close 20
healthy 19.5
stone 19
closeup 18.9
snack 18.8
meal 18.7
breakfast 18.6
tasty 18.4
dark 18.4
nut and bolt 17.4
diet 17
fastener 16.7
crust 16.5
chocolate 16.2
wheat 16.2
natural 15.4
restraint 15.2
piece 15.2
eating 15.1
device 14.4
cut 14.4
whole 14.3
sweet 13.4
pastry 13.4
nutrition 13.4
fire iron 13.4
eat 13.4
dessert 13.2
rye 12.7
organic 12.6
cereal 12.6
traditional 12.5
sugar 12.5
detail 12.1
grain 12
fresh 11.8
mineral 11.7
rock 11.3
gourmet 11
baking 10.7
corbel 10.5
full 10.1
object 9.5
cake 9.4
seed 9.4
nobody 9.3
invertebrate 9.1
black 9
kitchen 8.9
toast 8.9
homemade 8.7
sliced 8.7
candy 8.4
bracket 8.4
old 8.4
texture 8.3
freshness 8.3
memorial 8.2
structure 8.2
life 7.8
color 7.8
lunch 7.7
bake 7.7
fat 7.5
still 7.4

Google
created on 2019-07-07

Rock 97
Igneous rock 87.6
Geology 83.4
Mineral 79.5
Graphite 71.9
Bedrock 69.3
Metal 60.7
Lead 50

Microsoft
created on 2019-07-07

igneous rock 88.1
mineral 85.8
piece 74.9
granite 73.1
volcanic rock 72.8
stone 71.2
stone tool 67.2
slice 65.1
graphite 51.6
rock 24.3

Color Analysis

Feature analysis

Amazon

Bread

Clarifai

Food

AWS Rekognition

Bread 99.7%

Categories

Imagga
created on 2019-07-07

paintings art 70.8%
nature landscape 16%
food drinks 10.4%
pets animals 1.5%

Captions

Microsoft
created by unknown on 2019-07-07

a piece of cake covered in snow 37.4%
a piece of cake on a rock 37.3%
a piece of cake sitting on top of a rock 37.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-06

a photograph of a rock with a small piece of rock in the middle of it

Created by general-english-image-caption-blip-2 on 2025-06-28

a large rock sitting on a white surface

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows a piece of rock with a rough, irregular shape and textured surface. It is predominantly gray with lighter-colored patches and speckles, likely indicative of different minerals or materials embedded in the rock. The rock appears solid and dense, with broken and jagged edges, giving it a raw and unpolished appearance. It is set against a plain white background, highlighting its natural details and features.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a piece of polished granite. The granite has a rectangular, block-like shape with a rough and uneven surface on its sides, and a mostly flat top surface. The stone has a speckled pattern with various shades of gray, black, white, and some brownish areas. This is characteristic of granite, which is composed primarily of quartz, feldspar, and mica, giving it its distinctive speckled appearance. The surface reflects light, indicating the rock has been polished or has naturally smooth facets. The background is a neutral white, making the granite sample stand out clearly in the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a rock sample with a rough, irregular surface. The rock appears to be a type of igneous or metamorphic rock, with a mottled gray and brown coloration and visible mineral inclusions or crystals. The rock has an angular, blocky shape and appears to be a natural, unprocessed specimen. The background is a plain white surface, allowing the details of the rock to be clearly visible.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This image shows a rock or mineral specimen photographed against a white background. The specimen appears to have a mottled or variegated coloring, with patches of dark gray or bluish-gray mixed with lighter cream or white areas. The surface texture is rough and uneven, typical of a natural rock formation. The sample has a roughly rectangular or block-like shape with irregular edges and appears to be a raw, unpolished piece. There are also some rusty brown or orange-colored areas visible on parts of the specimen, which could indicate the presence of iron oxide or other mineral inclusions.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-08

The image presents a close-up view of a rock, showcasing its unique characteristics. The rock's surface is predominantly dark gray, with a speckled pattern of white and brown hues. Its rough edges suggest that it may be a fragment of a larger rock or mineral deposit.

The rock's texture appears to be coarse and uneven, with visible ridges and crevices on its surface. The speckles of white and brown add a sense of depth and complexity to the rock's appearance, giving it a visually interesting and dynamic quality.

The background of the image is a plain white surface, which helps to highlight the rock's features and create a sense of contrast between the rock and its surroundings. Overall, the image provides a detailed and informative view of the rock, allowing the viewer to appreciate its unique characteristics and textures.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-08

The image depicts a rock with a rough, irregular shape and a predominantly gray color. The rock's surface is characterized by a mix of dark gray, light gray, and brown hues, with visible speckles and patches throughout. The rock appears to be a type of granite or similar igneous rock, given its texture and coloration.

The rock is positioned centrally in the image, with its front face facing the viewer. The background of the image is a plain white surface, which helps to highlight the rock's features and colors. Overall, the image presents a clear and detailed view of the rock, allowing for a close examination of its texture, color, and composition.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image shows a rock with a rough surface, with a few cracks and uneven edges. The rock appears to be a mixture of different colors, including black, white, and gray. The black and white colors are spread throughout the rock, while the gray color is concentrated in the middle. The rock is placed on a white surface, which could be a table or a floor.

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image shows a close-up view of a rock specimen, likely a type of granite, placed on a white surface. The rock has a rough, uneven texture with visible grains and a speckled pattern of different colors, including shades of gray, white, and brown. The surface of the rock appears to have some small cracks and fractures, indicating its natural formation and geological history. The image provides a detailed and focused view of the rock's texture and appearance.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

Here is a description of the image:

The image shows a rectangular rock with rough, uneven surfaces. It is multi-colored, with a mix of dark gray, brown, and white. The top surface has a speckled appearance with small white fragments embedded in a darker matrix. The bottom portion of the rock appears to have a more coarse texture with varying shades of brown and gray. The rock is placed on a white background, which gives a clean and bright contrast to the rough texture and varied colors of the rock.

Created by gemini-2.0-flash-lite on 2025-05-07

Here's a description of the image:

The image features a piece of rock placed on a plain white background. The rock itself has a rough, irregular shape and a variety of colors, including shades of gray, black, brown, and white. The texture of the rock appears granular and textured, indicating a possibly metamorphic or igneous origin. The lighting is even, and the rock is centered in the frame, making it the clear subject of the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image shows a piece of rock with a rough, uneven surface. The rock appears to be composed of different minerals, as indicated by its varied colors and textures. The top surface of the rock has a combination of darker and lighter patches, with some areas appearing almost white or cream-colored, possibly indicating the presence of quartz or feldspar. The lower part of the rock has a darker, more reddish-brown hue, which could suggest the presence of iron oxides or other minerals. The edges of the rock are jagged and irregular, indicating it might have been broken or weathered naturally. Overall, the rock seems to be a type of igneous or metamorphic rock, given its mixed mineral composition and texture.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image shows a piece of rock with a rough, uneven surface. The rock has a predominantly dark gray color with specks of lighter gray and white, indicating a possible mineral or sedimentary composition. The top surface appears to have some white and possibly mineral-like patches. The rock has a jagged edge and a mix of textures, suggesting it may be a type of igneous or metamorphic rock, possibly with some weathering or alteration. The background is plain white, which makes the rock the central focus of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

The image shows a rectangular, irregularly shaped piece of rock or mineral specimen placed on a plain white surface. The rock has a rough texture and is primarily dark in color, with a mix of black, brown, and white streaks and patches. The top surface of the rock is relatively flat, while the sides and bottom show more jagged edges and uneven contours. The specimen appears to be a cut and polished slice, possibly from a geological or mineralogical collection, showcasing the internal structure and composition of the rock. The lighting is even, highlighting the details and colors of the rock.