Human Generated Data

Title

Sherd

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.277

Human Generated Data

Title

Sherd

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.277

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Bread 99.5
Food 99.5
Mineral 99.4
Crystal 98.5
Accessory 94.9
Jewelry 94.9
Gemstone 94.9
Accessories 94.9
Quartz 82
Rock 72.5

Clarifai
created on 2019-07-08

alternative 99.6
gem 99.5
marijuana 99.4
desktop 99.4
quartz 99.1
disjunct 99.1
medicine 98.9
geology 98.8
nature 98.6
illegal 98.5
stone 98.5
crystal 98.5
isolate 98.3
dope 98
precious 97.7
closeup 97.4
cannabis 97
joint 97
rock 97
ore 96.7

Imagga
created on 2019-07-08

tea 45.4
food 29.5
sugar 27.2
brown 25
close 22.3
bread 20.3
slice 19.1
healthy 18.3
chocolate 17.9
delicious 17.3
candy 17.1
meal 17
container 16.9
mineral 15.5
bakery 15.3
dessert 15.2
ring 14.9
closeup 14.8
bag 14.6
loaf 14.6
piece 14.4
breakfast 14.1
natural 14.1
sweet 13.4
tasty 13.4
eating 12.6
eat 12.6
nobody 12.4
snack 12
stone 11.9
organic 11.8
object 11.7
wheat 11.4
diet 11.3
baked 11.2
gourmet 11
nutrition 10.9
purse 10.7
crust 10.6
fresh 10.5
black 10.2
toast 10.1
cut 9.9
rye 9.8
detail 9.7
color 9.5
cake 9.4
gem 8.8
objects 8.7
cereal 8.7
seed 8.4
traditional 8.3
tourmaline 7.9
pastry 7.9
baking 7.8
homemade 7.7
rubber eraser 7.7
texture 7.6
health 7.6
nutritious 7.6
dark 7.5
freshness 7.5
grain 7.4
backgrounds 7.3
rough 7.3
tile 7.2

Google
created on 2019-07-08

Mineral 96.7
Rock 95.6
Geology 84.5
Igneous rock 73.3
Turquoise 72
Fashion accessory 61.6
Quartz 60.5
Gemstone 56
Metal 51.1

Microsoft
created on 2019-07-08

cake 97.6
piece 96.8
mineral 92.7
chocolate 90.2
slice 89.6
stone tool 78.8
igneous rock 78
granite 67.2
stone 67
rock 65.3
dessert 41.4
half 41.3
eaten 38.3

Color Analysis

Feature analysis

Amazon

Bread
Bread 99.5%

Categories

Captions

Microsoft
created by unknown on 2019-07-08

a piece of cake covered in chocolate 66.6%
a piece of chocolate cake 63.7%
a piece of cake 63.6%

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a piece of rock with a green and blue crystal -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image shows a rock or mineral specimen. The main feature is a dark, crystalline patch that appears reflective, displaying an iridescent mix of deep green, blue, and subtle gold hues. The shiny display suggests it's a mineral like azurite or malachite embedded in a beige, rough base rock. The specimen rests on a plain, white background, emphasizing its natural texture and coloration.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows a rock specimen featuring a mineral with a striking, iridescent surface. The mineral appears to have a dark, bluish-green color and displays some reflective qualities, giving it a shimmering appearance. It is embedded on a light brown, earthy matrix that seems to serve as a backing for the mineral. The mineral surface exhibits crystalline textures with small, sparkling facets. The rock specimen is placed on a plain white background.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows a rock or mineral specimen with a rough, irregular surface. The specimen has a greenish-blue color with some darker spots and patterns. It appears to be a piece of malachite, a copper carbonate mineral that is known for its distinctive green color and banded or crystalline appearance. The specimen is sitting on a white background, allowing the colors and textures of the mineral to be clearly visible.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-13

The image shows a rough, unpolished stone or mineral specimen against a plain white background. The stone has an irregular, jagged shape and appears to be a blue-green color with flecks or inclusions of darker material throughout. The surface texture looks coarse and granular. The stone seems to be a raw, natural sample rather than a cut or faceted gemstone.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This image shows a mineral specimen or rock sample featuring vibrant blue-green crystalline formations embedded in or growing on a lighter colored, beige or tan host rock. The blue-green portion appears to have a druzy or crystalline texture, suggesting it could be a copper-based mineral like chrysocolla, or possibly turquoise. The specimen is photographed against a white background, and the contrast between the vivid mineral formation and the more muted host rock creates an interesting visual effect. The sample appears to be a natural, unpolished piece, showing the raw beauty of the mineral's natural formation.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image presents a close-up view of a mineral specimen, showcasing its unique characteristics.

  • Mineral Specimen:
    • The mineral specimen is the central focus of the image.
    • It appears to be a type of ore or rock, with a rough, irregular shape.
    • The specimen is primarily composed of a light-colored base material, possibly a type of sedimentary rock.
    • A dark-colored substance is embedded within the base material, which could be a mineral deposit or an impurity.
    • The dark substance exhibits a metallic luster, suggesting that it may be a metal or a metal alloy.
    • The surface of the specimen is rough and uneven, with visible cracks and fissures.
    • The edges of the specimen are jagged and irregular, indicating that it has undergone some degree of weathering or erosion.
  • Background:
    • The background of the image is a plain white surface.
    • The surface is likely a table or countertop, given its smooth and flat appearance.
    • There are no other objects or features visible in the background, allowing the mineral specimen to be the sole focus of the image.

In summary, the image provides a detailed view of a mineral specimen, highlighting its unique composition and structure. The specimen's rough, irregular shape and dark-colored substance suggest that it may be a type of ore or rock with significant mineral deposits. The plain white background helps to emphasize the specimen's features, making it easier to examine and analyze.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image depicts a rock with a dark, iridescent surface. The rock is positioned centrally in the frame, with its base facing downwards and its top angled towards the viewer. The rock's surface features a predominantly dark coloration, punctuated by flecks of lighter hues that give it an iridescent appearance. The rock's shape is irregular, with jagged edges and a rough texture.

In the background, a plain white surface provides a clean and neutral backdrop for the rock. The overall effect is one of simplicity and elegance, with the rock's unique features taking center stage.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-25

The image features a rock with a rough surface and an irregular shape, possibly a piece of a larger rock. The rock has a greenish-blue color with black spots scattered throughout. The rock is placed on a white surface, possibly a table, and is illuminated by a bright light, possibly from a camera flash. The rock's surface appears to be slightly shiny, and the black spots are likely minerals or impurities.

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image features a rock specimen against a plain white background. The rock is irregular in shape and appears to be a fragment of a larger mineral or geological formation. It is predominantly composed of a dark green mineral matrix, which is likely to be chlorite or a similar mineral. The surface of the rock has a slightly rough texture, with visible grainy particles embedded within the matrix. There are also areas where the mineral appears to be more concentrated, giving the rock a speckled appearance. The edges of the rock are uneven, suggesting it has been broken or cut from a larger piece.

Google Gemini

Created by gemini-2.0-flash on 2025-05-15

The image shows a small, roughly triangular rock fragment resting on a plain white surface. The rock is composed of two distinct layers. The lower layer is a light tan color and appears to be a more typical rock or soil material. The upper layer is a darker, iridescent material with shades of green, blue, and possibly some gold or bronze. This iridescent layer seems to be a coating or inclusion within the rock. The overall impression is that it is a mineral specimen or a piece of weathered material with an interesting deposit or coating.

Created by gemini-2.0-flash-lite on 2025-05-15

Here's a description of the image:

Overall Impression:

The image shows a piece of what appears to be an archaeological find or a natural specimen, possibly a fragment of glass or glazed material embedded in a piece of earth or rock. It is placed on a white surface.

Specific Details:

  • Object: The main object is a piece with a dark, possibly bluish-green, color covering a portion of its surface. The surface has textures suggesting it has been broken. Surrounding this surface, the object has a light brown color.
  • Texture: The object's surface appears rough and fragmented, potentially due to age or weathering. The dark portion has a mottled appearance.
  • Color: The dark part of the object features a variety of colors including blue, green and touches of yellow, contrasting with the earth-toned base.
  • Background: The background is plain white.
  • Lighting: The lighting seems even and bright, highlighting the textures of the object.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-26

The image depicts a rock sample with a distinctive mineral composition. The rock has a rough, uneven surface and appears to be a fragment of a larger piece. The primary color of the rock is a dark greenish-blue, with numerous small, sparkling inclusions that give it a glittery appearance. These inclusions are likely minerals, possibly some form of copper-based mineral given the color and sheen. The rock also has lighter-colored areas, possibly due to different mineral compositions or weathering. The rock is set against a plain white background, which highlights its colors and textures. This type of rock could be indicative of an ore sample, often found in mining contexts.