Human Generated Data

Title

Fragment

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University, Gift of Miss E. Bayliss Received 11-17-1913, 1977.216.3257

Human Generated Data

Title

Fragment

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University, Gift of Miss E. Bayliss Received 11-17-1913, 1977.216.3257

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Mineral 88.8
Accessories 81.9
Accessory 81.9
Crystal 80.5
Gemstone 69.5
Jewelry 69.5
Food 63.6
Ornament 62.2

Clarifai
created on 2023-10-25

gem 98.8
art 98.1
quartz 97.3
rock 96.6
color 96.6
stone 96.5
painting 96.3
illustration 96.2
no person 96.1
desktop 95.8
jewelry 94.5
abstract 93.4
texture 93
cutout 92.8
precious 92.6
pattern 90.9
map 90.5
geology 89.2
disjunct 88.8
treasure 87.3

Imagga
created on 2022-01-14

container 65.7
bag 63
purse 55.7
wallet 30.8
paper 25.1
case 24.3
fabric 20.8
money 17
pillow 17
box 16.7
object 14.7
gift 14.6
card 13.6
color 13.4
slide fastener 13.1
blank 12.9
celebration 12.8
cushion 12.6
old 12.5
brown 12.5
decoration 12.3
birthday 12
shopping 11.9
present 11.8
currency 11.7
pattern 11.6
vintage 11.6
design 11.3
book 11.1
cash 11
business 10.9
fastener 10.8
pencil box 10.5
page 10.2
cotton 10
new 9.7
finance 9.3
document 9.3
yellow 9.3
pink 9.2
note 9.2
close 9.1
texture 9
padding 9
notes 8.6
empty 8.6
accessory 8.6
nobody 8.6
floral 8.5
orange 8.4
decorative 8.4
restraint 8.1
success 8
decor 8
paisley 7.9
blanket 7.9
black 7.8
towel 7.8
cards 7.8
party 7.7
bath towel 7.6
greeting 7.4
closeup 7.4
symbol 7.4
gold 7.4
single 7.4
festive 7.4
retro 7.4
piece of cloth 7.3
food 7.3
soft 7.2
colorful 7.2

Google
created on 2022-01-14

Shirt 93.8
Sleeve 87.2
Rectangle 79.3
Collar 77
Umbrella 73
Font 69.6
Pattern 68.1
Fashion accessory 67.5
Triangle 67.4
Creative arts 66.5
Linens 63.6
Circle 62.3
Cap 60.1
Rock 58.6
Paper product 57.7
Art 56.3
Pattern 55.1
Visual arts 51.9
Natural material 50.3

Microsoft
created on 2022-01-14

piece 85.1
art 65.6
rock 57.5
drawing 51.2
eaten 21.2
frittata 19.5

Color Analysis

Feature analysis

Amazon

Rug
Bread

Clarifai

No features identified

AWS Rekognition

Rug 79.1%

AWS Rekognition

Bread 63.6%

Categories

Imagga
created on 2022-01-14

food drinks 95.7%
paintings art 4.1%

Captions

Microsoft
created by unknown on 2022-01-14

a piece of food 81.5%
a piece of pizza 70.7%
a piece of broccoli 70.6%

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

a close up of the rock.

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a piece of artisanned rock artisanned in a triangle shape

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image shows a piece of fossilized material, most likely bone, with a weathered or mineralized surface. The surface appears iridescent with a range of vibrant colors, including shades of green, blue, purple, and hints of gold, likely caused by mineralization over time. The fragment has an irregular shape with a rough texture, and part of it displays a beige or brown fossilized appearance. Red markings, possibly identifying numbers or cataloging information (e.g., "257"), are painted on one portion of the material. The object is displayed on a plain white background.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows a fragment of a rock or mineral with an iridescent surface. The rock has a rough, angular shape and appears mostly brown with areas that have a shimmering, multicolored appearance, displaying hues of green, purple, blue, and pink. This iridescent effect is often seen in minerals like bornite or peacock ore. There is an area on the rock bearing some painted or marked numbers in red, which appear to be "257." The background is a plain white, highlighting the rock's texture and colors.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a rock or mineral specimen with an interesting and colorful appearance. The rock has a rough, irregular shape and is covered in various shades of green, blue, and reddish-orange hues. The colors appear to be a result of mineral deposits or oxidation on the surface of the rock. The overall appearance suggests this is a natural, unprocessed geological specimen with an intricate and visually striking pattern.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This image shows a piece of opal, which appears to be a rough or natural specimen. The stone displays the characteristic play of colors (iridescence) that opals are famous for, with vibrant flashes of green, blue, and purple across its surface. The specimen has a triangular shape and includes some matrix material (host rock) which appears as beige or tan colored areas. The opal portion shows a beautiful iridescent effect known as "opalescence" where the colors shift and change depending on the viewing angle. There are also some reddish markings visible on one edge of the specimen. The surface appears somewhat rough and natural rather than polished, suggesting this may be a raw or unprocessed piece of opal.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image shows a triangular piece of rock or mineral with a rough, weathered surface. The rock is primarily brown and tan, but it also has patches of green, blue, and purple, which may be due to the presence of minerals such as malachite or azurite.

The rock has a rough, porous texture, with visible cracks and crevices. It appears to have been weathered over time, with some areas showing signs of erosion or wear.

On the right side of the rock, there is a red symbol or mark that looks like a squiggle or a series of connected loops. The symbol is not clearly defined, but it may be a natural formation or a human-made mark.

The background of the image is a plain white surface, which suggests that the rock was photographed in a laboratory or studio setting. Overall, the image provides a detailed view of the rock's texture, color, and composition, as well as any interesting features or markings that it may have.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a small, triangular piece of rock or stone with a rough texture and a mix of colors. The rock is positioned at an angle, with its base facing the bottom-right corner of the image. It has a mottled appearance, featuring shades of green, blue, purple, and brown. A red handwritten number "3257" is visible on the right side of the rock.

The background of the image is a plain white surface, which suggests that the photo was taken in a studio or laboratory setting. The overall atmosphere of the image is one of simplicity and minimalism, with the focus solely on the rock itself.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image shows a piece of rock with a unique and colorful appearance. The rock has a rough and uneven surface, and it is covered with a thin layer of green and blue minerals. The minerals are arranged in a pattern that resembles a map or a landscape. The rock has a number "357" written on it in red paint, which suggests that it may have been collected or studied by someone.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image features a large, irregularly shaped rock with a rough surface. The rock has a unique and striking appearance, characterized by its vibrant and varied colors. The colors are predominantly shades of green, purple, and brown, with patches of other hues interspersed throughout. The surface of the rock is uneven and textured, with some areas appearing more worn or eroded than others. The rock is positioned on a plain, white background, which highlights its natural beauty and intricate patterns.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

The image shows a triangular fragment of ancient glass. The glass has a shimmering, iridescent quality, displaying a range of colors including green, blue, purple, and gold. This effect is likely due to the weathering and decomposition of the glass surface over time.

The edges of the fragment are rough and broken, suggesting that it was once part of a larger object. Along one side, there's a section of tan or light brown material that appears to be either some sort of adhesive or a piece of the original vessel to which the glass was attached.

In red paint, the number "2357" is visible on one of the edges of the fragment. This is likely a catalog or identification number added by archaeologists or museum curators.

The fragment is set against a plain white background, which helps to highlight its colors and textures. The lighting is even and diffused, allowing for a clear view of the glass's surface.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

The image shows a fragment of an ancient artifact, likely ceramic or glass. The fragment is roughly triangular in shape, with irregular, broken edges.

  • Color and Texture: The surface of the fragment displays a stunning iridescence, with a vibrant play of colors like green, blue, purple, and hints of gold, a result of the material's degradation over time. Patches of darker green and brown are scattered throughout the surface. The reverse side of the fragment appears to be a beige or tan, and is much rougher.
  • Markings: The number "3357" is boldly painted in red on the beige side.
  • Overall Impression: The fragment appears aged and fragile, likely unearthed during archaeological exploration. The iridescence suggests it's made of a material that has undergone significant chemical alteration. The entire image is taken against a neutral white background, highlighting the object.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a fragment of a mineral or rock specimen. The fragment has an irregular, roughly triangular shape with a somewhat rough and uneven surface. The surface displays a variety of colors, including shades of green, brown, blue, and purple, which suggests the presence of different minerals or oxidation states. There is also a section marked with red paint or ink, showing the number "3057." This marking is likely used for identification or cataloging purposes in a collection or laboratory setting. The overall appearance indicates that this could be a sample used for geological or mineralogical study.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image shows a geological specimen, likely a mineral or crystal, with a rough, irregular shape and a fragmented appearance. The surface of the specimen displays a vibrant, iridescent pattern with colors ranging from green to purple, and there are areas with a more muted, earthy brownish hue. The iridescence suggests that the specimen may be a type of mineral with specific optical properties, such as a sulfide or a copper-containing mineral.

On the right side of the specimen, there is a reddish number "3057" written in a somewhat cursive style, which could indicate a catalog or identification number used for specimen documentation. The background is plain white, which helps to highlight the specimen's colors and textures.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

The image shows a fragment of a ceramic shard with a vibrant, iridescent glaze. The glaze displays a range of colors, including green, purple, pink, and blue, creating a shimmering effect. The surface of the shard is uneven and shows signs of wear and age, with some areas where the glaze has chipped off, revealing the underlying material. The shard has a rough, triangular shape with sharp edges. On the right side of the shard, there is a red inscription that reads "3357." The background of the image is plain white, which helps to highlight the colors and details of the ceramic fragment. The overall appearance suggests that this could be an archaeological artifact, possibly from a historical pottery piece.

Text analysis

Amazon

LSTE

Google

57
57