Human Generated Data

Title

Korean Sherd

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of David K. and Rita S. Jordt, 1995.1169.612

Human Generated Data

Title

Korean Sherd

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of David K. and Rita S. Jordt, 1995.1169.612

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Food 99.3
Crystal 87.1
Accessories 80.6
Accessory 80.6
Jewelry 80.6
Rock 79.2
Gemstone 79.2
Mineral 76.7
Ornament 62
Arrowhead 60.9
Pottery 55.3

Clarifai
created on 2019-07-07

no person 99.2
rock 97.8
one 97.4
rough 97.3
stone 97.1
food 96.7
geology 95.6
desktop 95.4
disjunct 95.3
texture 95.3
abstract 93
art 92.9
hard 91.6
nature 90
cutout 89.8
closeup 87.4
shape 86.8
square 86.1
heavy 84.2
quartz 84.2

Imagga
created on 2019-07-07

food 51.8
chocolate 40.8
brown 40.5
bread 38.9
brick 30.9
building material 28.3
slice 26.4
loaf 26.3
wheat 25.7
tasty 24.3
healthy 22.7
closeup 21.6
delicious 21.5
baked 20.6
meal 20.3
bakery 20.1
piece 19
close 18.3
snack 18
breakfast 17.7
fresh 17.7
pastry 16.7
rye 16.6
crust 16.5
stone 16.4
diet 16.2
nutrition 16
grain 15.7
cut 15.3
nobody 14.8
eating 14.3
organic 14.3
dessert 14.2
dark 14.2
tile 14
object 13.9
sweet 13.5
natural 13.4
toast 12.7
sugar 12.6
detail 12.1
eat 11.8
cobble 11.7
cereal 11.6
sliced 11.6
homemade 11.6
single 11.5
objects 11.3
studio 10.7
whole 10.5
cake 10.4
seed 10.3
horizontal 10.1
bake 9.6
black 9.6
paving stone 9.4
carbohydrates 8.9
flour 8.8
sandwich 8.7
life 8.6
board 8.4
crusty 7.9
baker 7.8
paper 7.8
color 7.8
portion 7.8
gourmet 7.6
traditional 7.5
dry 7.4
stack 7.4
still 7.4
container 7.1
ingredient 7

Google
created on 2019-07-07

Rock 94.9
Igneous rock 83.1
Mineral 79.8
Geology 76.4
Artifact 72.7
Limestone 63.1

Microsoft
created on 2019-07-07

food 81
piece 79.3
slice 75.3
bread 36.3

Color Analysis

Feature analysis

Amazon

Bread

Clarifai

Food

AWS Rekognition

Bread 99.3%

Clarifai

Food 66.2%

Categories

Imagga
created on 2019-07-07

food drinks 67.6%
nature landscape 28.4%
paintings art 1.2%
interior objects 1.1%
pets animals 1%

Captions

Microsoft
created by unknown on 2019-07-07

a piece of bread 89.1%
a piece of cake 75%
a slice of cake sitting on top of a piece of bread 41.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a rock with a rock face on it

Created by general-english-image-caption-blip-2 on 2025-07-03

a piece of green stone with a brown spot

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This is an image of a flat, angular stone or rock fragment. The rock has a pale grayish-green color, with a rough texture and speckles of brown and rust-like patches scattered across its surface. Its irregular shape resembles a shard or a piece of a larger stone that has fractured. The background is clean and white, emphasizing the outline and details of the rock.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a single shard of quartzite set against a plain white background. The quartzite piece is roughly trapezoidal in shape, with an uneven and jagged edge on the upper side. It has a grainy texture, with a color that appears to be a mix of gray, light brown, and faint hints of green or blue. The surface of the shard displays speckled patterns, which is characteristic of quartzite rock. The shard is oriented in such a way that it stands upright on a flat side, slightly leaning at an angle.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a rock or stone fragment. It appears to be a natural, irregular-shaped piece of rock with a grayish-green color and some textured, mottled patterns on its surface. The rock has an asymmetrical, angular shape and seems to be a naturally occurring geological specimen rather than a manufactured or processed object.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The image shows a rough, irregularly shaped stone against a white background. The stone appears to be a dull grayish-green color with reddish-brown flecks or inclusions throughout. Its surface is uneven and pitted, suggesting it is a natural, unpolished rock fragment. Based on its color and texture, it could potentially be a piece of unrefined ore or mineral. The stone is positioned at an angle, revealing its asymmetrical, chunky shape.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This image shows what appears to be a fragment or shard of grayish-green stone or ceramic material. The piece has an irregular, angular shape with clean edges, suggesting it may be a broken piece of a larger object. The surface texture appears somewhat rough and granular, with small speckles or inclusions visible throughout. The material has a matte finish and appears to be photographed against a white background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-08

The image depicts a small, irregularly shaped rock with a rough texture. The rock is positioned at an angle, with its left side closer to the viewer than its right side. It has a flat bottom and a pointed top, with a jagged edge along its right side. The rock's surface is a mottled gray color with flecks of brown and white throughout. The background of the image is solid white, suggesting that it may be a product photo or a stock image. Overall, the image presents a simple yet striking visual representation of a natural object.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-08

The image depicts a rough, irregularly shaped rock or stone against a white background. The rock is positioned in the center of the image, with its longest side facing the viewer. It has a flat bottom and a pointed top, resembling a triangle with the top cut off. The rock's surface features a mottled gray color with flecks of brown and white throughout.

The rock casts a slight shadow on the white background, indicating that it is being illuminated from above. The overall atmosphere of the image suggests that the rock is being displayed for observation or study, possibly in a scientific or educational context.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image depicts a small, irregularly shaped piece of rock. The rock appears to be a type of shale, characterized by its fine-grained texture and layered structure. The surface of the rock has a greenish-gray color with subtle variations in hue, possibly due to the presence of minerals like clay or iron oxide. The edges of the rock are uneven, suggesting it has been broken or weathered over time. The rock is placed on a plain white background, which helps to highlight its natural colors and textures.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image shows a piece of stone with a rough surface, possibly a fragment of a larger rock. The stone has a greenish-gray color with some white spots and brown stains. It is likely a piece of a rock that has been broken or chipped off, and it is placed on a white surface, which could be a table or a piece of paper. The stone appears to be natural and unpolished, with a rough texture and irregular edges.

Google Gemini

Created by gemini-2.0-flash on 2025-05-14

Here is a description of the image:

The image shows a fragment of a rock, likely a sedimentary rock. The rock is primarily a muted green-gray color with small, speckled grains throughout its surface. The surface appears somewhat textured or slightly uneven, and there are subtle lighter and darker bands or striations running across it. The edges of the rock are rough and uneven, suggesting it was broken or fractured. There's a small portion of the rock at the top that has a brownish-red hue. The rock is resting on a plain white background, which helps to highlight its color and texture.

Created by gemini-2.0-flash-lite on 2025-05-14

Here's a description of the image:

The image shows a single piece of rock, likely a shard or fragment, against a plain white background. The rock is a muted grey-green color and has a slightly irregular, angular shape, suggesting it's been broken off of a larger piece. Its surface is covered in tiny specks of different shades. Some areas of the rock show a layered texture. The light source appears to be diffused, casting soft shadows and highlighting the texture of the rock.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a fragment of what appears to be a piece of pottery or ceramic. The shard is roughly pentagonal in shape and has a somewhat uneven, broken edge. The surface of the fragment is textured with a rough, grainy appearance, and it features a mottled coloration, predominantly grayish-green with speckles of brown and white. The fragment appears to be relatively thick, suggesting it might have been part of a larger, sturdier piece of pottery. The overall look of the shard suggests it could be an artifact or a piece of ancient or historical ceramic ware.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-29

The image shows a single, irregularly shaped rock or stone piece. The rock has a grayish-green color with a relatively smooth surface and a few small, scattered brown spots, which could indicate mineral inclusions or weathering. The shape is somewhat angular, with sharp edges and a mix of flat and curved surfaces. The background is plain white, which contrasts with the rock and highlights its details.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-29

The image shows a piece of rock or stone with a roughly triangular or pentagonal shape. The stone appears to be a thin, flat slab with a smooth surface. Its color is primarily gray with some brownish and reddish speckles scattered throughout. The edges of the stone are irregular, suggesting it may have been broken or naturally weathered. The background is plain white, which helps to highlight the stone's texture and color. The stone is resting on a flat surface, and its shadow is visible beneath it.