Human Generated Data

Title

Fragment of talc

Date

-

People

-

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. William L. Payson, 1986.609.209

Human Generated Data

Title

Fragment of talc

Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. William L. Payson, 1986.609.209

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Rock 99.4
Pebble 85.2
Rubble 60.4
Jewelry 56.4
Accessory 56.4
Accessories 56.4
Gemstone 56.4

Clarifai
created on 2019-07-07

food 97.2
desktop 97.2
no person 94.7
batch 93.8
closeup 89.9
pile 89
many 88.7
texture 87.9
color 87.4
wood 86.7
nutrition 84.1
disjunct 82.4
refreshment 81.9
diet 81.9
chocolate 81.8
shape 81.4
group 81.2
healthy 81.1
isolated 80.6
epicure 79.6

Imagga
created on 2019-07-07

chocolate 45.2
food 43
brown 32.4
closeup 21.6
candy 20.1
close 20
money 19.6
coins 18.4
currency 18
beans 17.4
confectionery 16.7
heap 16
coffee 15.9
coin 15.3
finance 15.2
ingredient 15.1
breakfast 14.4
spice 14
roasted 13.4
sugar 13
group 12.9
snack 12.8
seed 12.8
nut 12.6
drink 12.5
bean 12.2
black 12
healthy 12
cash 11.9
dessert 11.5
sweet 11.1
dark 10.9
financial 10.7
health 10.4
therapy 10.4
gourmet 10.2
banking 10.1
tasty 10.1
collection 9.9
wealth 9.9
bank 9.9
nuts 9.7
powder 9.7
caffeine 9.7
dried 9.7
aromatic 9.6
pattern 9.6
golden 9.5
refreshment 9.4
stack 9.3
organic 9.3
investment 9.2
business 9.1
gold 9.1
detail 8.9
treat 8.6
fruit 8.4
hot 8.4
taste 8.4
many 8.3
delicious 8.3
full 8.2
meal 8.2
metal 8.1
espresso 8
shell 7.8
objects 7.8
nobody 7.8
change 7.7
savings 7.5
beverage 7.4
natural 7.4
object 7.3
backgrounds 7.3
vegetarian 7.2
medicine 7.1

Google
created on 2019-07-07

Rock 85.5
Beige 54.8

Microsoft
created on 2019-07-07

dessert 94.9
chocolate 94.2
plate 89.6
food 88
indoor 87.4
baked goods 86.4
snack 78.5
cookie 77.3
tray 66.4
baking 53.9
displayed 41.5
decorated 37.9
arranged 23.5

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

Food

Clarifai

Food 86.7%

Clarifai

Food 82.9%

Clarifai

Food 80.6%

Clarifai

Food 79%

Clarifai

Food 77.8%

Clarifai

Food 74.6%

Clarifai

Food 74.4%

Clarifai

Food 73.8%

Clarifai

Food 73.8%

Clarifai

Food 73.7%

Clarifai

Food 73.1%

Clarifai

Food 71%

Clarifai

Food 70.2%

Clarifai

Food 68.9%

Clarifai

Food 68.7%

Clarifai

Food 68.7%

Clarifai

Food 68.3%

Clarifai

Food 67.9%

Clarifai

Food 67.4%

Clarifai

Food 66.9%

Clarifai

Food 66.6%

Clarifai

Food 65.2%

Clarifai

Food 64.6%

Clarifai

Food 64.2%

Clarifai

Food 64%

Clarifai

Food 61.8%

Clarifai

Food 61.5%

Clarifai

Food 61.3%

Clarifai

Food 60.9%

Clarifai

Food 59.2%

Clarifai

Food 57%

Clarifai

Food 56.2%

Clarifai

Food 56.2%

Clarifai

Food 56%

Clarifai

Food 55.9%

Clarifai

Food 55.5%

Clarifai

Food 55.5%

Clarifai

Food 55.3%

Clarifai

Food 54.8%

Clarifai

Food 54%

Clarifai

Food 53.7%

Clarifai

Food 53.3%

Clarifai

Food 52.9%

Clarifai

Food 52.6%

Clarifai

Food 52.2%

Clarifai

Food 51%

Clarifai

Food 50.4%

Clarifai

Food 50.2%

Clarifai

Food 50.2%

Clarifai

Food 49.6%

Clarifai

Food 49.5%

Clarifai

Food 49%

Clarifai

Food 48.9%

Clarifai

Food 48.5%

Clarifai

Food 48.4%

Clarifai

Food 48.1%

Clarifai

Food 47.8%

Clarifai

Food 47.6%

Clarifai

Food 47.3%

Clarifai

Food 47.3%

Clarifai

Food 45.4%

Clarifai

Food 43.9%

Clarifai

Food 42.3%

Clarifai

Food 41.6%

Clarifai

Food 36.5%

Categories

Imagga
created on 2019-07-07

paintings art 96%
food drinks 2.3%
interior objects 1.4%

Captions

Microsoft
created by unknown on 2019-07-07

a close up of a plate covered with chocolate 64.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a bunch of rocks and stones on a white surface

Created by general-english-image-caption-blip-2 on 2025-06-28

a collection of rocks and stones arranged in a circle

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows a collection of various small rocks arranged on a white surface. The rocks vary in size, color, shape, and texture. They include smooth pebbles, rough fragments, and distinctive stones with natural patterns. The colors range from earthy tones such as beige, gray, brown, and red, to lighter shades like white. The arrangement appears random yet spaced out, allowing each rock to be seen clearly against the plain background.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a collection of various small rocks and stones arranged neatly on a plain, white surface. The stones display a variety of shapes, sizes, and colors, ranging from light to dark shades. Some stones are smooth and rounded, while others are rough and angular. The color palette includes shades of brown, gray, red, and beige, showcasing the diverse appearance of natural stones. The arrangement is somewhat orderly, with stones placed in rows, creating a visually intriguing display of geological diversity.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows a collection of various rocks and stones of different shapes, sizes, and colors. The stones range from small pebbles to larger, more irregular-shaped rocks. The colors of the stones vary, including shades of brown, gray, red, and tan. Some of the stones appear smooth and rounded, while others have a more jagged, angular appearance. The stones are arranged in a scattered pattern on a plain white background, creating an interesting visual display of natural geological formations.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This image shows a collection of various rocks and stones arranged on a white background. The rocks appear to be natural specimens and vary in size, color, and texture. They range from small pebbles to medium-sized stones, displaying different hues including pink, brown, gray, and beige. Some appear to be smooth and rounded, likely from water erosion, while others are more angular and rough. The stones are arranged in a somewhat organized manner, spread out to display each individual specimen. This could be part of a geological collection or study, as the presentation appears to be intentional and documentary in nature.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-08

The image presents a visually striking arrangement of approximately 50 small rocks or pebbles, showcasing a diverse range of shapes, sizes, and colors. The rocks are predominantly brown, beige, gray, and white, with some featuring subtle hints of red or pink. They vary in size, from small pebbles to larger stones, and are scattered across the image in a seemingly random pattern.

The background of the image is a clean white surface, which provides a striking contrast to the earthy tones of the rocks. The overall effect is one of simplicity and elegance, with the rocks taking center stage against the neutral backdrop. The image appears to be a product photo, likely intended to showcase the natural beauty and diversity of the rocks.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-08

The image features a collection of rocks and pebbles arranged in a circular pattern, with the largest rocks at the center and smaller ones towards the edges. The rocks vary in size, shape, color, and texture, with some being smooth and others rough. The colors range from light beige to dark brown, with some rocks having a reddish or pinkish hue.

The background of the image is white, which helps to highlight the details of the rocks. The overall effect is one of a carefully curated display of natural objects, possibly for educational or decorative purposes.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A collection of stones is arranged in a grid-like pattern on a white surface. The stones are of different sizes, shapes, and colors. Some of the stones are gray, while others are reddish-brown, pink, and white. The stones are scattered in a way that seems to be intentional, and they are arranged in a way that resembles a grid. The stones are probably collected from different places and are used for various purposes.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image features a collection of rocks of various sizes, shapes, and colors. The rocks are arranged in a circular pattern on a white surface. The rocks vary in size, with some being larger than others, and they are scattered around the circular pattern. Some of the rocks are smooth, while others have rough surfaces. The colors of the rocks range from gray to brown, with some having a reddish-brown hue.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-14

The image showcases a collection of various rocks scattered on a white surface. The rocks differ in size, shape, and color. Some are small and smooth, others are larger and more angular. The color palette is earthy, including shades of gray, brown, beige, pink, and red. The arrangement of the rocks appears random, creating a natural and organic feel. The neutral background highlights the diversity of the stones, which are the main focus of the photograph.

Created by gemini-2.0-flash on 2025-05-14

The image displays a collection of rocks and stones scattered on a plain white surface. The rocks vary in size, color, and shape, ranging from small pebbles to larger, more irregularly shaped stones. The colors are predominantly earthy tones, including shades of brown, gray, tan, and reddish hues. Some stones appear to be smooth and rounded, while others have rougher textures and more angular shapes. The overall arrangement of the rocks is somewhat random and unorganized, suggesting a natural gathering or collection of these geological specimens. The lighting is bright and even, highlighting the details and textures of the rocks against the clean white backdrop.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image displays a collection of rocks and pebbles of varying sizes, shapes, and colors arranged on a plain white background. The rocks range from small, smooth pebbles to larger, rougher stones. The colors of the rocks include shades of brown, gray, white, red, and beige. Some of the rocks have distinct patterns or textures, while others appear more uniform. The arrangement of the rocks is somewhat random, with no apparent order or pattern, and they are spread out across the entire surface of the image. The overall impression is one of natural diversity and variety in rock formations.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-12

The image shows a collection of various stones and pebbles arranged on a plain white background. The stones vary in size, shape, and color. Some are smooth and rounded, while others are jagged and angular. The colors range from light beige and brown to darker shades of gray, black, and reddish-brown. The stones are scattered across the frame, with no particular order or pattern, and their diversity in texture and color suggests they may have been collected from different sources.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-12

This image shows a collection of various rocks and stones arranged on a white background. The rocks come in different shapes, sizes, and colors. Some are smooth and rounded, while others are rough and jagged. The colors range from shades of brown, gray, and beige to red, pink, and black. The rocks appear to be of different mineral compositions, suggesting a diverse geological origin.