Human Generated Data

Title

Untitled (bleed-through of previous page and note, left page); Untitled (children's drawing, right page)

Date

1981

People

Artist: Otto Piene, German 1928 - 2014

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.22.88

Copyright

© Otto Piene Estate

Human Generated Data

Title

Untitled (bleed-through of previous page and note, left page); Untitled (children's drawing, right page)

People

Artist: Otto Piene, German 1928 - 2014

Date

1981

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.22.88

Copyright

© Otto Piene Estate

Machine Generated Data

Tags

Amazon
created on 2022-08-17

Art 96.4
Modern Art 93
Drawing 90.8
Human 90.8
Text 83.7
Graphics 77.4
Paper 73.6
Doodle 59.6
Sketch 58.9
Canvas 55.6

Clarifai
created on 2023-10-12

art 98.9
artistic 98.3
paper 98
painting 97
illustration 96.7
dirty 96.6
retro 94.7
design 94.5
vintage 94.3
bill 93.6
desktop 93.4
messy 93.3
creativity 93.2
old 92.5
chalk out 91.7
brush 90.2
graffiti 89.8
wear 87.8
color 87.1
picture frame 86.4

Imagga
created on 2022-08-17

envelope 100
container 100
grunge 29
design 26.5
art 23
card 21.4
floral 21.3
retro 19.7
decorative 19.2
drawing 17.4
decoration 17
flower 16.9
wallpaper 16.9
graphic 16.8
paper 16.6
pattern 16.4
texture 16
vintage 15.7
frame 15.3
silhouette 14.9
dirty 12.7
leaf 12.5
greeting 12.1
template 11.9
old 11.9
paint 11.8
border 11.8
creative 11.5
colorful 11.5
plant 11.2
style 11.1
holiday 10.8
map 10.6
clip art 10.2
birthday 10.2
color 10
valentine 10
painting 9.9
element 9.9
cartoon 9.8
scrapbook 9.7
summer 9.7
invitation 9.6
celebration 9.6
ornament 9.5
symbol 9.4
banner 9.2
backdrop 9.1
collection 9
artistic 8.7
spring 8.6
blank 8.6
space 8.5
pillow 8.4
wedding 8.3
fun 8.2
decor 8
text 7.9
gift 7.8
set 7.6
hand 7.6
grungy 7.6
outline 7.6
pink 7.5
happy 7.5
rose 7.5
man 7.4
foliage 7.4
swirl 7.4
note 7.4
blossom 7.3
artwork 7.3
ornate 7.3
business 7.3
icon 7.1
season 7
modern 7
cushion 7

Google
created on 2022-08-17

Paint 87.2
Rectangle 83.4
Art 82.7
Creative arts 80.6
Font 79.4
Art book 74.9
Painting 73.9
Book 72.1
Magenta 72
Pattern 70.9
Stationery 70.2
Visual arts 69.2
Ink 67.1
Paper 67
Paper product 66
Illustration 65.4
Drawing 64.8
Child art 64.4
Notebook 59.3
Graphics 59

Microsoft
created on 2022-08-17

drawing 99.4
child art 99.3
text 97.3
sketch 94.1
cartoon 92.8
illustration 92.5
painting 79.8
art 73.9
gallery 57.7
design 56.9

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Book
Person
Flower
Hat
Clothing
Human face
Human arm

AWS Rekognition

Person 72.3%

Clarifai

Book 72.7%

Clarifai

Person 69.6%

Clarifai

Person 64.3%

Clarifai

Flower 59.6%

Clarifai

Hat 45.1%

Clarifai

Clothing 42.4%

Clarifai

Human face 38.5%

Clarifai

Human arm 36.7%

Categories

Imagga
created on 2022-08-17

paintings art 99.6%

Captions

Microsoft
created by unknown on 2022-08-17

a close up of a womans face in a room 32.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-30

a book with drawings and writing on it

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a book opened to show a drawing of a woman

OpenAI GPT

Created by gpt-4 on 2024-12-15

This image shows a spread from a journal or an artist's sketchbook. On the left page, there are faint, abstract color imprints that look like they might be the result of ink or paint splatters and smudges, forming no distinct shape. There are some numbers and letters in the upper-left corner of this page, but it's not clear what they signify.

On the right page, there is a much more vibrant scene with illustrations and texts. Two primary figures dominate this page, both with anthropomorphic characteristics and exaggerated limbs but with different color schemes. The figure on the left is pink with a purplish outline, stylized with a large blue hat, musical notes, and an expressive pose, as if it's singing or performing. This figure stands on a colorful platform resembling a ripple of water.

The figure on the right is a darker hue of green with a black hat sporting a red band. The pose is lively, with arms raised and extended fingers, exuding an energetic vibe. Both figures are surrounded by text - seemingly expressive or poetic, although the specific content is not entirely discernible from the image.

The bottom portion of the page features wavy lines suggesting water, completing the artistic seascape scene. Small details, like an additional figure or object near the bottom right corner next to the green figure, add to the whimsical nature of the artwork. There is also a small illustration of a person in yellow towards the bottom, possibly observing the scene. The entire page is filled with creativity, perhaps illustrating a narrative or exploring thematic elements personal to the artist.

Created by gpt-4o-2024-05-13 on 2024-12-15

The image shows an open sketchbook with artwork on both the left and right pages. The left page appears to be a faint, abstract splash of colors including red, yellow, and purple, likely a bleed-through from the opposite page or an unfinished watercolor painting.

The right page features a vivid cartoon-like drawing with colorful illustrations. It depicts two anthropomorphic tree characters. The character on the left is pink with dark blue hair, wearing some accessories, and appears to be dancing or striking a lively pose. Musical notes and a speech bubble with text (unreadable in detail) are around this character. The character on the right is green, resembling a tree with arms extended, wearing a black hat with a red band. Another speech bubble with text is next to this character. Below these main characters, there are additional illustrations, including a smaller human-like figure pointing at a spider web and a speech bubble with text. Along the bottom of this page, there are wavy, colorful lines possibly representing water or a decorative border.

Handwritten text is present interspersed throughout the drawing, but the details are not clear enough to transcribe accurately.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-15

The image shows an open sketchbook or journal with vibrant and whimsical illustrations and handwritten notes. The left page features an abstract, colorful splash pattern, while the right page contains various drawings and doodles. These include a dancing figure in a pink costume, a tall green shape resembling a tree or plant, and some additional smaller sketches and textual elements. The overall impression is of a creative, expressive, and personal visual exploration.

Created by claude-3-5-sonnet-20241022 on 2024-12-15

This appears to be an open notebook or sketchbook with colorful artwork. The left page has some faint, abstract color splashes in pastels and watercolors. The right page features two distinctive figures drawn in bold colors. One figure is in bright pink/magenta with a blue top portion, appearing to be dancing or in motion. The second figure is drawn in green with what appears to be a black hat or hair with a red band. There are some musical notes drawn near the pink figure, and some handwritten text scattered around the drawings. At the bottom of the page, there's a decorative border made of wavy lines in blue, pink, and green colors. The overall style appears playful and whimsical.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This appears to be an open notebook or sketchbook with artistic drawings. The right page features two whimsical figures - one in bright pink with a blue top, and another in green wearing what appears to be a black hat with a decorative band. The figures have an animated, playful quality to them. There are some musical notes drawn near the pink figure, and some handwritten text scattered around the drawings. At the bottom of the page, there's a decorative border made of wavy lines in blue, pink, and green colors. The left page appears to have some faint color marks or stains in various pastel shades.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-15

The image presents a vibrant and imaginative sketchbook spread, showcasing two open pages filled with colorful drawings and handwritten notes.

Page 1:

  • The left page is predominantly blank, featuring a few scattered marks in various colors, including pink, blue, yellow, orange, and purple.
  • A small, illegible signature is visible in the top-right corner.
  • A faint, circular design is discernible in the center of the page, although its details are unclear.

Page 2:

  • The right page is dominated by two large, abstract figures:
    • A green figure with a black hat and red band, accompanied by a small, blue and red fish.
    • A pink figure with a blue hat, standing on a blue and pink island.
  • Both figures have long arms and legs, with the green figure pointing upwards and the pink figure gesturing downwards.
  • The background of the page is white, with scattered notes and scribbles in black ink.
  • A small, illegible message is written in the top-right corner.

Overall:

  • The sketchbook spread exudes a sense of creativity and playfulness, with its bright colors and whimsical drawings.
  • The abstract figures and handwritten notes suggest a personal and expressive artistic process.
  • The image invites the viewer to explore the imagination and creativity of the artist, who has poured their thoughts and feelings onto these pages.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-15

This image depicts an open, worn sketchbook with vibrant illustrations on the right-hand page. The left-hand page features a white background with scattered paint splatters in various colors, including pink, orange, yellow, blue, and purple. In the top-right corner, handwritten notes are visible, although they are illegible.

The right-hand page showcases three distinct illustrations. At the top, a pink figure with a blue hat and a blue, curly hairstyle is depicted. This figure is adorned with a necklace and appears to be dancing or posing. Below this figure, a smaller pink creature is shown emerging from the water, accompanied by illegible handwritten notes. On the right side of the page, a green figure with a large black hat and a red band is illustrated. This figure has its arms outstretched and appears to be dancing or posing as well.

At the bottom of the page, a colorful design resembling waves is visible. The overall atmosphere of the image suggests that it may be a page from a child's sketchbook, showcasing their creativity and imagination through art.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-26

The image shows an open book with a colorful and creative page layout. On the left side of the page, there is a vibrant and abstract painting with a mix of bright colors like red, orange, yellow, and green. The painting has a playful and spontaneous feel, with splashes of paint and a lack of defined shapes. On the right side of the page, there is a drawing of a woman with a blue hat, wearing a pink dress, and a green tree with a red ribbon around its neck. The drawing is accompanied by some handwritten text, possibly a caption or a note. The book has a black cover and a white background, creating a contrast with the colorful content inside.

Created by amazon.nova-pro-v1:0 on 2025-02-26

The image is of an open book with drawings on the pages. The book is open to two pages. On the left page, there is a drawing of a pinkish-red figure with a blue hat. On the right page, there is a drawing of a green figure with a red hat. The drawings are surrounded by various scribbles, doodles, and text. The book is placed on a gray surface.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

The image is a spread from a sketchbook or diary. The left page has a collection of colorful scribbles and blotches, likely created with crayons or markers. There are some blue and green marks, as well as some writing and the name "Chloe" written above a date "xii - '81".

The right page features two cartoon-like figures drawn in bold colors: a pink figure with a blue hair-like structure and a green, tree-like figure with a black hat. Both figures have text bubbles and are interacting. The pink figure has musical notes above it and is standing on a water element, and is wearing a skirt. The green figure is holding something, and text bubbles describe the interaction. A wave-like pattern is drawn across the bottom of the right page, and two small figures can be seen in a dance. The image feels playful, expressive, and likely created by someone with an imaginative style.

Created by gemini-2.0-flash on 2025-05-01

Here's a description of the image:

The image shows an open sketchbook. The left page is covered in colorful smudges and what appear to be ink or paint blots in a variety of colors. In the upper right corner, there is handwriting with the word "Chloe", followed by "DDF," and "XII - '81".

The right page contains a more elaborate drawing. There are two figures: one is a pink humanoid with a large blue cloud-like hairdo, and the other is a tall, green humanoid that resembles a tree. Both figures have their arms raised. Speech bubbles next to each figure contain handwritten text. The pink figure says, "Hi big boy, what's your name we would have fun here in lovers lane...." and the green figure exclaims, "But I'm HANK!".

There are musical notes drawn next to the pink figure, as well as additional smaller drawings and handwritten phrases. At the bottom of the page, there is a drawn line of colorful waves in shades of blue, pink, and teal.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image shows an open sketchbook with two pages of colorful and imaginative artwork.

On the left page, there is a vibrant, abstract design that appears to be a blend of colors and shapes, with some areas looking like paint splatters or smudges. The colors include shades of pink, orange, yellow, green, and blue, creating a dynamic and lively effect.

On the right page, there is a more detailed illustration featuring two anthropomorphic tree-like figures. The figure on the left is pink with blue hair and appears to be holding something in its hand, while the figure on the right is green with black hair and is gesturing with its hands. There are also smaller figures and objects around them, including what looks like a small person, a spider web, and some musical notes. The illustration is accompanied by handwritten text, which seems to be a dialogue or narrative related to the scene. The text includes phrases like "Hi! I'm Bob," "I'm a tree," and "But I'm thirsty," suggesting a whimsical or humorous interaction between the characters.

The overall style of the artwork is playful and creative, with a mix of abstract and figurative elements.

Qwen

No captions written

Text analysis

Amazon

and
Those
the
fun
lovers
here
name
have
2
I
its
are
will
three,
HANKI
invatation, its the
could have fun
you
DDF
lovers maybe three,
dance,
in
boy
we
est
invatation,
could
maybe
land
h
lovers are
Just you dance,
here in lovers lane....
But I m
sai
takeyour
est vaa-cation,two
Dyes I takeyour
will romance
Just
8/
MUS
whatsJyoor Hi pig boy
lane....
vaa-cation,two
whatsJyoor
Dyes
MARRED
XT
romance
Hi pig
i c we
meeel
@wear

Google

ci DDF. XI-181 '87 hene inlevers lave shall Gwe saileus, Fust you the-nd me-e. invatation, it's the romance to the music we oyes I take your best vaa-cation, two @We shall sail and lovers maybe three, Those lovers are will Just you an eeeeee! Hi big boy what's your name we could have fun in lovers lanc..... here you and меле But Im. HANKI ESIT MALLFED MAKI
ci
DDF
.
XI
-
181
'87
hene
inlevers
lave
shall
Gwe
saileus
,
Fust
you
the
nd
me
e
invatation
it's
romance
to
music
we
oyes
I
take
your
best
vaa
cation
two
@We
sail
and
lovers
maybe
three
Those
are
will
Just
an
eeeeee
!
Hi
big
boy
what's
name
could
have
fun
in
lanc
.....
here
меле
But
Im
HANKI
ESIT
MALLFED
MAKI