Human Generated Data

Title

Book of Caricatures (Tobae-cho)

Date

-

People

-

Classification

Books

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Ernest G. Stillman, Class of 1907, 1978.477.72.3

Human Generated Data

Title

Book of Caricatures (Tobae-cho)

Classification

Books

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Ernest G. Stillman, Class of 1907, 1978.477.72.3

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Text 99.2
Diary 98.5
Human 91.7
Drawing 91.5
Art 91.5
Sketch 85.6
Page 66.7
Animal 65
Doodle 56.7

Clarifai
created on 2023-10-25

paper 98.8
page 97.9
chalk out 97.6
art 97.3
old 97.2
retro 96.6
ancient 96.1
illustration 94.8
vintage 94.3
manuscript 94.2
parchment 93.5
document 93.5
antique 93.3
text 91.9
desktop 91.6
book bindings 91.1
people 91.1
sepia pigment 90.8
wear 89.7
writing 89.6

Imagga
created on 2022-01-08

envelope 100
container 75.3
grunge 50.3
notebook 49.6
paper 49.5
vintage 47.2
old 46.7
antique 37.3
retro 34.5
texture 32.7
aged 32.6
blank 30
book 29.4
ancient 27.7
art 26.7
page 26
empty 25.8
dirty 24.4
design 24.2
brown 23.6
border 22.6
wallpaper 21.5
parchment 21.1
frame 20.8
floral 20.4
document 20.4
pattern 19.9
decorative 18.4
text 17.5
grungy 17.1
canvas 17.1
manuscript 16.7
artistic 16.5
card 16.5
open 16.2
flower 16.2
material 16.1
letter 15.6
stained 15.4
worn 15.3
history 15.2
diary 14.7
damaged 14.3
age 14.3
note 13.8
shabby 13.7
drawing 13.7
pages 13.7
rough 12.8
memory 12.6
stain 12.5
old fashioned 12.4
creative 12.4
textured 12.3
sheet 12.2
ornament 12.1
style 11.9
sepia 11.7
historic 11
paint 10.9
yellow 10.6
surface 10.6
color 10.6
cardboard 10.6
write 10.4
graphic 10.2
backdrop 9.9
century 9.8
stains 9.7
burnt 9.7
leaf 9.4
space 9.3
map 9.1
gold 9.1
detail 8.9
stationery 8.8
scrapbook 8.7
decoration 8.7
decay 8.7
aging 8.6
obsolete 8.6
wall 8.6
journal 8.4
dark 8.4
greeting 8.4
cover 8.3
artwork 8.3
message 8.2
backgrounds 8.1
decor 8
tattered 7.9
crumpled 7.8
torn 7.8
mail 7.7
scroll 7.6
ornate 7.3
collection 7.2
world 7.1
atlas 7.1
travel 7.1

Google
created on 2022-01-08

Book 87
Organism 86.4
Art 86.1
Font 83.2
Painting 80.3
Tree 77.9
Art book 74.9
Illustration 73.8
Ink 73.4
Publication 72.7
Drawing 72.1
Line art 71.7
Paper 71.1
Visual arts 69.7
Fiction 68.1
Pattern 67.3
Paper product 65.4
Event 65.3
Modern art 62
Artwork 62

Microsoft
created on 2022-01-08

drawing 99.9
sketch 99.7
text 99.6
child art 98.2
cartoon 94.9
handwriting 93.2
illustration 91.2
art 90.7
ink 73

Color Analysis

Feature analysis

Amazon

Bird
Person

Clarifai

Clothing
Book
Human face
Person
Animal
Footwear

AWS Rekognition

Bird 65%

AWS Rekognition

Bird 62.8%

AWS Rekognition

Person 54.1%

Clarifai

Clothing 82.4%

Clarifai

Clothing 60.5%

Clarifai

Clothing 47.2%

Clarifai

Clothing 33.4%

Clarifai

Book 75.7%

Clarifai

Human face 74.2%

Clarifai

Human face 72.9%

Clarifai

Human face 70.6%

Clarifai

Human face 60.5%

Clarifai

Human face 52%

Clarifai

Person 67.7%

Clarifai

Person 40.3%

Clarifai

Animal 56.2%

Clarifai

Footwear 42.1%

Clarifai

Footwear 34.5%

Clarifai

Footwear 33.5%

Categories

Imagga
created on 2022-01-08

paintings art 100%

Captions

Microsoft
created by unknown on 2022-01-08

a close up of a book 52.4%
close up of a book 46.1%
a book on a wood surface 46%

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

illustration from the book by novelist.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a book with a drawing of a dog and a man

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This image depicts a hand-drawn illustration split across an open book. On the left page, two figures dressed in traditional Japanese attire appear to be in action poses, possibly engaged in combat or fleeing, accompanied by two dogs in motion. Their clothing is detailed with geometric patterns, suggesting a theatrical or dramatic context. On the right page, two women in elaborate traditional garments are featured, one holding a sword and the other leaning forward, also suggesting dynamic movement. A dragon-like figure is visible near what appears to be a rocky or cliff-like setting on the right. Text written in pencil appears at the top of the right page, hinting at commentary or context related to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is an illustration from a book or document, depicting two pages of a scene filled with dynamic action. On the left page, there is a group of figures engaged in animated movement. One figure is carrying a round shield and wearing traditional attire with a short skirt, indicating a possible warrior or samurai interpretation. Another character appears to be running or leaping beside a pair of dogs, adding a sense of urgency and chaos. On the right page, a different scene is shown, featuring two elegantly dressed figures. One is crouching or bowing, and there is a sword present, suggesting a dramatic or theatrical moment. There's a faint, handwritten note at the top right corner that reads, "played very often in theatre," indicating that the scenes might be depicting a theatrical performance, perhaps in the style of a Kabuki or traditional Japanese play. The paper has several small stains and the binding style suggests it's part of a bound book.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a spread from an old sketchbook or journal. It contains several hand-drawn illustrations in a whimsical, stylized style. The left page depicts a chaotic scene with various figures, some human and some fantastical creatures, engaged in dynamic poses and interactions. The right page shows a more serene scene with a woman reclining in a chair or chaise lounge, surrounded by decorative elements. The drawings have an expressive, almost caricature-like quality to them.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The image shows two pages from a sketchbook or notebook with rough pencil sketches depicting various fantastical or whimsical scenes. On the left page, there are sketches of people or creatures riding on the backs of animals, possibly pigs or boars. The figures have exaggerated, cartoonish features. On the right page, the sketches show more surreal scenes, including a figure lounging in a chair while unusual creatures or shapes surround them. The sketches have a playful, imaginative quality and seem to capture fleeting ideas or visual experiments rather than polished, finished drawings. The handwritten notes at the top of the right page are difficult to decipher but may provide insight into the artist's creative process or intentions behind the sketches.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical Japanese ink drawing or sketch showing a dynamic scene of figures in traditional clothing engaged in some kind of animated action or conflict. The drawing style is loose and expressive, characteristic of Japanese manga or woodblock print aesthetics. The figures are shown in various animated poses, with flowing robes and dramatic movements. There also appear to be some animal figures (possibly dogs) included in the scene. The drawing is done on what looks like aged paper with some handwritten notes at the top of the page. The overall composition has a sense of movement and energy typical of Japanese action scenes from historical artwork.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image presents a sketchbook with two open pages, showcasing sketches of people and animals in various poses. The sketches are rendered in black ink on a beige background, with some areas featuring faint blue or red marks.

  • The left page features a group of people dressed in traditional Japanese attire, holding swords and shields. They appear to be engaged in a battle scene, with one individual lying on the ground.
  • The right page depicts a woman in a flowing dress, accompanied by a dog. The woman is shown in a dynamic pose, with her arms outstretched and her body leaning forward. The dog is positioned beside her, facing the same direction.
  • In the top-right corner of the right page, there is a handwritten note in cursive script. Although the text is difficult to decipher, it appears to be a title or description of the artwork.

Overall, the image suggests that the sketchbook contains a collection of sketches or illustrations created by an artist, possibly depicting scenes from Japanese folklore or mythology. The use of traditional Japanese attire and the inclusion of a dog in one of the sketches may indicate that the artwork is inspired by Japanese culture.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is an open book with two pages featuring sketches of Japanese characters. The left page has three characters, one of whom is riding a horse and holding a sword. The right page has two characters, one of whom is falling backwards while holding a sword. The sketches are drawn in black ink and appear to be from a traditional Japanese style. The background of the pages is off-white, with some faint blue and red markings visible. The overall atmosphere of the image suggests a sense of action and movement, as if the characters are engaged in a dynamic scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image shows an open book with two pages of drawings on it. The drawings are in black and white, and there are some handwritten notes on the pages. The drawing on the left page depicts three people in traditional Japanese clothing, with one of them holding a stick and a dog. The drawing on the right page shows two people, one of whom is holding a sword. The drawings appear to be from a sketchbook or a notebook.

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image shows an open book with two pages. The pages have black and white illustrations of people and animals, possibly from a comic or manga book. The left page features a group of people, including a person riding a dog, while the right page depicts a person falling off a horse. The pages have handwritten text in a foreign language, possibly Japanese, and the book's spine is visible on the left side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here is a description of the image:

The image is a double-page spread from a notebook, likely a sketchbook or diary, with hand-drawn illustrations. The pages are off-white or cream-colored, with visible staple marks along the spine. The style of the drawings is simple, with lines in black ink.

On the left page, there are several figures depicted in a dynamic action. The figures seem to be people dressed in traditional garb, some with swords, engaged in a fight or performance. Two dog-like animals are in the scene, one with spots.

On the right page, the scene shifts to a more dramatic setting. A serpentine creature, possibly a dragon, and a few figures that look like women are in the middle of some type of activity. One of the women has a sword in hand. The handwriting at the top of the page indicates that this is a theatre performance.

Overall, the images suggest a narrative or a series of scenes from an event. The artistic style and the handwriting suggest an amateur or personal recording of a theatre experience. The style of illustration evokes a traditional Japanese aesthetic.

Created by gemini-2.0-flash on 2025-05-16

The image shows a sketchbook opened to a two-page spread, with ink sketches on each page. The paper is aged and off-white, with visible binding stitches down the center.

On the left page, there are drawings of figures resembling traditional Japanese warriors with swords, wearing patterned clothing and headbands. There are also sketched outlines of two dogs, one with a spotted pattern.

On the right page, there's a sketched dragon-like creature climbing what appears to be a waterfall or cliff. Adjacent to this, there are two figures engaged in what seems to be a dance or fight with a sword, one with their leg raised and both wearing traditional garments.

At the top right corner of the right page, there's handwriting in ink, which reads "played very often in theatre we saw one again shotomigh." The sketches are in black ink, with varying line weights suggesting different levels of detail and shading. The overall style is simple and evocative, with a focus on capturing form and movement.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image shows an open sketchbook with two pages featuring traditional Japanese-style ink drawings. The drawings depict scenes that appear to be from Japanese theater or folklore.

On the left page:

  • There are three figures dressed in traditional Japanese attire. The figure on the left is holding a sword and seems to be in a dynamic pose, possibly in the middle of an action sequence. The middle figure is also holding a sword and appears to be engaged in a conversation or confrontation with the figure on the left. The third figure, on the right, is a mythical creature resembling a dog or fox with a human-like posture, which is common in Japanese folklore.

On the right page:

  • There is a dramatic scene with three figures. The figure on the left is kneeling and appears to be in distress or prayer. The central figure is lying on the ground, seemingly unconscious or defeated. The figure on the right is standing and appears to be in a state of shock or grief, with one hand raised to their face. In the background, there is a depiction of a dragon-like creature, adding a fantastical element to the scene.

There is also some handwritten text at the top of the right page, which reads: "Japanese plays often in theatre we saw many at Shimonoseki." This suggests that the drawings might be inspired by live theater performances the artist saw in Shimonoseki, Japan.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image shows an open book with two pages featuring hand-drawn illustrations. The left page depicts an animated scene with three figures dressed in traditional attire, possibly from a theatrical or martial arts context. One figure appears to be performing a martial move, another is holding a weapon, and the third is interacting with a large dog. The right page illustrates a dramatic scene with multiple figures, including one person lying on the ground and another figure with long hair who seems to be in motion, possibly performing a dance or a martial move. The illustrations are detailed and stylized, with an emphasis on movement and action. The pages are aged, with some writing and marks visible, suggesting the book may be a personal journal, sketchbook, or a collection of notes.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This image appears to be an open sketchbook or notebook with drawings on the pages. The left page shows a sketched scene with two figures dressed in traditional Japanese attire, possibly samurai, holding swords. There is a dog in the foreground, seemingly startled or reacting to the figures. The right page depicts another sketched scene with two figures, one lying down and the other standing over them, also in traditional Japanese clothing. The standing figure seems to be holding a sword. There is some handwriting at the top of the right page, which is partially legible and appears to be in cursive. The overall style of the drawings is sketchy and expressive, with minimal details and shading. The pages show signs of age, with some discoloration and spots.

Text analysis

Amazon

played
in
theatre
played sawareging in theatre
tomigh
shin tomigh
shin
sawareging

Google

ped feyofen theetre we saw vs
ped
feyofen
theetre
we
saw
vs