Human Generated Data

Title

A Pictorial Dictionary of American Words (Amerika kotoba osanu etoki)

Date

Late Edo period, seventh month of 1860

People

Artist: Utagawa Yoshitoyo, Japanese 1830 - 1866

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.65

Human Generated Data

Title

A Pictorial Dictionary of American Words (Amerika kotoba osanu etoki)

People

Artist: Utagawa Yoshitoyo, Japanese 1830 - 1866

Date

Late Edo period, seventh month of 1860

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.65

Machine Generated Data

Tags

Amazon
created on 2019-06-17

Text 99.7
Human 98.1
Advertisement 93.2
Page 78.4
Leisure Activities 57.1

Clarifai
created on 2019-06-17

illustration 99.7
people 99.6
print 99.5
art 98.9
adult 98.7
lithograph 97.8
vintage 97.8
painting 97.5
group 97.4
man 97.1
woman 96.7
manuscript 96.4
text 95.7
woodcut 95.4
retro 94.2
old 93.9
wear 93.8
bill 92.4
son 92.2
collection 90.8

Imagga
created on 2019-06-17

envelope 100
container 75.2
old 34.2
vintage 33.9
retro 30.3
paper 29.8
money 23.8
antique 22.5
currency 22.4
comic book 22
cash 20.1
menu 19.4
letter 18.4
grunge 17.9
stamp 16.5
aged 16.3
mail 16.3
card 16.2
finance 16.1
dollar 15.8
bank 15.2
fare 14.6
financial 14.3
ancient 13.9
states 13.5
exchange 13.4
business 13.4
design 12.9
banking 12.9
note 12.9
postmark 12.8
texture 12.5
notes 12.5
map 12.2
postage 11.8
page 11.1
message 11
circa 10.9
close 10.9
printed 10.8
dollars 10.6
bill 10.5
savings 10.3
book jacket 10
wallpaper 10
philately 9.9
postal 9.8
art 9.8
bills 9.7
sepia 9.7
pound 9.7
geography 9.6
payment 9.6
capital 9.5
blank 9.4
rich 9.3
economy 9.3
collection 9
wealth 9
shows 8.9
print media 8.8
banknotes 8.8
symbol 8.8
text 8.7
pay 8.6
city 8.3
new 8.1
market 8
world 8
food 7.9
drawing 7.9
jacket 7.8
travel 7.8
frame 7.7
post 7.6
product 7.6
silhouette 7.5
investment 7.3
global 7.3
dirty 7.2
book 7.2

Google
created on 2019-06-17

Text 88.1
Miniature 50.6

Microsoft
created on 2019-06-17

text 99.6
person 94.4
cartoon 93.3
clothing 91.5
illustration 86.1
drawing 74.3
handwriting 66.9
manuscript 62.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 45-63
Gender Female, 55%
Happy 47%
Sad 52.8%
Angry 45.1%
Confused 45%
Surprised 45.1%
Disgusted 45%
Calm 45%

AWS Rekognition

Age 35-52
Gender Male, 52.2%
Disgusted 45%
Calm 46.2%
Happy 45.1%
Sad 52.8%
Surprised 45.2%
Confused 45.4%
Angry 45.2%

AWS Rekognition

Age 15-25
Gender Male, 54.5%
Surprised 45.4%
Sad 46.2%
Disgusted 50.4%
Confused 45.3%
Happy 45.3%
Angry 46%
Calm 46.5%

AWS Rekognition

Age 30-47
Gender Male, 53.8%
Angry 46.2%
Surprised 45.2%
Disgusted 48%
Confused 45.2%
Calm 46.3%
Happy 45%
Sad 49%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.6%
Calm 49.6%
Disgusted 49.6%
Sad 49.7%
Happy 49.7%
Confused 49.5%
Angry 49.8%

AWS Rekognition

Age 10-15
Gender Male, 53.5%
Confused 45.2%
Surprised 45.4%
Disgusted 45.1%
Happy 45.1%
Sad 45.6%
Angry 45.3%
Calm 53.2%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Happy 49.6%
Confused 49.5%
Sad 50.4%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Happy 49.7%
Confused 49.6%
Calm 49.8%
Disgusted 49.5%
Surprised 49.6%
Sad 49.7%
Angry 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Calm 50%
Happy 49.6%
Disgusted 49.6%
Surprised 49.5%
Angry 49.8%
Sad 49.5%
Confused 49.5%

Feature analysis

Amazon

Person
Poster

Clarifai

Clothing
Person
Human face
Poster
Footwear
Human arm

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 90.5%

AWS Rekognition

Person 90.1%

AWS Rekognition

Person 90%

AWS Rekognition

Person 87.1%

AWS Rekognition

Person 78.2%

AWS Rekognition

Person 75.3%

AWS Rekognition

Person 74.5%

AWS Rekognition

Person 74.1%

AWS Rekognition

Poster 93.2%

Clarifai

Clothing 88.1%

Clarifai

Clothing 82%

Clarifai

Clothing 78.9%

Clarifai

Clothing 74.8%

Clarifai

Clothing 70.3%

Clarifai

Clothing 68.9%

Clarifai

Clothing 61.9%

Clarifai

Clothing 57.5%

Clarifai

Person 73.1%

Clarifai

Person 70.9%

Clarifai

Person 65.9%

Clarifai

Person 61.3%

Clarifai

Person 55.8%

Clarifai

Person 54.3%

Clarifai

Person 52.7%

Clarifai

Person 40%

Clarifai

Human face 59.5%

Clarifai

Human face 59.2%

Clarifai

Human face 55.2%

Clarifai

Human face 51%

Clarifai

Human face 49.6%

Clarifai

Human face 49.1%

Clarifai

Human face 44.6%

Clarifai

Human face 42.2%

Clarifai

Human face 41.5%

Clarifai

Human face 41%

Clarifai

Human face 40.1%

Clarifai

Human face 36.1%

Clarifai

Poster 59.3%

Clarifai

Footwear 57.3%

Clarifai

Footwear 56.7%

Clarifai

Footwear 54.2%

Clarifai

Footwear 53.7%

Clarifai

Footwear 51.2%

Clarifai

Footwear 48.7%

Clarifai

Footwear 45.4%

Clarifai

Footwear 41.2%

Clarifai

Human arm 37.2%

Categories

Imagga
created on 2019-06-17

paintings art 63.5%
text visuals 34.6%
events parties 1.5%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

a group of children in traditional dress.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a chinese painting of a man and a woman

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-26

This image is a vintage Japanese illustration that appears to be educational, possibly from a textbook or instructional poster. It contains a list of text written in Japanese characters, accompanied by numerous small, colorful drawings of people engaged in various activities. The scenes include individuals dressed in traditional clothing, interacting with animals, performing tasks, and playing. There is a large header at the top with more detailed Japanese writing, and across the image, the illustrations help to visually describe the text presented. The style of the art is reminiscent of traditional Japanese woodblock prints.

Created by gpt-4 on 2025-01-26

This image is a traditional Japanese woodblock print, which is characterized by its vibrant colors and fine detail. The print appears to be from the Edo period, judging by the attire of the figures and artistic style.

The scene depicts a variety of characters engaged in different activities. On the lower right, a person stands on a small boat, while a kneeling individual nearby appears to be washing something in a basin. Two animals, which could possibly be a seal and a baboon, are also present, adding an element of curiosity to the scene.

On the left side of the image, there's a procession of individuals, each performing different actions, such as carrying a pole or interacting with each other. The clothing of these figures suggests a range of social statuses, from commoners to those of higher rank.

In the background, structures that resemble traditional Japanese architecture can be seen, alongside nature depicted by the presence of a tree on the far right.

The top portion of the image features Japanese text, likely providing context or a story related to the scene depicted. The text is arranged in vertical columns, a common format in traditional Japanese writing. The combination of text and imagery is common in ukiyo-e, a genre of Japanese woodblock prints that often portrays scenes from history, everyday life, and folklore.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This is a traditional Japanese woodblock print (ukiyo-e) with multiple scenes arranged vertically on a yellowish background. The print includes Japanese text at the top and middle sections, with illustrations below each text block. The scenes depict various figures in traditional Japanese clothing engaging in different activities. There are several vignettes showing people interacting with animals, including what appears to be a dog or wolf-like creature. The figures are dressed in various styles of kimono and other period clothing, with some wearing plaid patterns and others in solid colors like red, blue, and green. In the bottom section, there's a scene with a boat or small vessel. The artwork has a characteristic Edo period style with bold outlines and flat color areas. The composition includes both action scenes and more static poses, creating an interesting narrative flow throughout the piece.

Created by claude-3-5-sonnet-20241022 on 2025-01-26

This is a traditional Japanese woodblock print (ukiyo-e) featuring multiple vignettes or scenes arranged on a yellowed background. The image includes Japanese text at the top and middle sections, written in traditional characters. The artwork shows several small scenes of daily life in historical Japan, with figures dressed in traditional clothing like kimono and other period garments. There are some interesting elements including what appears to be a white dog or wolf-like animal, and someone in a boat in the lower right corner. The figures are depicted in a characteristic ukiyo-e style with simple but expressive lines and poses. The color palette includes blues, reds, greens, and blacks against the aged paper background. The overall composition appears to be telling a story or depicting various aspects of life during the Edo period in Japan.

Created by claude-3-opus-20240229 on 2025-01-26

This image appears to be an old Japanese woodblock print or ukiyo-e. It depicts various people and activities with accompanying Japanese text above and below the main illustration.

The scene shows multiple groupings of people in traditional Japanese clothing engaged in what seem to be leisurely or entertaining pursuits. Some are sitting and conversing, while others appear to be playing music or games. A few animals like dogs and a bird are also included.

The artistic style is characteristic of ukiyo-e prints from the Edo period with its flat colors, bold outlines, and slightly caricatured figures. The aged, yellowed paper adds to the vintage feel.

While I cannot read the Japanese text, based on the lighthearted slice-of-life subject matter, detailed snapshot of customs, and the title at the top, this print was likely meant to capture and promote a famous leisure spot, festival, or cultural practice popular during the time it was made. It provides an intriguing window into everyday life and pastimes in historic Japan.

Created by claude-3-haiku-20240307 on 2025-01-26

This image appears to be an illustrated Japanese text. The top part contains Japanese text, which appears to be a title or caption. The rest of the image depicts various scenes with people engaged in different activities. There are illustrations of people in traditional Japanese dress, as well as animals and other elements. However, as the instructions stated, I will not identify or name any specific individuals shown in the image.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-26

The image is a Japanese woodblock print featuring a series of illustrations and text. The print is divided into two sections, with the top section containing Japanese text in black ink and the bottom section featuring a series of colorful illustrations.

Top Section:

  • The top section of the print features a blue banner with white Japanese characters.
  • Below the banner, there are several lines of Japanese text written in black ink.
  • The text appears to be a poem or story, but the exact meaning is unclear without translation.

Bottom Section:

  • The bottom section of the print features a series of colorful illustrations depicting various scenes.
  • The illustrations are arranged in a horizontal row and appear to be related to each other.
  • The scenes depicted include people engaging in various activities, such as playing musical instruments, dancing, and interacting with animals.
  • The illustrations are rendered in a traditional Japanese style, with bold lines and vibrant colors.

Overall:

  • The print appears to be a traditional Japanese woodblock print, likely created during the Edo period (1603-1868).
  • The combination of text and illustrations suggests that the print may have been used for educational or entertainment purposes.
  • The exact meaning and context of the print are unclear without further research or translation.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-26

The image is a Japanese woodblock print from the 19th century, featuring a collection of scenes depicting various aspects of Japanese life. The print is divided into three sections, each with its own unique illustrations and text.

  • Top Section:
    • The top section of the print features a blue banner with white Japanese characters at the top.
    • Below the banner are six illustrations of people engaging in different activities, such as playing games, cooking, and interacting with animals.
    • The text below the illustrations appears to be a poem or song lyrics, written in Japanese calligraphy.
  • Middle Section:
    • The middle section of the print features five more illustrations of people and animals, including a man playing a musical instrument, a woman carrying a basket, and a dog and a cat.
    • The text below the illustrations is similar to the text in the top section, but it is not as clear or legible.
  • Bottom Section:
    • The bottom section of the print features four illustrations of people and animals, including a man and woman embracing, a man holding a box, and a dog and a cat.
    • The text below the illustrations appears to be a poem or song lyrics, similar to the text in the top and middle sections.

Overall, the image provides a glimpse into Japanese culture and daily life during the 19th century, showcasing various aspects of society, including leisure activities, work, and relationships between humans and animals.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-26

The image is a traditional Japanese print that depicts a calendar with illustrations for each month. The calendar is vertically oriented, with the months arranged in two columns. Each month is represented by a scene that reflects traditional activities or seasonal events associated with that time of the year.

At the top of the calendar, there is a blue header with Japanese characters, which likely indicates the title or purpose of the calendar. Below this header, the months are listed in Japanese characters, each accompanied by an illustration.

Starting from the top left, the first month shows a scene with a man and a woman engaged in an activity, possibly related to the New Year's celebration. The second month features a man and a woman with a dog, possibly indicating an event or festival. The third month shows a man and a woman, possibly engaged in farming or a seasonal activity. The fourth month depicts a man and a woman with a child, possibly signifying a family event or celebration.

The fifth month shows a man and a woman with a boat, possibly indicating a river or sea-related activity. The sixth month features a man and a woman with a child, possibly engaged in a summer activity. The seventh month depicts a man and a woman with a dog, possibly indicating an event or festival. The eighth month shows a man and a woman with a child, possibly engaged in an autumn activity.

The ninth month features a man and a woman with a dog, possibly indicating an event or festival. The tenth month depicts a man and a woman with a child, possibly engaged in a seasonal activity. The eleventh month shows a man and a woman with a dog, possibly indicating an event or festival. The twelfth month features a man and a woman with a child, possibly engaged in a winter activity.

At the bottom of the calendar, there are additional Japanese characters, likely providing further information or context for the calendar. The illustrations are traditional in style, with a focus on depicting everyday life and seasonal activities in a simple yet expressive manner.

Created by amazon.nova-lite-v1:0 on 2025-01-26

The image is a traditional Japanese print that depicts various scenes and characters from different months of the year. It is structured with a calendar-like layout, featuring illustrations and text in Japanese. The top part of the image contains a title written in Japanese, indicating that it is a representation of the twelve months of the year. Below the title, there are twelve distinct illustrations, each corresponding to a month, accompanied by Japanese text that describes the activities or characteristics associated with that month. The illustrations include people engaged in various activities, such as farming, fishing, and other seasonal tasks, along with animals and natural elements that reflect the time of year. The colors and styles of the illustrations are characteristic of traditional Japanese woodblock prints, known for their vibrant and detailed artistry.

Google Gemini

Created by gemini-2.0-flash on 2025-05-19

This is an antique Japanese print, likely from the Edo or Meiji period. Here's a description:

General Layout:

  • It has a yellowish-tan background.
  • The image is divided into two horizontal registers or sections.
  • Above each scene are what appear to be lines of Japanese text, potentially descriptive or captions. These lines of text have geometrical shapes above them, which may be to help align the words above their corresponding scene.

Top Register:

  • Several figures are arranged in a row.
  • From left to right:
    • A figure in a red and blue outfit and a black head covering kneels down holding an axe.
    • A figure wearing a kimono stands with hands folded.
    • A figure kneels and strokes an animal.
    • A figure in a green and black outfit sits atop a round object, with arm raised.
    • Two figures sit next to each other, one appears to be playing an instrument.

Bottom Register:

  • More figures are depicted.
  • From left to right:
    • Two figures sitting next to each other.
    • A nude figure.
    • A figure pouring water into a container on the ground.
    • A figure carrying a box on their shoulders.
    • A figure standing in a boat.
    • Two animals stand next to each other.

Style:

  • It has a traditional Ukiyo-e style with flat colors and outlined forms.

Overall Impression:

  • The print appears to depict everyday scenes or perhaps illustrations for a story or instructional text.
  • The antique nature and the style point to a historical or cultural artifact.

Created by gemini-2.0-flash-lite on 2025-05-19

This is a traditional Japanese woodblock print. It features a grid layout with illustrations and Japanese text. The print's title is written at the top, and the text is likely a form of education or story. The illustrations depict various scenes with figures in traditional clothing, engaging in different activities. The style is consistent with classical Japanese printmaking, using bold outlines, vibrant colors, and a focus on symbolic representation. It is probably an educational print, possibly related to language learning, as it includes illustrations and Japanese characters.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image appears to be a traditional Japanese print, likely from the Edo period, featuring a series of illustrations accompanied by Japanese text. The print is divided into two main sections, each with a row of illustrations and corresponding text above and below them.

Top Section:

  1. Illustrations:

    • The top row features six different characters, each engaged in a unique activity. From left to right:
      • A man in a red robe and blue pants, possibly a scholar or official, holding a scroll.
      • A woman in a blue and red kimono, holding a fan.
      • A man in green robes, holding a white animal, possibly a rabbit or a small dog.
      • A man in a black robe with red pants, holding a staff and gesturing.
      • A man in a blue robe and red pants, holding a bowl.
      • A woman in a colorful kimono, holding a fan and a small object.
  2. Text:

    • Above the illustrations, there is a line of Japanese text in kanji characters.
    • Below the illustrations, there is another line of Japanese text, also in kanji characters.

Bottom Section:

  1. Illustrations:

    • The bottom row features six different characters, each engaged in a unique activity. From left to right:
      • A woman in a blue kimono with a red sash, holding a fan.
      • A man in a blue robe and white pants, holding a scroll.
      • A woman in a blue kimono, holding a fan and a small object.
      • A man in a blue robe and white pants, holding a staff and gesturing.
      • A man in a blue robe and white pants, holding a bowl.
      • A woman in a blue kimono, holding a fan and a small object.
  2. Text:

    • Above the illustrations, there is a line of Japanese text in kanji characters.
    • Below the illustrations, there is another line of Japanese text, also in kanji characters.

Overall Theme:

The print seems to depict various characters from Japanese folklore or daily life, each engaged in different activities. The text likely provides descriptions or narratives related to the illustrations, possibly in the form of a story or a poem. The use of traditional clothing and objects suggests a historical or cultural context.

Qwen

No captions written

Text analysis

Amazon

E
D
MM
r
AY
2
D D Fm
4
1
MSO
n
448
3
Uns
me
at
siir2M
t
+nst
Fm
M>
CSo
OUy
M
, 1 3
Si
VyN
+h
S NU
N
ET
,
$
wt

Google

解給雅知業吉加利墨王 A O Omt あuwのwt aSS ○f とと O A 大金 4 O S 4.MA O Oe ○ n のとと 4 t O UJ 3 ○ へ ととと への正Y S ○ 1 O NJ くちんすとくえ O スま多込のとを O O An S N 4 n 4 O SN N O vauNY 4ナタうええん 4 n O ANGH 4
解給
雅知
業吉
加利墨王
A
O
Omt
uw
wt
aSS
f
大金
4
S
4.MA
Oe
n
のと
t
UJ
3
ととと
Y
1
NJ
くちん
とくえ
スま
多込
An
N
SN
vauNY
ナタ
うええん
ANGH