Human Generated Data

Title

Illustrated Scroll of Events of All Year (Shiki no itami)

Date

18th-19th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.550.1

Human Generated Data

Title

Illustrated Scroll of Events of All Year (Shiki no itami)

Date

18th-19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.550.1

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Handrail 80.2
Banister 80.2
Art 80.2
Human 76
Person 76
Person 75.3
Person 75.2
Person 73.2
Person 73
Person 67.1
Person 66.7
Person 66.4
Painting 66.3
Mural 66.3
Advertisement 65.4
Person 64
Person 60.8
Collage 60
Poster 60
Person 58.9
Building 58.4
Housing 58.4
Playground 57.3
Play Area 57.3
Plant 55.7

Clarifai
created on 2020-04-23

art 98.2
street 98.1
people 96.7
painting 96.3
urban 96.2
wall 96.2
city 95.5
architecture 95.2
building 93
man 92.9
illustration 92.8
desktop 91.9
artistic 91.3
woman 91.3
adult 90.7
color 90.7
graffiti 89.4
girl 88.4
design 88.1
house 87.9

Imagga
created on 2020-04-23

grunge 36.6
texture 32.6
old 29.3
vintage 27.3
map 25
wallpaper 24.5
art 23.7
jigsaw puzzle 23.3
aged 21.7
puzzle 21.3
paper 21.3
dirty 19.9
surface 18.5
decoration 18.4
paint 18.1
color 17.8
pattern 17.8
antique 16.4
floral 16.2
design 15.8
retro 15.6
material 15.2
grungy 15.2
world 15.1
graffito 14.7
flower 14.6
envelope 14.5
stain 14.4
wall 14.4
game 14.4
container 13.4
rusty 13.3
frame 13.3
geography 12.5
structure 12.5
rough 11.8
colorful 11.5
worn 11.5
textured 11.4
detail 11.3
artwork 11
graphic 10.9
backgrounds 10.5
artistic 10.4
drawing 10.3
brown 10.3
grain 10.2
insulating material 10.1
school 10
atlas 9.8
creative 9.7
rust 9.6
weathered 9.5
textures 9.5
page 9.3
globe 9.3
global 9.1
backdrop 9.1
decay 8.7
aging 8.6
north 8.6
damaged 8.6
leaf 8.6
earth 8.3
pencil 8.3
effect 8.2
industrial 8.2
border 8.1
country 8
yellow 7.9
stationery 7.9
building material 7.9
text 7.9
ancient 7.8
continent 7.8
torn 7.7
canvas 7.6
planet 7.5
close 7.4
plants 7.4
crayon 7.4
steel 7.1

Google
created on 2020-04-23

Microsoft
created on 2020-04-23

cartoon 97.7
drawing 96
painting 95
child art 85.6
text 77.9
illustration 77.2
person 76.1
colored 14.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 17-29
Gender Male, 50.3%
Surprised 49.7%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Calm 50.2%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%

AWS Rekognition

Age 9-19
Gender Male, 50.1%
Happy 49.6%
Surprised 50.1%
Sad 49.5%
Calm 49.6%
Disgusted 49.5%
Fear 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Angry 49.7%
Sad 49.5%
Fear 49.5%
Surprised 50.1%
Happy 49.5%
Confused 49.5%
Calm 49.7%
Disgusted 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Angry 49.9%
Sad 49.5%
Happy 49.5%
Disgusted 49.6%
Calm 49.6%
Confused 49.5%
Surprised 49.7%
Fear 49.7%

AWS Rekognition

Age 20-32
Gender Male, 54.3%
Calm 47.6%
Disgusted 45.5%
Happy 45.5%
Surprised 46.5%
Sad 46.3%
Confused 46.4%
Fear 45.4%
Angry 46.7%

Feature analysis

Amazon

Person
Person 76%
Person 75.3%
Person 75.2%
Person 73.2%
Person 73%
Person 67.1%
Person 66.7%
Person 66.4%
Person 64%
Person 60.8%
Person 58.9%

Categories

Imagga

paintings art 99.3%

Captions

Microsoft
created on 2020-04-23

a birthday cake 42%
a table with a birthday cake 26.5%
a birthday cake on a table 26.4%

OpenAI GPT

Created by gpt-4 on 2024-12-03

This image depicts a traditional Japanese scene in a classical style. It features a number of people, apparently from an earlier historical period, engaged in various activities. The figures are dressed in traditional Japanese garments, which suggests that the scene may represent a slice of life from the Heian period or another historical era of Japan. On the left and center sections, we see interiors of two buildings. Within these buildings, groups of women are seated in conversation or engaged in activities such as reading or playing instruments, representing a courtly or aristocratic setting. To the right, the scene transitions to an outdoor setting featuring trees and what appears to be a garden or courtyard. Here, several more figures, women and children, stand or engage in tasks. Some hold fans, while one figure is sweeping, and another is tending to a child. The artwork is on paper decorated with gold leaf, which has worn away in places, giving it an aged appearance. The depiction of the characters and their activities is detailed, with attention paid to the patterns on their robes and the objects they are carrying or using. The image is likely a panel from a larger work, such as a screen or scroll, used to tell a story or illustrate court life. It is a representation of a bygone era captured through traditional Japanese artistic conventions.

Created by gpt-4o-2024-05-13 on 2025-01-04

This image is a traditional Japanese painting that appears to depict a vibrant and bustling scene of daily life during a historical period. The artwork showcases rich colors and intricate details that give insight into the culture and social interactions of the time. The composition is divided into multiple levels, with various figures engaged in different activities. In the upper section, inside a building, there are people seemingly in a conversation or perhaps a negotiation. They are dressed in traditional Japanese attire with kimonos and appear to be interacting in a formal setting. Some women are depicted sitting, while others are standing or walking on elevated wooden walkways. The lower part of the painting features more figures, including women and children, dressed in colorful kimonos. They can be seen walking outdoors among pine trees and bamboo, engaged in various actions such as talking, carrying items, and tending to infants. The scene conveys a sense of community and daily life, with people freely moving between indoors and outdoors. The background contains gold leaf embellishments, which add an element of elegance and richness to the painting, highlighting the opulence and attention to detail characteristic of traditional Japanese art. The artwork captures a lively and harmonious atmosphere with strong elements of nature and communal activities.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a traditional Japanese painting, likely from the Edo period, depicting a lively scene with multiple figures in traditional Japanese clothing including kimonos. The painting shows what appears to be a social gathering or celebration taking place on different levels of a building or platform structure. The composition includes architectural elements with sloping surfaces and steps, decorated with green pine trees or bamboo. The figures are rendered in the classic Japanese artistic style, wearing various colored garments including blue, red, and gray. The background has a golden tone, which is characteristic of many Japanese decorative paintings. The overall scene suggests a moment of social interaction or entertainment, with people gathered in small groups across the different levels of the space. The painting demonstrates the sophisticated spatial organization and attention to detail typical of Japanese narrative art of this period.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a traditional Japanese painting or illustration depicting a busy, bustling scene. It shows a large group of people, both men and women, dressed in traditional Japanese attire such as kimonos and robes. The figures are engaged in various activities, some walking, others conversing or interacting with one another. In the background, there are buildings and trees, adding to the sense of a lively, populated setting. The overall style and use of color and detail suggest this is a work of Japanese art, likely from an earlier historical period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a traditional Japanese painting, likely from the Edo period, showcasing a lively scene of people gathered in a courtyard. The artwork is characterized by its muted color palette, with a focus on earthy tones such as beige, green, and brown, accented with subtle hints of red and blue. In the foreground, a group of individuals are engaged in various activities, including playing musical instruments, conversing, and enjoying food and drink. The figures are dressed in traditional Japanese attire, with men wearing kimonos and women adorned in elegant robes. The atmosphere appears to be one of celebration and merriment, with the participants seemingly lost in the joy of the moment. The background of the painting features a serene landscape, with trees and foliage adding depth and texture to the composition. The overall effect is one of harmony and balance, reflecting the traditional Japanese aesthetic values of simplicity, elegance, and restraint. The painting's style and technique are reminiscent of traditional Japanese art forms, such as ukiyo-e woodblock prints and sumi-e ink paintings. The use of bold lines, flat perspectives, and muted colors creates a sense of intimacy and immediacy, drawing the viewer into the scene. Overall, the image presents a captivating glimpse into traditional Japanese culture and society, offering insights into the customs, values, and aesthetics of a bygone era.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a traditional Japanese painting, likely from the Edo period (1603-1868), featuring a lively scene of people gathered in a courtyard. The painting is rendered in muted colors, with gold accents and a beige background. * **People:** * The painting shows a diverse group of people, including men, women, and children, all dressed in traditional Japanese clothing. * Some individuals are seated on benches or stairs, while others are standing or walking around. * The people appear to be engaged in various activities, such as conversation, reading, or playing musical instruments. * **Setting:** * The courtyard is depicted as a serene and peaceful environment, with a few trees and plants scattered throughout. * The walls of the courtyard are adorned with traditional Japanese architecture, including sliding doors and windows. * The floor is made of stone or wood, and there are several benches and stairs leading up to the upper levels of the courtyard. * **Objects:** * The painting includes several objects that add to the scene's atmosphere, such as musical instruments, books, and fans. * There are also some decorative elements, such as lanterns and vases, that add to the overall aesthetic of the painting. * **Color Palette:** * The dominant colors used in the painting are muted shades of green, blue, and brown, which give the scene a sense of calmness and serenity. * The gold accents add a touch of luxury and elegance to the painting, highlighting the importance of the people and objects depicted. * **Style:** * The painting is characterized by its traditional Japanese style, with bold lines and simple shapes. * The artist has used a range of techniques, including brushwork and layering, to create a sense of depth and texture in the painting. Overall, the image presents a charming and intimate portrayal of everyday life in traditional Japan, showcasing the beauty and simplicity of the country's culture and architecture.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a traditional Japanese painting featuring a scene of people engaged in various activities within a household setting. The painting is characterized by its intricate details and vibrant colors, typical of Japanese art. The scene includes several figures, some of whom are seated while others are standing, suggesting a bustling family gathering or social event. The background is adorned with decorative elements such as trees, plants, and architectural details that reflect the traditional Japanese aesthetic. The use of gold leaf in the upper portion of the painting adds a touch of elegance and richness to the artwork. The painting's style and composition suggest it is a work from the Edo period, known for its detailed and expressive art forms.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image depicts a painting of people, possibly a family, in a house. The painting is in a vintage style, with a golden border and a yellowish background. The people in the painting are wearing traditional Japanese clothing, and they are engaged in various activities. Some are sitting on the floor, while others are standing. There are also trees and plants in the painting, adding to the overall aesthetic.