Human Generated Data

Title

Scenes from the Song of Everlasting Sorrow

Date

Early Edo period, circa 1624-1630 (Kan'ei Era)

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1917.56

Human Generated Data

Title

Scenes from the Song of Everlasting Sorrow

Date

Early Edo period, circa 1624-1630 (Kan'ei Era)

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1917.56

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Person 93.9
Human 93.9
Painting 93.5
Art 93.5
Person 88.7
Person 84.3
Person 83.2
Person 82.2
Person 79.9
Person 76.9
Person 70.8
Person 68.4
Drawing 65.1
Person 61.3
Tapestry 55.4
Ornament 55.4
Person 55

Clarifai
created on 2020-04-23

illustration 98.7
people 98.1
art 97.7
group 97.7
print 97.6
painting 97.6
wear 97.2
tree 96.5
no person 96.3
house 93.2
collage 92.8
mammal 92.1
symbol 89.5
adult 89.1
lithograph 87.9
one 87.1
vintage 86.8
travel 85.8
vehicle 85.5
card 84.7

Imagga
created on 2020-04-23

jigsaw puzzle 47.1
puzzle 41.1
old 32.1
grunge 29.8
vintage 29
game 26.4
antique 24.2
wall 21.9
ancient 21.6
religion 21.5
art 20.4
architecture 19.5
church 18.5
retro 18
tile 17
decoration 16.9
texture 16.7
paper 16.5
travel 16.2
city 15.8
aged 15.4
graffito 15.2
history 15.2
structure 14.1
map 13.7
old fashioned 13.3
cathedral 13.1
pattern 13
grain 12.9
landmark 12.6
world 12.5
building 12.5
historic 11.9
tourism 11.6
dirty 10.8
painting 10.8
cemetery 10.5
material 10.5
historical 10.4
paint 10
wallpaper 10
house 9.9
style 9.6
stain 9.6
text 9.6
brown 9.6
color 9.5
temple 9.4
stone 9.4
culture 9.4
frame 9.2
brick 9.1
mosaic 9
sky 8.9
geography 8.7
stained 8.7
window 8.6
grungy 8.5
money 8.5
monument 8.4
letter 8.3
currency 8.1
design 7.9
us 7.7
weathered 7.6
religious 7.5
landscape 7.4
global 7.3
colorful 7.2
textured 7

Google
created on 2020-04-23

Art 85
Textile 76.5
Painting 76.1
Tapestry 69.3
World 60.5
Illustration 57.7
History 57.6

Microsoft
created on 2020-04-23

painting 97.8
text 93.7
drawing 79.7
cartoon 75
art 56.5
fabric 12

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 37-55
Gender Male, 50.5%
Happy 49.5%
Surprised 49.6%
Confused 49.5%
Disgusted 49.5%
Calm 50%
Sad 49.6%
Fear 49.7%
Angry 49.5%

AWS Rekognition

Age 8-18
Gender Male, 50.1%
Calm 49.7%
Sad 50.3%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Fear 49.5%

AWS Rekognition

Age 52-70
Gender Male, 50.2%
Fear 49.5%
Disgusted 49.5%
Sad 50.3%
Angry 49.5%
Calm 49.6%
Confused 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 16-28
Gender Female, 50.1%
Calm 49.6%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Fear 49.5%
Confused 49.5%
Sad 50.3%
Happy 49.5%

AWS Rekognition

Age 9-19
Gender Male, 50.3%
Angry 49.7%
Disgusted 49.7%
Calm 49.7%
Happy 49.5%
Fear 49.5%
Confused 49.5%
Sad 49.9%
Surprised 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.4%
Surprised 49.5%
Fear 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%
Sad 50.4%
Angry 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Person
Painting
Person 93.9%
Person 88.7%
Person 84.3%
Person 83.2%
Person 82.2%
Person 79.9%
Person 76.9%
Person 70.8%
Person 68.4%
Person 61.3%
Person 55%
Painting 93.5%

Categories

Imagga

paintings art 93.9%
food drinks 2.4%
text visuals 1.1%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-03

This image depicts a traditional Asian folding screen, specifically a Japanese byōbu. The screen is elaborately painted, featuring multiple panels connected by hinges that allow it to stand freely and be folded. The painting itself shows a scene with architectural elements and figures that appear to be engaged in various activities. The overall style suggests it may portray a narrative or a scene from courtly life. On the left, a group of people are on a terrace with pine trees, which may signify longevity or resilience in many East Asian cultures. The central panel shows individuals on an elevated structure with a tiled roof, holding what appears to be fans, with clouds surrounding the scene. This could indicate a depiction of an ethereal or heavenly place. On the right, a more grounded setting is presented, showing figures near a rocky outcrop, with one individual holding a staff or pole with a circular object atop, possibly signifying a spiritual or ceremonial function. The golden background of the screen indicates opulence and also serves to unify the scene, while the clouds mingling through the segments give a sense of continuity across the panels. Each panel is rich in detail, with carefully depicted patterns on the clothing, intricate architectural elements, and naturalistic portrayal of the trees and rocky landscapes. Overall, the screen has a balanced composition, imbuing the depicted scene with a sense of harmony and elegance that is characteristic of traditional Japanese art. The exact meaning or story being told within the painting would likely be understood in the context of Japanese history, literature, or mythology.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a traditional Japanese painting done in the style of a folding screen (byōbu). The scene depicts several figures in traditional Japanese clothing gathered on different levels of what appears to be a bridge or architectural structure. The painting has a golden background characteristic of many Japanese screen paintings, with decorative pine trees and landscape elements scattered throughout the composition. The figures are shown in various activities - some appear to be holding fans or other objects, and they're arranged in small groups across the scene. The artwork uses typical Japanese painting techniques with flat color areas and delicate line work to portray the figures and architectural elements. The landscape includes rocky outcrops, stylized clouds, and various vegetation rendered in deep greens against the gold background. The overall composition is balanced and flows across multiple panels, as was typical for Japanese screen paintings of this period. This type of screen painting would have been used both as a decorative element and as a room divider in traditional Japanese architecture, likely dating from the Edo period or earlier based on its style and execution.

Created by claude-3-haiku-20240307 on 2024-11-27

This image appears to be a Japanese folding screen or byōbu painting. It depicts a detailed, colorful landscape scene with various figures engaged in activities. The background features a mountainous setting with pagodas, trees, and other architectural elements. In the foreground, there are small groups of people, some seated and some standing, suggesting a social gathering or festival. The overall style and composition suggest this is a traditional Japanese artistic work, likely from the Edo or earlier periods.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a traditional Japanese-style painting, likely a screen or panel, featuring a serene and idyllic scene. The artwork is divided into six panels, each showcasing a unique aspect of the scene. **Color Scheme:** The dominant colors are gold, black, and green, with accents of red, white, and brown. The gold background provides a warm and luxurious tone, while the black and green elements add depth and contrast. **Scene Description:** The scene appears to be set in a natural environment, possibly a garden or a mountainous area. The central panel features a large tree with a checkered pattern on its trunk, surrounded by clouds and foliage. To the left, a group of people are gathered around a structure, possibly a temple or a pavilion. On the right side, another group of people are engaged in various activities, such as playing musical instruments or holding objects. **Figures and Objects:** The figures in the painting are dressed in traditional Japanese attire, with some wearing kimonos and others sporting more casual clothing. The objects depicted include musical instruments, fans, and what appears to be a shield or a mirror. **Overall Impression:** The painting exudes a sense of tranquility and harmony, with the natural surroundings and the peaceful activities of the figures creating a soothing atmosphere. The use of gold and other rich colors adds to the overall sense of luxury and refinement. **Possible Interpretation:** The painting may be intended to represent a moment of leisure and relaxation, where individuals can escape the stresses of everyday life and connect with nature and each other. Alternatively, it could be a depiction of a specific event or ceremony, such as a wedding or a festival.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a traditional Japanese screen, likely from the Edo period (1603-1868), featuring a scene with multiple panels. The screen is divided into six panels, each depicting a different scene. **Panel 1:** The first panel shows a group of people standing on a staircase, surrounded by trees and clouds. They are dressed in traditional Japanese clothing, with some wearing kimonos and others wearing more casual attire. The scene appears to be a social gathering or celebration. **Panel 2:** The second panel features a group of people standing on a balcony, overlooking a garden. They are also dressed in traditional Japanese clothing, and some are holding fans or other objects. The scene appears to be a more formal gathering or ceremony. **Panel 3:** The third panel depicts a group of people standing in front of a large stone structure, possibly a temple or shrine. They are dressed in traditional Japanese clothing, and some are holding objects such as fans or scrolls. The scene appears to be a religious or cultural event. **Panel 4:** The fourth panel shows a group of people standing in a garden, surrounded by trees and flowers. They are dressed in traditional Japanese clothing, and some are holding objects such as fans or parasols. The scene appears to be a leisurely activity or social gathering. **Panel 5:** The fifth panel features a group of people standing in front of a large tree, possibly a cherry blossom tree. They are dressed in traditional Japanese clothing, and some are holding objects such as fans or scrolls. The scene appears to be a celebration or festival. **Panel 6:** The sixth panel depicts a group of people standing in front of a large mountain range, possibly a landscape painting. They are dressed in traditional Japanese clothing, and some are holding objects such as fans or parasols. The scene appears to be a representation of nature or a spiritual journey. Overall, the image suggests that the screen is depicting a series of scenes related to traditional Japanese culture, including social gatherings, religious ceremonies, and natural landscapes. The use of traditional Japanese clothing and objects adds to the cultural significance of the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a traditional Japanese folding screen, known as a byobu, adorned with intricate gold leaf and detailed illustrations. The screen is divided into four panels, each showcasing a different scene. The first panel features a group of people standing on a bridge, with one individual holding a fan. The second panel displays a group of people gathered around a central figure who is holding a fan. The third panel shows a group of people standing on a bridge, with one individual holding a fan. The fourth panel depicts a group of people standing on a bridge, with one individual holding a fan. The screen is set against a backdrop of clouds, trees, and a mountain, with a golden hue that adds to its elegance.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a painting of a scene with several people, a building, and trees. The painting is divided into four sections. The scene depicts a group of people in traditional clothing standing in front of a building with a staircase. Some of the people are holding objects, such as a fan and a stick. The painting also includes trees, plants, and a body of water in the background. The colors of the painting are predominantly yellow, green, and red.