Human Generated Data

Title

A Waste of Weeds (Yomogiu), Illustration to Chapter 15 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.15.A

Human Generated Data

Title

A Waste of Weeds (Yomogiu), Illustration to Chapter 15 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.15.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Human 99
Person 99
Person 98.3
Art 91.4
Painting 86.8
Person 72.7
People 62.2
Drawing 57.9

Clarifai
created on 2018-02-09

painting 98.5
illustration 97.9
art 96.9
wear 96.8
people 96.6
print 95
adult 92.9
paper 90.4
veil 89.6
no person 86.4
vintage 86.1
group 84.6
text 83.6
man 83.3
retro 83
home 80.9
war 80.1
document 77.6
woman 77.4
old 77.3

Imagga
created on 2018-02-09

grunge 46.8
old 39.7
texture 36.1
vintage 32.2
aged 29.9
paper 28.4
antique 27.8
wall 26
material 25
dirty 24.4
retro 22.9
pattern 21.9
surface 21.2
wallpaper 20.7
damaged 20
frame 20
brown 19.1
paint 19
weathered 19
grungy 19
detail 18.5
ancient 18.2
rusty 18.1
stucco 16.4
stained 16.3
border 16.3
textured 15.8
rough 15.5
decay 15.4
aging 15.3
worn 15.3
backdrop 14
structure 13.8
burnt 13.6
torn 13.5
stain 13.4
color 13.3
rust 12.5
canvas 12.3
backgrounds 12.2
obsolete 11.5
art 11.3
design 11.3
blank 11.1
decorative 10.9
cracked 10.7
stone 10.6
parchment 10.6
concrete 10.5
page 10.2
cement 10
decoration 10
yellow 9.9
map 9.8
text 9.6
architecture 9.4
flower 9.2
card 9
metal 8.8
stains 8.8
messy 8.7
dirt 8.6
iron 8.4
document 8.3
metallic 8.3
person 8.2
romantic 8
graffito 8
rustic 7.9
world 7.9
peeling 7.9
urban 7.9
grime 7.8
fracture 7.8
leaf 7.8
sepia 7.8
space 7.8
empty 7.7
textures 7.6
sheet 7.5
close 7.4
closeup 7.4
grain 7.4
industrial 7.3

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

old 43
dirty 10.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 11-18
Gender Male, 54.4%
Angry 46.6%
Calm 45.9%
Confused 46.1%
Happy 46.5%
Disgusted 46%
Surprised 46.5%
Sad 47.4%

AWS Rekognition

Age 29-45
Gender Male, 54.2%
Disgusted 47.4%
Sad 45.9%
Surprised 45.3%
Calm 45.1%
Confused 45.3%
Angry 46.8%
Happy 49.1%

Feature analysis

Amazon

Person
Painting
Person 99%
Person 98.3%
Person 72.7%
Painting 86.8%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image depicts a traditional Japanese scene with three individuals dressed in historical attire featuring elaborate robes and large, black hats. One person is holding an umbrella, while another is kneeling on the ground and holding a walking stick. The setting appears to be outdoors, with visible elements of nature such as trees and grass. There is also a wooden structure with detailed roofing and railings in the background, partly obscured by wispy cloud-like formations. The entire scene is rendered in a delicate, illustrative style that suggests it could be part of a historical Japanese artwork.

Created by gpt-4 on 2024-01-25

The image depicts a traditional Japanese scene with individuals dressed in period garments. Two figures walk in unison under a shared umbrella. Both wear intricately patterned kimonos, one in a hue of green and the other in blue and white, each carrying a white object. A third individual, in a mustard-yellow kimono with a subdued pattern, kneels on the ground holding a thin stick or rod. The setting suggests a tranquil outdoor area near traditional Japanese structures with wooden frames and thatched elements. The scene is rendered with delicate brushwork and soft, muted tones, evoking a serene and historical atmosphere.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a traditional Japanese scene with several figures in traditional Japanese attire. There are two people wearing colorful robes and carrying umbrellas, suggesting they are out for a stroll or outing. In the background, there is a distinctive Japanese architectural structure with a sloped roof and intricate details. The overall setting appears to be a lush, natural environment with trees and greenery surrounding the figures and building.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image is a Japanese painting, likely from the Edo period (1603-1868), depicting three men in traditional attire. The man on the left wears a green kimono and holds a parasol, while the man in the center sports a blue kimono and carries a sword. The man on the right, dressed in yellow, also wields a sword. In the background, a building with a tiled roof and a staircase leading up to it is visible. The scene is set amidst trees and grass, with a serene atmosphere prevailing. The painting's style and composition suggest that it may be a scene from a story or a depiction of everyday life during the Edo period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a scene from a traditional Japanese painting, showcasing three men in traditional attire gathered near a tree and a building. * The man on the left wears a green robe and holds a parasol in his right hand, while the man in the middle dons a blue robe and holds a parasol in his left hand. The man on the right is dressed in a yellow robe and holds a long stick in his right hand. * The background features a tree on the left side of the image, with a building situated behind the men. The building has a brown roof and white walls, and a staircase leads up to it. * The overall atmosphere of the image suggests a serene and peaceful setting, with the men engaged in a leisurely activity amidst nature. The image presents a tranquil and idyllic scene, capturing a moment of everyday life in traditional Japan.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

This image is a painting depicting three people in a garden. The painting is in a traditional Japanese style, with a focus on simplicity and minimalism. The three people in the painting are dressed in traditional Japanese clothing, with the man on the left wearing a kimono and the woman on the right wearing a yukata. The man in the middle is holding an umbrella, which is a common accessory in Japanese art. The background of the painting features a building with a tiled roof and a tree, which adds to the serene and peaceful atmosphere of the scene. The painting is framed in a simple wooden frame, which complements the traditional style of the artwork. Overall, the image captures the beauty and tranquility of a traditional Japanese garden.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a painting with a traditional style. It features four people, two of whom are standing under an umbrella while the other two are kneeling on the ground. The person in the center is holding a stick. The scene is set in an outdoor area with a grassy field, trees, and a house in the background. The painting is done in a traditional style, with a muted color palette and a focus on simplicity and elegance.