Human Generated Data

Title

The Pilgrimage to Sumiyoshi (Miotsukushi), Illustration to Chapter 14 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.14.A

Human Generated Data

Title

The Pilgrimage to Sumiyoshi (Miotsukushi), Illustration to Chapter 14 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.14.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Painting 94.1
Art 94.1
Human 93.5
Person 93.5
Person 90.9
Person 89.8
Person 88.7
Person 88.4
Person 86.7
Person 84.8
Person 82.1
Person 78.1
Person 77.6
Person 77.3
Person 75
Vehicle 69.8
Transportation 69.8
Boat 69.8
Person 67.8
Person 65.4
Person 59.7
Drawing 58.6

Clarifai
created on 2018-02-09

people 98.5
water 96.5
group 95.6
painting 95.3
adult 94.9
art 94.3
illustration 94
man 91.9
child 90.3
wear 89.5
print 89.4
travel 87.4
woman 86.5
landscape 85.2
many 84.9
recreation 84.7
war 82.1
mammal 81
calamity 80.6
skirmish 80.5

Imagga
created on 2018-02-09

grunge 24.7
old 23.7
texture 21.5
puzzle 18.8
wall 18.7
aged 18.1
spectator 18
game 16.7
dirty 15.4
paint 14.5
grungy 14.2
travel 14.1
people 13.4
color 13.3
antique 13
rough 12.8
sky 12.7
vintage 12.4
tourism 12.4
world 12.1
tree 11.5
building 11.5
rusty 11.4
architecture 10.9
rust 10.6
urban 10.5
man 10.1
decoration 10.1
city 10
ocean 10
wallpaper 10
country 9.9
vacation 9.8
map 9.7
surface 9.7
landscape 9.7
ancient 9.5
town 9.3
art 9.3
scenery 9
pattern 8.9
brown 8.8
yellow 8.6
weathered 8.5
structure 8.5
design 8.4
summer 8.4
silhouette 8.3
person 8.2
connection 8.2
retro 8.2
border 8.1
water 8
river 8
holiday 7.9
black 7.8
scene 7.8
stone 7.8
messy 7.7
decay 7.7
stain 7.7
dirt 7.6
damaged 7.6
earth 7.6
sport 7.4
graffito 7.3
global 7.3
mountain 7.2
material 7.1
grass 7.1
paper 7.1
scenic 7

Google
created on 2018-02-09

painting 78.8
art 75.1
recreation 60.9
artwork 54.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-23
Gender Male, 54.6%
Disgusted 45%
Sad 54.8%
Surprised 45%
Calm 45%
Confused 45%
Angry 45.1%
Happy 45%

AWS Rekognition

Age 35-52
Gender Male, 54%
Angry 45.2%
Calm 45%
Confused 45%
Happy 45%
Disgusted 45%
Surprised 45%
Sad 54.7%

AWS Rekognition

Age 1-5
Gender Female, 50.1%
Confused 49.6%
Sad 49.7%
Disgusted 49.9%
Calm 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Male, 52.3%
Calm 45%
Surprised 45%
Happy 45%
Sad 54.8%
Angry 45.1%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.6%
Confused 49.6%
Sad 49.5%
Calm 50.2%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.6%
Calm 49.6%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Sad 50.2%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 53%
Confused 45.3%
Angry 45.6%
Sad 46.7%
Surprised 45.8%
Happy 48.6%
Disgusted 45.6%
Calm 47.4%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Angry 49.6%
Confused 49.5%
Disgusted 49.8%
Sad 49.8%
Happy 49.5%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.6%
Surprised 49.6%
Happy 49.8%
Sad 49.9%
Angry 49.5%
Confused 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Painting 94.1%
Person 93.5%
Boat 69.8%

Captions

Azure OpenAI

Created on 2024-01-25

This is an artwork showcasing a lively scene with multiple individuals gathered by a body of water. In the backdrop, there is a boat gently floating on the surface, while the foreground is occupied by a diverse group of individuals dressed in traditional attire, suggesting a cultural or ceremonial gathering. The individuals are displayed in various poses, with some standing and others seated, engaged in what appears to be a social event. The overall aesthetic, clothing style, and composition suggest that this could be a historical scene from an East Asian context. The earthy tones and the detailed depiction of the water and vegetation give the image a serene yet dynamic quality.

Anthropic Claude

Created on 2024-03-29

The image depicts a lively scene with numerous figures dressed in traditional Japanese attire, including kimonos and robes of various colors. In the foreground, there is a group of people gathered, some standing and others seated. In the background, there appear to be buildings and a boat on the water, as well as a larger vessel suspended in the sky, suggesting a fantastical or imaginative element to the scene. The overall impression is one of a vibrant, complex, and richly detailed Japanese landscape or setting.

Text analysis

Amazon

I