Human Generated Data

Title

Heart-to-Heart (Aoi), Illustration to Chapter 9 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.9.A

Human Generated Data

Title

Heart-to-Heart (Aoi), Illustration to Chapter 9 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.9.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Machine 98.7
Wheel 98.7
Wheel 98.2
Art 96.2
Human 95.5
Person 95.5
Painting 93.6
Mural 90.9
Person 90.8
Person 89.4
Person 87.9
Person 71.8
Person 69.3
Person 64.8
Wall 58.5
Graffiti 55.8
Modern Art 55.3
Person 43.2

Clarifai
created on 2018-02-09

illustration 99.9
art 99.4
painting 99.2
print 97.8
graffiti 96.7
old 95.4
vintage 95.3
war 94.5
wall 94.3
cavalry 94.1
manuscript 92.8
people 92.5
bill 92.5
spray 91.7
texture 91.6
skirmish 91
woodcut 89.7
lithograph 89.6
design 89.5
antique 89.2

Imagga
created on 2018-02-09

graffito 59.7
decoration 45.1
vintage 26.5
old 25.1
grunge 24.7
art 24.2
retro 22.1
antique 19.2
drawing 19.2
design 18
tile 17.4
paper 17.2
map 17.2
stamp 15.5
currency 15.3
world 15.1
money 14.5
texture 13.2
pattern 13
business 12.8
ancient 12.1
puzzle 11.9
aged 11.8
mail 11.5
symbol 11.4
country 11.4
finance 11
global 10.9
paint 10.9
postmark 10.8
postage 10.8
wallpaper 10.7
geography 10.6
card 10.3
graphic 10.2
economy 10.2
artwork 10.1
atlas 10
silhouette 9.9
sketch 9.9
wall 9.9
history 9.8
postal 9.8
mosaic 9.8
financial 9.8
artistic 9.6
post 9.5
grungy 9.5
man 9.4
dollar 9.3
letter 9.2
frame 9.2
travel 9.2
border 9
black 9
envelope 9
color 8.9
detail 8.8
decorative 8.3
element 8.3
earth 8.2
dirty 8.1
painting 8.1
wealth 8.1
ink 7.7
painted 7.6
close 7.4
bank 7.4
note 7.4
cash 7.3
cotton 7.3
creative 7.1

Google
created on 2023-10-30

Microsoft
created on 2023-10-30

drawing 98.7
cartoon 97.3
painting 94.9
indoor 87
child art 53.4
different 33.4
several 11.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 48-68
Gender Male, 51.4%
Angry 45.8%
Confused 45.5%
Disgusted 45.6%
Sad 51.6%
Happy 45.8%
Calm 45.4%
Surprised 45.2%

AWS Rekognition

Age 4-7
Gender Male, 52.8%
Happy 47.4%
Surprised 45.4%
Sad 46.5%
Disgusted 45.5%
Angry 45.5%
Confused 45.7%
Calm 49%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Confused 49.5%
Surprised 49.6%
Angry 49.6%
Happy 49.5%
Sad 50.2%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 10-15
Gender Male, 54.2%
Sad 50.1%
Happy 46%
Disgusted 45.5%
Calm 45.1%
Angry 47.6%
Confused 45.5%
Surprised 45.3%

AWS Rekognition

Age 45-63
Gender Female, 50.1%
Angry 45.6%
Calm 48.7%
Confused 45.7%
Happy 45.2%
Disgusted 45.1%
Surprised 45.5%
Sad 49.1%

AWS Rekognition

Age 11-18
Gender Female, 54.1%
Calm 50.2%
Surprised 47.1%
Happy 45.5%
Angry 45.3%
Sad 45.3%
Disgusted 46.2%
Confused 45.4%

AWS Rekognition

Age 35-53
Gender Female, 52.1%
Angry 45.3%
Calm 46.3%
Confused 45.4%
Happy 45.1%
Disgusted 45.1%
Sad 52.6%
Surprised 45.2%

Feature analysis

Amazon

Wheel 98.7%
Person 95.5%

Captions

Azure OpenAI

Created on 2024-01-25

The image depicts a traditional Asian scene with various individuals in historic garments. There is a prominent presence of overturned vehicles, which resemble rickshaws or carts, with their wheels prominently displayed and detailed patterns on their side panels. Additionally, several characters are positioned around the scene, wearing attire that reflects cultural heritage, suggesting a narrative or an event that has unfolded within the artwork. The overall color palette seems subdued with intentional gold accents that could indicate status or importance. The artwork appears to be in a style suggestive of historic Asian prints or paintings.

Anthropic Claude

Created on 2024-03-29

The image depicts a lively scene of people gathered around various ornate wagons or carriages. The carriages appear to have distinctive wheel designs and are intricately decorated. The people in the image are dressed in traditional-looking clothing and seem to be engaged in some kind of activity or event. The overall scene has a vibrant, almost dreamlike quality to it, with the use of bold colors and stylized depictions of the figures and wagons.

Text analysis

Google

FEDA Gay SCHLIE ாா AAY CTTHIL AFEC 451 H Titig Coco அஜ
FEDA
Gay
SCHLIE
ாா
AAY
CTTHIL
AFEC
451
H
Titig
Coco
அஜ