Human Generated Data

Title

The Perfumed Prince (Niou Miya), Illustration to Chapter 42 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.42.A

Human Generated Data

Title

The Perfumed Prince (Niou Miya), Illustration to Chapter 42 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.42.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Machine 99.1
Wheel 99.1
Person 98.5
Human 98.5
Person 97.2
Person 95.1
Person 94.2
Person 92.2
Person 92
Art 84.1
Person 80.9
Transportation 77.8
Vehicle 77.8
Horse 73.2
Animal 73.2
Mammal 73.2
Horse 72.7
Painting 68.1
Person 67.6
Mural 55.2
Person 50.8

Clarifai
created on 2018-02-09

people 97.6
adult 97.6
illustration 96.6
vehicle 95.8
wear 95.7
man 95.5
painting 95.5
transportation system 95.2
art 95
one 94.5
no person 93.5
cavalry 92.4
print 91.3
helmet 90.2
vintage 89
seated 88.7
weapon 88.1
two 87.8
shield 87
mammal 86.5

Imagga
created on 2018-02-09

old 23.7
vintage 19
device 18.5
grunge 17
machine 15.8
paper 15.7
retro 15.6
equipment 14.7
ancient 14.7
aged 14.5
lace 13.3
antique 13
appliance 12.1
texture 11.8
dirty 11.7
metal 11.3
decoration 10.5
work 10.3
industry 10.2
money 10.2
yellow 9.9
gold 9.9
construction 9.4
wall 9.4
border 9
art 8.8
torn 8.7
pattern 8.2
rough 8.2
durables 8.1
open 8.1
object 8.1
textured 7.9
black 7.8
empty 7.7
worn 7.6
grungy 7.6
frame 7.5
dollar 7.4
close 7.4
box 7.4
many 7.4
design 7.3
earth 7.3
industrial 7.3
detail 7.2
currency 7.2
tool 7.1

Google
created on 2018-02-09

art 89.9
painting 86.2
illustration 61.6
artwork 61.5
modern art 57.4
mural 56.2
paint 54.6

Microsoft
created on 2018-02-09

old 48.7
painting 17.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 17-27
Gender Male, 50%
Confused 46.2%
Angry 47.2%
Sad 50.2%
Surprised 45.1%
Happy 45.3%
Disgusted 45.6%
Calm 45.4%

AWS Rekognition

Age 26-44
Gender Male, 50.5%
Disgusted 49.5%
Sad 50.4%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Happy 51.2%
Disgusted 45.6%
Angry 45.5%
Surprised 45.6%
Sad 46%
Calm 45.6%
Confused 45.6%

AWS Rekognition

Age 15-25
Gender Male, 54.9%
Sad 54.2%
Confused 45.2%
Disgusted 45%
Happy 45%
Angry 45.3%
Surprised 45.1%
Calm 45.1%

AWS Rekognition

Age 14-25
Gender Male, 54.8%
Angry 46.1%
Happy 48.6%
Disgusted 45.4%
Surprised 45.8%
Sad 47.9%
Confused 45.7%
Calm 45.4%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Angry 49.6%
Sad 49.6%
Confused 49.5%
Surprised 49.6%
Calm 49.9%
Disgusted 49.6%
Happy 49.7%

AWS Rekognition

Age 4-7
Gender Male, 54.2%
Surprised 47.3%
Disgusted 45.4%
Calm 45.1%
Happy 49%
Sad 46.8%
Confused 45.4%
Angry 46.1%

AWS Rekognition

Age 12-22
Gender Female, 51.7%
Disgusted 45.1%
Sad 54.5%
Surprised 45.1%
Happy 45.2%
Angry 45.2%
Calm 45%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Male, 53.9%
Happy 45.3%
Angry 51.2%
Sad 46.8%
Surprised 45.5%
Disgusted 45.5%
Confused 45.4%
Calm 45.4%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Happy 49.6%
Disgusted 49.5%
Calm 49.5%
Angry 49.6%
Sad 50.3%
Confused 49.5%
Surprised 49.5%

Feature analysis

Amazon

Wheel
Person
Horse
Painting
Wheel 99.1%
Person 98.5%
Person 97.2%
Person 95.1%
Person 94.2%
Person 92.2%
Person 92%
Person 80.9%
Person 67.6%
Person 50.8%
Horse 73.2%
Horse 72.7%
Painting 68.1%

Captions

Microsoft
created on 2018-02-09

a painting of a person 61.3%
a painting on the wall 59.7%
a painting hanging on a wall 59.6%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image depicts an ancient scene featuring an ox-drawn carriage, with two carriages visible in the foreground. The carriages are ornate with detailed designs and appear to be enclosed, suggesting they are designed for the transportation of important individuals or nobility. The oxen are harnessed and guided by attendants dressed in traditional attire, possibly indicating a Japanese or East Asian origin. The background showcases a golden-hued surface with delicate illustrations of trees and landscape elements, completing the historical and cultural setting of the artwork.

Created by gpt-4 on 2024-01-24

This is a traditional Asian scene featuring a black ox-drawn carriage with large wheels, ornately decorated in black with gold details and enclosed with latticework. Subjects in white traditional robes are seen walking alongside the carriage. They are likely attendants or servants. The background is rendered in muted tones of gold and brown, suggesting a dusty or earthen ground. There are hints of vegetation and landscape details painted in a delicate, minimally invasive style. The overall composition conveys a sense of travel or procession, underlining the importanceor status associated with the carriage and its occupants.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a traditional Japanese scene with several figures in traditional dress. There appears to be a large ornate carriage or cart in the center of the image, surrounded by smaller figures, some of whom appear to be pulling or pushing the cart. The background features a mountainous landscape with trees and other details. The overall style of the image suggests it may be a woodblock print or other traditional Japanese artwork.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image is a painting of a group of people in traditional Japanese clothing, with some riding in carts pulled by oxen. The people are dressed in white robes and black hats, while the carts are black with red accents. The background features a yellow sky with clouds and a mountain range in the distance. The overall atmosphere of the painting suggests a sense of movement and activity, as the people and carts are depicted in motion. The use of bright colors and bold brushstrokes adds to the dynamic feel of the image. The painting appears to be a depiction of everyday life in Japan during a specific time period, possibly during the Edo period (1603-1868).

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a scene from ancient China, showcasing a procession of people and animals in a rural setting. The dominant colors are gold, black, and white, with subtle hints of green and red. In the foreground, a large black carriage with a red ribbon adorns its side, pulled by two oxen. A man in a brown robe sits on the carriage, accompanied by another man in a white robe standing beside him. Several individuals in white robes are scattered throughout the scene, some of whom appear to be walking alongside the oxen or standing on the carriage. The background features a serene landscape with trees and a cloudy sky, evoking a sense of tranquility and historical significance. The overall atmosphere of the image is one of elegance and refinement, capturing a moment in time from ancient China's rich cultural heritage.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

This painting depicts a scene of an ancient Chinese funeral procession. It shows two palanquins being carried by people in white robes. The palanquins are covered with green cloth and have red tassels. One of the palanquins has a person sitting inside it, while the other has a person lying inside it. The people carrying the palanquins are walking in a line, with some of them holding the ropes attached to the palanquins. The background of the painting is blurry, with trees and a golden sky.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a painting of a group of people traveling in carriages. The painting depicts a scene with three carriages, each pulled by a pair of horses. The people in the painting are dressed in white robes and hats, and some of them are wearing shoes. The carriages are black and have a red cross on the side. The painting also depicts a landscape with trees and a clear sky.