Human Generated Data

Title

The Paulownia Pavilion (Kiritsubo), Illustration to Chapter 1 of the "Tale of Genji" (Genji monogatari)

Date

17th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Mrs. John T. Linzee, 1931.247

Human Generated Data

Title

The Paulownia Pavilion (Kiritsubo), Illustration to Chapter 1 of the "Tale of Genji" (Genji monogatari)

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Mrs. John T. Linzee, 1931.247

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Poster 99.4
Advertisement 99.4
Machine 98
Wheel 98
Human 97.8
Person 97.8
Person 97.1
Person 94.5
Person 94.1
Person 91.3
Art 81.7
Drawing 76.8
Text 71.5
Person 69
Transportation 66.4
Vehicle 65.1
Outdoors 63.7
Nature 62.9
Spoke 60.4
Painting 59.8
House 56.2
Building 56.2
Housing 56.2
Cottage 56.2

Clarifai
created on 2020-04-24

people 99.7
wagon 99.6
print 99.5
vehicle 99.3
cavalry 98.9
illustration 98.4
carriage 98.4
transportation system 98.3
group 97.4
war 95.9
military 95.5
weapon 94.9
home 94.7
one 94.6
art 93.6
adult 93.2
skirmish 92.5
text 92.4
cart 92.3
painting 91.2

Imagga
created on 2020-04-24

book jacket 58.2
jacket 45.3
vintage 42.2
old 40.4
wrapping 34.4
retro 27.9
covering 27.2
grunge 26.4
texture 25.7
aged 25.3
stamp 23.3
ancient 21.6
paper 21.2
wall 18.8
letter 17.4
mail 17.2
money 17
postmark 16.7
antique 16.6
frame 15.8
currency 14.4
binding 14.2
circa 13.8
note 13.8
postage 13.8
chalkboard 13.7
envelope 13.7
finance 13.5
symbol 13.5
banking 12.9
art 12.8
printed 12.8
postal 12.8
black 12.6
bank 12.5
container 12.4
philately 11.8
structure 11.8
blackboard 11.7
history 11.6
business 11.5
bill 11.4
grungy 11.4
board 11.3
cash 11
message 11
post 10.5
close 10.3
book 10
wealth 9.9
shows 9.8
states 9.7
textured 9.6
brown 9.6
exchange 9.5
blank 9.4
card 9.4
design 9.3
decoration 9.3
product 9.1
financial 8.9
object 8.8
icon 8.7
worn 8.6
united 8.6
savings 8.4
house 8.4
dollar 8.4
historic 8.3
one 8.2
global 8.2
device 8.2
collection 8.1
religion 8.1
museum 7.8
photograph 7.7
rusty 7.6
communication 7.6
pattern 7.5
sign 7.5
wood 7.5
stock 7.5
closeup 7.4
memorial 7.4
investment 7.3
box 7.2
border 7.2
dirty 7.2
home 7.2
building 7.1
market 7.1
travel 7
wooden 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 98.7
drawing 96.8
book 92.4
sketch 92.2
painting 81.2
old 62
picture frame 17.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-37
Gender Female, 51.4%
Fear 45%
Confused 45.1%
Angry 45%
Surprised 45.1%
Disgusted 45%
Calm 53.8%
Happy 45%
Sad 45.9%

AWS Rekognition

Age 38-56
Gender Male, 52.9%
Disgusted 45.2%
Happy 45.6%
Calm 52.5%
Fear 45%
Confused 45.3%
Sad 45.1%
Surprised 45.3%
Angry 46.1%

AWS Rekognition

Age 32-48
Gender Male, 51%
Disgusted 45%
Sad 45%
Happy 45%
Angry 45%
Confused 45%
Surprised 45%
Fear 45%
Calm 54.9%

AWS Rekognition

Age 12-22
Gender Male, 51.8%
Sad 45.2%
Angry 45.1%
Happy 45%
Fear 45%
Disgusted 45%
Calm 54.7%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 45-63
Gender Female, 50.2%
Sad 50.1%
Confused 49.5%
Surprised 49.5%
Angry 49.6%
Calm 49.7%
Fear 49.6%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 24-38
Gender Female, 50.2%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.7%
Happy 49.6%
Surprised 49.5%
Angry 49.5%
Calm 50.1%

Feature analysis

Amazon

Poster 99.4%
Wheel 98%
Person 97.8%

Categories

Captions

Microsoft
created on 2020-04-24

an old photo of a person 72.8%
an old photo of a building 72.7%
old photo of a person 69%

Azure OpenAI

Created on 2024-12-04

This black and white image depicts a portion of a historical Asian artwork. The scene is an illustration of several figures in traditional attire, engaged in what appears to be a domestic or everyday activity. The top left corner shows a portion of an architectural element that looks like the eaves of a roof. Below it, we can see a person seated near a desk-like piece of furniture, while in the center and bottom of the image, there are other figures seated on the floor around a large, ornate wheeled cart. To the right of the cart, there seems to be some kind of a stream or river depicted with vegetation alongside it. Something is written on the bottom right of the artwork, likely a reference number or cataloging detail that reads "1931.247." The artwork has a few creases and shows signs of age, with its edges frayed and damaged. The artwork itself is mounted on a larger piece of paper or matting, and this assembly is placed against a contrasting background, likely for photographic documentation purposes.

Anthropic Claude

Created on 2024-11-27

The image depicts an intricate and ornate scene with various elements and individuals. In the foreground, there appears to be a decorated carriage or similar vehicle, with individuals seated around it. The background includes a detailed and complex landscape, with architectural elements and a cloudy sky. The overall composition has a distinct artistic and historical quality to it.

Meta Llama

Created on 2024-11-24

The image is a black-and-white photograph of an old, worn-out piece of artwork. The artwork depicts a scene with multiple people in traditional clothing, possibly from the 19th or early 20th century. The people are gathered around a large, ornate cart or carriage, which appears to be decorated with intricate designs and patterns. The cart has a large wheel and a roof, and there are several people sitting on it, as well as others standing nearby. In the background, there is a tree and a cloudy sky. The overall atmosphere of the image suggests that it may be a historical or cultural artifact, possibly from a museum or archive collection. The image is framed by a white border, and there is a small label at the bottom with the number "1931247" written on it.

Text analysis

Google

1931. 247
1931.
247