Human Generated Data

Title

Page from an album: Finding of a Dalai Lama

Date

19th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.863.7

Human Generated Data

Title

Page from an album: Finding of a Dalai Lama

Date

19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.863.7

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Rug 95.1
Human 88.6
Person 88.6
Art 83.9
Person 83
Person 81.1
Envelope 77.6
Mail 77.6
Person 77.3
Person 76.1
Greeting Card 70.8
Painting 65.2
Pattern 64.5
Drawing 58.6

Clarifai
created on 2018-02-16

illustration 99.3
art 96.6
desktop 92.3
painting 92
picture frame 91.1
card 89
design 87.2
old 86.9
people 86.6
vintage 85.9
retro 84.9
paper 84
man 83.6
print 83.4
sketch 82.7
woman 80.6
decoration 78.8
child 78.1
love 77.9
text 75.7

Imagga
created on 2018-02-16

envelope 100
container 86.4
paper 33.8
handkerchief 29.4
vintage 29
card 29
old 28.6
design 24.8
retro 24.6
letter 23.9
decoration 23.2
art 22.8
frame 22.5
graphic 21.9
texture 21.6
element 20.7
decorative 20.1
grunge 19.6
copy 19.5
cover 19.5
creative 19.5
artwork 19.3
collection 19
greeting 18.6
backdrop 18.2
business 17.6
advertisement 17.4
collage 17.4
ancient 17.3
floral 17
composition 17
idea 16.9
decor 16.8
fabric 16.8
advertising 16.4
aged 16.3
conceptual 15.9
associated 15.8
association 15.8
definition 15.7
brochure 15.6
carpet 15.6
advertise 15.6
flower 15.4
page 14.9
data 14.6
invitation 14.5
mail 14.4
antique 13.9
cloud 13.8
blank 13.7
stamp 13.7
album 13.7
scrapbook 13.6
information 13.3
pattern 13
birthday 13
holiday 12.9
congratulation 12.7
leaf 12.5
sheet 12.2
keywords 11.9
ornament 11.2
cash 11
money 10.2
border 10
philately 9.9
currency 9.9
postmark 9.9
empty 9.5
anniversary 9.4
note 9.2
style 8.9
postage 8.9
more 8.8
stains 8.8
text 8.7
announcement 8.7
day 8.6
notes 8.6
message 8.2
dirty 8.1
wealth 8.1
mosaic 7.8
modern 7.7
mix 7.7
damaged 7.6
post 7.6
canvas 7.6
map 7.6
bouquet 7.6
economy 7.4
brown 7.4

Google
created on 2018-02-16

Microsoft
created on 2018-02-16

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-9
Gender Male, 54.9%
Happy 45.3%
Angry 45.8%
Surprised 45.6%
Sad 46.2%
Disgusted 45.3%
Calm 48.5%
Confused 48.2%

AWS Rekognition

Age 23-38
Gender Male, 50.3%
Sad 49.9%
Happy 49.6%
Calm 49.5%
Surprised 49.6%
Disgusted 49.5%
Angry 49.7%
Confused 49.7%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Disgusted 49.6%
Surprised 49.6%
Angry 49.7%
Calm 49.6%
Happy 49.6%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Female, 53%
Disgusted 45%
Sad 52.6%
Angry 45.1%
Calm 45.3%
Surprised 45.1%
Happy 46.8%
Confused 45%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Disgusted 45.4%
Confused 45.9%
Surprised 47.2%
Calm 47.1%
Angry 46%
Happy 46%
Sad 47.5%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Disgusted 45.4%
Confused 45.5%
Surprised 45.2%
Calm 45.6%
Angry 48.1%
Happy 45.8%
Sad 49.3%

AWS Rekognition

Age 14-25
Gender Female, 52.7%
Disgusted 45.3%
Sad 46.3%
Calm 51.1%
Surprised 45.4%
Happy 46.2%
Confused 45.2%
Angry 45.5%

AWS Rekognition

Age 29-45
Gender Male, 51.1%
Disgusted 45.7%
Confused 45.3%
Happy 45.2%
Angry 46.5%
Calm 48.3%
Surprised 45.5%
Sad 48.5%

AWS Rekognition

Age 17-27
Gender Female, 53.2%
Surprised 45.2%
Angry 45.3%
Disgusted 45.1%
Confused 45.1%
Happy 45.4%
Calm 45.4%
Sad 53.3%

AWS Rekognition

Age 23-38
Gender Male, 54.7%
Happy 45.3%
Sad 51.4%
Calm 45.6%
Confused 45.6%
Disgusted 45.1%
Angry 46.1%
Surprised 45.9%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Happy 49.6%
Surprised 49.6%
Disgusted 49.5%
Sad 49.6%
Angry 49.6%
Confused 49.7%
Calm 50%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Disgusted 49.5%
Happy 50.3%
Confused 49.5%
Surprised 49.5%
Sad 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Sad 50.1%
Happy 49.5%
Angry 49.6%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 4-7
Gender Female, 52.9%
Disgusted 45.3%
Sad 49.5%
Angry 47.5%
Calm 45.3%
Surprised 45.5%
Happy 46.6%
Confused 45.4%

AWS Rekognition

Age 15-25
Gender Female, 53.7%
Surprised 45.9%
Confused 45.8%
Calm 47.7%
Happy 46.4%
Disgusted 45.4%
Angry 46.2%
Sad 47.5%

Feature analysis

Amazon

Rug
Person
Painting
Rug 95.1%
Person 88.6%
Person 83%
Person 81.1%
Person 77.3%
Person 76.1%
Painting 65.2%

Captions

Microsoft
created on 2018-02-16

a room with white walls 11.6%
a picture of a room 11.5%
a number of animals in a room 8.7%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

This image appears to be a traditional painting depicting a ceremonial scene. It shows an interior setting with detailed architecture and vibrant drapery. At the center, there is a decorated area with a red and gold throne-like structure. Various figures are dressed in traditional attire. Some wear long robes, and there is a group of individuals in red garments carrying ornaments. Additionally, there are figures on horseback and some carrying a palanquin. This scene might be representing a formal royal or religious ceremony, given the solemnity and grandeur of the outfits and objects present.

Created by gpt-4 on 2024-11-18

This is a traditional Asian painting, possibly of Chinese origin, illustrating a scene that appears to be a procession or a ceremonial event. The artwork is detailed with architectural elements that suggest a historical setting. There are several groups of figures clad in vibrant traditional attire, engaging in what looks like a festive occasion. Some carry musical instruments, while others hold banners and different objects that might have cultural significance. The color palette is rich, yet slightly faded, indicating the artwork's age, and it’s mounted on a larger piece of fabric or paper, which provides a border for the image.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-27

This appears to be a traditional East Asian painting depicting a ceremonial or formal scene. The image shows multiple figures arranged in what seems to be a procession or formal gathering. There are figures wearing different colored robes - some in blue, others in bright orange-red, and some in green. In the upper portion of the scene, there's a covered area with decorative curtains in purple and green with pink trim. The composition includes what appears to be a palanquin or sedan chair carried by bearers, and several figures carrying ceremonial objects that look like parasols or banners. There's also a red platform or table in the background under the curtained area. The style of the painting suggests it's likely from China, Japan, or Korea, and appears to be depicting a court ceremony or important ritual. The careful attention to the different clothing colors and the formal arrangement of the figures indicates this was likely an important official or ceremonial event being documented. The painting technique uses delicate lines and soft colors on what appears to be paper or silk, which is characteristic of traditional East Asian artistic styles.

Created by claude-3-haiku-20240307 on 2024-11-18

The image depicts a ceremonial scene in a traditional setting. It appears to show a formal procession or parade, with various figures dressed in ornate, colorful costumes and carrying ceremonial objects. The figures are arranged in a structured, symmetrical composition, with a central figure or event surrounded by numerous attendants and onlookers. The overall scene has a vibrant, festive quality, with intricate details and patterns throughout the illustration.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image is a painting of a scene depicting a funeral procession, with a group of people in traditional clothing gathered around a coffin. The coffin is adorned with red and gold decorations, and it appears to be being carried by several individuals. In the background, there are curtains and a window with a green valance, suggesting that the scene is taking place indoors. The overall atmosphere of the painting is one of solemnity and respect, as the mourners are dressed in somber attire and their faces are serious. The use of muted colors such as beige, brown, and gray adds to the somber mood, while the red and gold accents on the coffin provide a touch of elegance and dignity. The painting also features a few other details that add to its interest. For example, there are several objects scattered throughout the scene, including what appears to be a vase or urn on a table in the foreground. Additionally, some of the mourners are holding items such as fans or parasols, which may have been used to shield themselves from the sun or to add a decorative element to the procession. Overall, this painting is a beautiful and thought-provoking depiction of a funeral procession, capturing the emotions and traditions surrounding death in a way that is both respectful and visually striking.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a scene from a traditional Chinese painting, showcasing a gathering of people in a room with a high ceiling and a large window. The room is filled with various objects, including a red couch, a table, and a horse. * **Room:** * The room has a high ceiling and a large window. * The walls are beige, and the floor is made of wood. * There is a red couch in the corner of the room. * A table is placed near the window. * **People:** * There are several people in the room, all dressed in traditional Chinese clothing. * Some of them are standing, while others are sitting or lying down. * One person is riding a horse. * **Objects:** * A red couch is placed in the corner of the room. * A table is placed near the window. * A horse is being ridden by one of the people in the room. * **Overall:** * The image appears to be a traditional Chinese painting, depicting a scene from everyday life. * The use of bright colors and intricate details suggests that the painting is meant to be decorative and visually appealing. The image provides a glimpse into traditional Chinese culture and daily life, showcasing the importance of social gatherings and community in Chinese society.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a traditional Chinese painting depicting a scene from a historical play. The painting is set in a stage-like environment with a backdrop that features a red platform with a red bed, curtains, and a red cloth. The characters are dressed in traditional Chinese attire, with some wearing hats and others holding sticks. They appear to be performing a play, with some characters carrying a golden box and others riding horses. The painting has a beige border and is framed in a white mat.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a painting of a scene with a group of people, likely depicting a traditional ceremony or event. The painting has a vintage style and appears to be on a beige background. The people in the painting are dressed in traditional clothing, with some wearing hats and shoes. There are two individuals on horses, possibly indicating a procession or a significant figure. The setting appears to be indoors, with a stage or platform in the background. The overall atmosphere of the painting suggests a formal or ceremonial occasion.