Human Generated Data

Title

Emperor Akbar and Gosain Jadrup, Folio from the St. Petersburg Muraqqa’

Date

c. 1625-1630

People

-

Classification

Albums

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Grenville L. Winthrop, Class of 1886, 1937.20

Human Generated Data

Title

Emperor Akbar and Gosain Jadrup, Folio from the St. Petersburg Muraqqa’

Date

c. 1625-1630

Classification

Albums

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Grenville L. Winthrop, Class of 1886, 1937.20

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Rug 98.5
Person 97.9
Human 97.9
Person 96.8
Person 92.4
Art 85.6
Quilt 72.7
Painting 66.4
Ornament 61.7
Tapestry 61.7
Person 60.5
Applique 59.2

Clarifai
created on 2018-02-10

art 99
painting 98.4
retro 97.8
antique 96.9
decoration 96.6
illustration 96.3
picture frame 96
vintage 95.9
old 95.4
print 94.6
pattern 93.7
ornate 92.7
paper 92.6
design 92
letter 91.9
ancient 91.8
desktop 90.3
artistic 89.6
exhibition 89.4
scrapbook 88.4

Imagga
created on 2018-02-10

rug 100
furnishing 74.5
covering 50.5
vintage 43
old 40.4
mosaic 40
art 38.4
retro 32
ancient 29.4
frame 26.9
stamp 26.1
antique 26.1
mail 24.9
postmark 23.7
decoration 23.2
grunge 23
postage 22.6
texture 22.2
letter 22
design 21.4
paper 20.4
aged 19.9
postal 19.6
pattern 18.5
ornate 18.3
border 18.1
gold 17.3
post 17.2
transducer 17
printed 16.7
envelope 16.6
shows 15.8
culture 15.4
philately 14.8
museum 14.6
religion 14.4
empty 13.7
blank 13.7
style 13.4
puzzle 13.2
wall 12.8
circa 12.8
card 12.8
decorative 12.5
color 12.2
golden 12
painter 11.8
paintings 11.7
history 11.6
interior 11.5
obsolete 11.5
floral 11.1
global 10.9
masterpiece 10.9
stamps 10.9
painting 10.8
flower 10.8
delivery 10.7
decor 10.6
painted 10.5
unique 10.4
icon 10.3
church 10.2
message 10
paint 10
renaissance 9.8
close 9.7
cutting 9.7
communications 9.6
symbol 9.4
page 9.3
wallpaper 9.2
traditional 9.1
device 9.1
game 9
collection 9
material 8.9
zigzag 8.9
known 8.9
detail 8.9
office 8.8
used 8.6
parchment 8.6
rustic 8.6
ornament 8.6
god 8.6
brown 8.1
closeup 8.1
object 8.1
post mail 7.9
canceled 7.9
fame 7.9
gallery 7.9
leaf 7.8
artist 7.7
palace 7.7
fine 7.6
ornamental 7.6
textile 7.6
canvas 7.6
creation 7.5
sheet 7.5

Google
created on 2018-02-10

picture frame 85.9
art 80.2
painting 79.5
miniature 68.3
artwork 64.9
paint 56.3

Microsoft
created on 2018-02-10

indoor 91.2
painting 86.9
decorated 77.8
painted 27.4
picture frame 14.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-69
Gender Male, 54.8%
Confused 45.6%
Disgusted 45.9%
Angry 45.6%
Surprised 45.8%
Happy 46.3%
Sad 45.6%
Calm 50.3%

AWS Rekognition

Age 30-47
Gender Male, 52.5%
Happy 45.6%
Sad 45.7%
Disgusted 45.5%
Surprised 45.5%
Calm 51.8%
Confused 45.4%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Angry 45.8%
Happy 45.3%
Confused 45.7%
Sad 49%
Surprised 45.6%
Calm 48.1%
Disgusted 45.5%

AWS Rekognition

Age 48-68
Gender Male, 50.7%
Surprised 47.1%
Happy 45.5%
Sad 47.2%
Calm 46.8%
Disgusted 45.5%
Angry 46.9%
Confused 46.1%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Happy 45.3%
Confused 45.6%
Angry 48.9%
Surprised 45.5%
Disgusted 45.8%
Calm 47%
Sad 47%

Feature analysis

Amazon

Rug
Person
Painting
Rug 98.5%
Person 97.9%
Person 96.8%
Person 92.4%
Person 60.5%
Painting 66.4%

Categories

Captions

Microsoft
created on 2018-02-10

a painting on the wall 83.1%
a painting hanging on a wall 81.9%
a painting on a wall 81.8%

Clarifai
created by general-english-image-caption-blip on 2025-05-12

-100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

The image portrays a scene set in front of a small domed structure, possibly a hermitage or hut. It depicts four figures: two sitting on the ground, one of whom is dressed in pink robes, and the other holding a book or document. The other two figures stand nearby, one dressed in green and the other in yellow and orange. The setting suggests a historic or religious context, possibly involving a discussion or teaching session. The scene is surrounded by an intricate border featuring a pattern of ivy leaves and various birds.

Created by gpt-4 on 2024-11-28

This is a colorful illustration that appears to be from a manuscript or a historical text, featuring a detailed border with floral patterns and what looks like small birds in the foliage. The central image depicts three figures near a thatched structure, possibly a hut or cave, which is situated in a serene landscape setting. The figure on the left seems to be standing guard or attending, dressed in vibrant attire. The two figures on the right are in conversation; one is seated inside the structure while the other, wearing a detailed garment, stands at the entrance. The artwork appears to have an Old-World charm, likely representing a scene from a folktale, myth, or historical event from South Asia or the Middle East, given the style of the clothing and architecture. The use of colors, the intricate details in the characters' attire, and the serene setting are characteristic of the miniature painting traditions from these regions.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-26

This is a Mughal miniature painting with an ornate border decorated with grape vines, leaves, and small birds. The main scene depicts several figures at what appears to be a cave or rock shelter. The painting shows what seems to be a meeting or conversation between figures of different social standings, as indicated by their varied clothing styles. One figure is dressed in a pink/white robe and appears to be of higher status, while others are dressed more simply. There's also a figure seated in the cave entrance with minimal clothing, possibly representing an ascetic or holy man. The scene is set against a simple landscape background with hints of trees and sky. The artwork is framed by multiple decorative borders - an outer border with the vine and bird motif, and inner frames in red and gold with intricate patterns. This style of painting is characteristic of Mughal art from India, likely from the 16th or 17th century.

Created by claude-3-haiku-20240307 on 2024-11-27

This image appears to be a miniature painting from an Indian or Persian manuscript. It depicts a scene with several figures in traditional clothing seated and conversing in an outdoor setting. The background is framed by a decorative border of leaves and vines, creating an ornate and visually striking composition. While the image contains human subjects, I will refrain from identifying or naming them, as per the instructions provided.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image is a painting of a scene from Indian history or mythology, featuring a group of men in traditional attire. The central figure, dressed in white and pink, sits on the ground with his right hand raised, while another man, wearing orange and white, stands beside him holding a musical instrument.

To the left, two men are depicted: one standing and the other seated in front of an arched doorway within a stone structure. The background of the painting features a serene landscape with a body of water and trees, set against a blue sky. The artwork is surrounded by a decorative border adorned with leaves and birds, adding to its cultural and historical significance.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-26

The image depicts a painting of four men in traditional Indian attire, set against a backdrop of a stone structure and a serene landscape. The men are dressed in vibrant clothing, with one seated on the ground, another standing, and two others positioned in front of the stone structure.

  • Men in Traditional Indian Attire:
    • The man on the left is wearing a green and yellow outfit, while the man on the right is dressed in a white and pink ensemble.
    • The man in the center is seated on the ground, wearing a pink robe, and the man on the far right is standing, clad in a brown robe.
  • Stone Structure:
    • The stone structure is situated behind the men, featuring an arched entrance and a circular opening.
  • Landscape:
    • In the background, a serene landscape unfolds, complete with trees, a body of water, and a blue sky.
  • Border:
    • The painting is surrounded by a decorative border, adorned with green leaves and birds.

The image showcases a harmonious blend of traditional Indian attire, architecture, and natural beauty, evoking a sense of cultural richness and tranquility.

Google Gemini

Created by gemini-2.0-flash on 2025-05-02

The painting depicts a scene with five figures against the backdrop of a cave and a landscape in the distance. The composition is set within an ornate border of repeating patterns, with vines and birds on the outermost layer and a patterned red band and gold trim closer to the scene itself.

Inside the scene, the cave dominates the left side. A man with a shaved head and minimal clothing sits cross-legged at the entrance of the cave. His posture suggests he may be a religious figure or a sage.

To the right of the cave, a man wearing a patterned pink robe and a turban sits on the ground, seemingly in conversation with the sage. An attendant stands to his right, holding a bird, possibly a falcon, and wearing a long yellow robe and turban.

Two additional figures stand to the left, in front of the cave entrance. The figure closest to the viewer is wearing a brown robe over bare legs and a white apron. The figure behind him is wearing a green cloak.

In the background, a subtle landscape can be seen, with a few trees and a distant view of the horizon. The color palette is soft, with earthy tones dominating the cave and ground, contrasted by the vibrant colors of the figures' garments.

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

Overall Composition:

  • The image is a detailed miniature painting, likely from the Mughal or a related Indian artistic tradition. It is a framed composition with a decorative border.
  • The central scene portrays a group of figures gathered in a landscape.
  • The painting's style is characterized by bright colors, detailed ornamentation, and a combination of portraiture and storytelling.

Central Scene:

  • Setting: The main scene is set outdoors, with a backdrop suggesting a hillside or natural cave. There's a sense of light and space.

  • Figures: Several figures are present. They appear to be engaged in a conversation or a meeting.

    • One figure is sitting in front of the cave.
    • Another figure is sitting on a small mat, appearing to address the other individuals.
    • The rest of the figures are standing, one is holding what appears to be a bird.
    • The figures' clothing suggests royalty or high-status individuals.
  • Color and Details: The artists utilized a vibrant color palette to depict clothing, surroundings, and details.

Frame and Border:

  • The central scene is contained within an elaborate frame. The frame has gold, decorative patterns, and a red accent.
  • The outer border is filled with a detailed pattern of grape vines and birds.

Possible Interpretation:

  • The image likely depicts a historical event, a religious scene, or a scene of social or courtly life. The figures' elaborate clothing suggests their importance.
  • The overall image quality suggests a highly skilled artist or a group of artists, with the level of detail and composition typical of the Mughal tradition.