Human Generated Data

Title

Meghamallar Ragini (painting, recto), from a Ragamala (Garland of Melodies) Series

Date

early 17th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift in gratitude to John Coolidge, Gift of Leslie Cheek, Jr., Anonymous Fund in memory of Henry Berg, Louise Haskell Daly, Alpheus Hyatt, Richard Norton Memorial Funds and through the generosity of Albert H. Gordon and Emily Rauh Pulitzer; formerly in the collection of Stuart Cary Welch, Jr., 1995.73

Human Generated Data

Title

Meghamallar Ragini (painting, recto), from a Ragamala (Garland of Melodies) Series

Date

early 17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift in gratitude to John Coolidge, Gift of Leslie Cheek, Jr., Anonymous Fund in memory of Henry Berg, Louise Haskell Daly, Alpheus Hyatt, Richard Norton Memorial Funds and through the generosity of Albert H. Gordon and Emily Rauh Pulitzer; formerly in the collection of Stuart Cary Welch, Jr., 1995.73

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Human 96.6
Art 94.3
Animal 91.9
Ornament 91.7
Tapestry 91.7
Worship 69.6
Building 64.1
Architecture 64.1
Temple 58.9
Shrine 58.9
Painting 58.6
Tile 56.9
Mosaic 56.6
Mural 55.2

Clarifai
created on 2019-05-22

art 99.3
painting 98.9
old 98.4
ancient 97.9
antique 97.6
illustration 97
religion 96.6
print 96.3
vintage 95.6
people 94.7
culture 94.4
symbol 93.8
retro 93.1
manuscript 92.9
decoration 91.9
god 90.8
paper 87.8
traditional 86.5
crown 85.1
collection 83.5

Imagga
created on 2019-05-22

prayer rug 42.6
art 38.9
rug 35.9
mosaic 33.7
vintage 30.6
old 29.3
furnishing 26.2
floor cover 25.7
antique 25.3
retro 23.8
covering 22.6
pattern 22.6
texture 20.8
design 20
religion 19.7
ancient 19
stamp 18.4
decoration 18
pillow 17.6
traditional 17.5
transducer 17.2
gold 16.4
mail 16.3
grunge 16.2
postmark 15.8
frame 14.5
post 14.3
cushion 14.2
color 13.9
church 13.9
postage 13.8
letter 13.8
postal 13.7
wall 13.7
culture 13.7
paper 13.3
artistic 13
electrical device 12.9
style 12.6
fabric 12.6
painted 12.4
travel 12
floral 11.1
architecture 10.9
paint 10.9
painting 10.8
padding 10.7
embroidery 10.6
detail 10.5
oriental 10.4
artwork 10.1
decorative 10
printed 9.8
temple 9.7
symbol 9.4
religious 9.4
colorful 9.3
yellow 9.3
window 9.2
map 9.2
flower 9.2
ornate 9.1
tourism 9.1
aged 9
history 8.9
canceled 8.9
stamps 8.9
tray 8.9
colors 8.8
icon 8.7
door 8.7
used 8.6
ornament 8.6
device 8.6
leaf 8.6
unique 8.5
envelope 8.4
border 8.1
collection 8.1
container 8
wallpaper 7.7
card 7.7
east 7.5
historic 7.3
object 7.3
graphic 7.3
receptacle 7.2
painter 7.2
modern 7

Google
created on 2019-05-22

Painting 95.3
Art 91.9
Textile 77.8
Miniature 74.8
Tapestry 72.9
History 71.8
Modern art 51.9
Illustration 50.4

Microsoft
created on 2019-05-22

drawing 93.7
cartoon 92.1
illustration 87.1
book 81.7
child art 57.7
poster 52.7
flower 51
colorful 42.6
fabric 34.2
painting 15.2
picture frame 13.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Calm 47.5%
Surprised 45.6%
Angry 47.4%
Sad 47.2%
Disgusted 45.3%
Happy 46.5%
Confused 45.5%

AWS Rekognition

Age 23-38
Gender Female, 51.8%
Happy 45.5%
Sad 45.7%
Calm 51%
Disgusted 45.4%
Confused 45.2%
Angry 45.5%
Surprised 46.7%

AWS Rekognition

Age 16-27
Gender Male, 53.4%
Happy 46.8%
Sad 45.6%
Disgusted 46.1%
Calm 46.3%
Confused 45.6%
Angry 46.4%
Surprised 48.1%

Feature analysis

Amazon

Person
Bird

Clarifai

Picture frame
Clothing
Tree
Human face
Person

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 81.2%

AWS Rekognition

Person 58.6%

AWS Rekognition

Bird 91.9%

Clarifai

Picture frame 88%

Clarifai

Clothing 86.5%

Clarifai

Clothing 85.4%

Clarifai

Clothing 78%

Clarifai

Clothing 33.9%

Clarifai

Tree 57%

Clarifai

Tree 56.8%

Clarifai

Human face 48.3%

Clarifai

Human face 40.8%

Clarifai

Human face 39.4%

Clarifai

Person 39.3%

Clarifai

Person 38%

Categories

Imagga
created on 2019-05-22

paintings art 98.5%
interior objects 1.4%

Captions

Microsoft
created by unknown on 2019-05-22

a colorful rug 46%
a close up of a colorful rug 45.9%
close up of a colorful rug 40.5%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man and woman in a garden

Created by general-english-image-caption-blip-2 on 2025-06-27

an indian painting depicting the god and his wife

OpenAI GPT

Created by gpt-4 on 2024-12-03

This image is a traditional painting featuring two figures clad in detailed, colorful attire, suggestive of historical or mythological significance. These figures are probably characters from a story or legend, given the stylized presentation. They stand against a backdrop of a lush landscape with two trees filled with blossoms and a dark blue sky. Birds, possibly cranes or herons, are perched on the trees and soaring above them. The border of the painting is red with some ornamentation and the overall aesthetic suggests that it may be a piece of folk art or a painting with cultural or religious significance. The palette is rich with reds, yellows, greens, and blues, and the artistry is characterized by intricate patterns and bold outlines.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This is a traditional Indian miniature painting with a vibrant red border. The scene depicts three figures in ornate clothing and jewelry standing beneath trees in a garden or forest setting. The central figure wears yellow and red garments and holds what appears to be a staff or scepter. The figures on either side wear complementary colors of yellow and red.

The background features two stylized trees - one with circular, multicolored foliage on the left, and another with green leaves and pink flowers on the right. White birds, possibly cranes or swans, are shown flying in the dark blue sky above. The overall composition uses rich colors typical of Indian miniature paintings, including reds, yellows, greens, and blues.

The painting style is characteristic of medieval Indian art, with its flat perspective, decorative elements, and attention to ornamental details in the clothing and natural elements. The scene likely depicts a moment from an Indian epic or religious story, given the formal composition and the elaborate dress of the figures.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a vibrant and intricate painting depicting a lush, fantastical landscape. In the center, there are several human figures dressed in ornate, colorful clothing. They seem to be engaged in some kind of ceremonial or ritual activity, possibly in a garden or natural setting. The background features a variety of stylized trees, plants, and other natural elements, all rendered in a rich, decorative style. The overall composition is highly detailed and visually striking, with a strong sense of narrative and symbolic meaning.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a vibrant painting of a man and two women in an outdoor setting, surrounded by lush greenery and colorful flowers. The man, positioned centrally, wears a red and yellow outfit adorned with intricate designs and accessories, including a crown on his head. He holds a staff in his right hand and appears to be dancing or moving towards the woman on the right.

The woman on the left is dressed in a red and yellow sari, while the woman on the right wears a yellow and red sari. Both women are engaged in conversation with the man, adding to the dynamic atmosphere of the scene. In the background, several trees and bushes are visible, along with a few birds flying overhead. The overall mood of the painting is one of joy and celebration, capturing a moment of happiness and connection between the three figures.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a painting of a man and two women in traditional Indian attire, set against a backdrop of trees, flowers, and birds. The man is positioned in the center, wearing a yellow turban and a red and white outfit, while the two women are dressed in yellow and red saris. The scene is framed by a red border, with a blue sky and clouds above.

The painting appears to be an illustration from a book or manuscript, possibly from the 18th or 19th century. The style and technique used in the painting suggest that it may have been created by an Indian artist during this period.

The image conveys a sense of elegance and refinement, with the intricate details and vibrant colors used in the painting. The composition of the scene is well-balanced, with the figures arranged in a harmonious manner.

Overall, the image presents a beautiful and captivating representation of Indian art and culture, showcasing the skill and craftsmanship of the artist who created it.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a painting that depicts a scene of Krishna with two women, possibly Radha and another gopi, in a lush green garden. The painting has a red border and is framed. The background is a blue sky with white clouds, and there are two large trees with red and yellow flowers. The two women are dressed in traditional Indian clothing, and one of them is holding a fan. The painting has a vintage look and is likely an old piece of art.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image shows a painting of a scene with three people and two trees. The people are wearing traditional clothing. The person in the middle is holding a stick with a flower on it. The person on the left is holding a flower, and the person on the right is holding a flower. The trees have flowers and fruits. There are birds on the trees and in the sky.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

Here is a description of the image:

The painting depicts a traditional Indian scene with three figures, set against a landscape with trees and birds. The entire painting is framed by a red border.

In the center stands a man, adorned with a golden crown and jewelry. He is dressed in red pants and a tunic, with a sheer, flowing cape. His expression is contemplative as he holds a small flower in his right hand.

To his left, a woman in a yellow gown and red top holds a fan or book. She is also adorned with jewelry. To the right of the man, another woman is seated, wearing a yellow and red dress, playing a drum that rests in her lap.

The background features two trees with dense foliage and white birds perched in their branches. Above the trees is a cloudy sky, with more white birds flying in formation, set against mountains. The overall style of the painting is intricate and colorful, typical of Indian miniature paintings.

Created by gemini-2.0-flash-lite on 2025-04-27

This is a traditional Indian miniature painting. The scene features a central male figure, likely royalty, in a striking orange and red outfit, with a yellow cape and headdress. He is flanked by two female figures, one holding a book or fan, the other playing a drum. The background is rich with detail: two flowering trees, white birds, a dark sky suggestive of rain, and a field dotted with flowers. The painting is framed with a red border, a common element in this art style. The overall style is vibrant and colorful, employing traditional techniques and symbolism, characteristic of Indian miniature painting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a traditional Indian miniature painting, likely from the Pahari or Rajasthani school of art, known for their intricate and detailed work. The scene portrays a divine or royal figure, possibly a deity or a king, standing in the center. This central figure is adorned with rich attire, including a crown, jewelry, and elaborate clothing, indicating high status.

Surrounding the central figure are two female attendants or consorts, dressed in vibrant, traditional garments. They appear to be in a gesture of reverence or service, holding objects that might be offerings or symbols of their devotion.

The background features lush, stylized trees with abundant foliage and fruit, suggesting a garden or forest setting. Birds, possibly peacocks, are perched on the trees, adding to the natural and serene ambiance of the scene. The sky above is dark, indicating either nighttime or an impending storm, which contrasts with the vivid colors of the figures and the landscape.

The painting is framed with a red border, which is typical of many Indian miniature paintings, providing a distinct boundary to the artwork. The overall composition and detailing reflect the rich cultural and artistic heritage of Indian miniature painting.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-26

This image is a traditional Indian miniature painting, likely from the Mughal or Rajput style, depicting a scene that appears to be from Hindu mythology or folklore. The painting is framed with a red border and has a dark green background with a tree on each side. The tree on the left is adorned with red flowers, while the one on the right has pink blossoms and birds perched on its branches.

In the center of the painting, there is a male figure dressed in elaborate attire, possibly representing a deity or a king. He is adorned with a crown and jewelry and is holding a staff or scepter. To his left, there is a woman who appears to be presenting him with an offering, possibly a flower. She is also dressed in traditional attire with jewelry. To the right of the central figure, another woman is seated, possibly in a contemplative or reverent pose, also dressed in traditional attire with jewelry.

The painting is rich in color and detail, with intricate patterns on the clothing and the trees, and it conveys a sense of reverence and ritualistic significance. The overall composition and style are characteristic of traditional Indian miniature paintings, which often depict scenes from mythology, courtly life, or nature.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-26

This image is a traditional Indian miniature painting, likely depicting a scene from Indian mythology or folklore. It features three figures in ornate, elaborate attire, suggesting they are of significant status, possibly deities or royal figures. The central figure, possibly a king or deity, is standing and holding a staff, with a crown and a headdress adorned with jewels. The two figures on either side, a woman and another person, appear to be attending or serving the central figure.

The background includes trees with vibrant foliage and flowers, and a backdrop of a dark sky with several birds, including swans. The trees are detailed with different colored leaves and blossoms, adding to the richness of the scene. The painting is framed in a red border, which is typical of this style of art. The overall color palette is bright and vivid, with a mixture of greens, reds, yellows, and blues, creating a lively and dynamic composition.