Human Generated Data

Title

Shah Abbas Receiving Khan Alam in 1618

Date

18th-19th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Nina Bourne, 1984.855

Human Generated Data

Title

Shah Abbas Receiving Khan Alam in 1618

Date

18th-19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Nina Bourne, 1984.855

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Human 99.1
Person 99.1
Person 99
Person 98.9
Person 98.9
Person 98.1
Person 98.1
Person 98
Person 97.7
Person 97.7
Person 97.6
Person 97.3
Person 97.1
Person 97.1
Person 96.6
Person 95.6
Person 95.6
Person 95.5
Person 94.8
Person 94.6
Person 94.1
Person 93.6
Art 89
Painting 86.9
Person 86.5
Person 84.8
Person 84.8
Drawing 66.9
Person 65.1
Advertisement 64.7
Poster 61.1
Furniture 58.9

Clarifai
created on 2019-07-08

illustration 99.8
art 99.4
people 99.2
painting 99.1
child 98.2
man 97.1
adult 96.8
woman 96.7
group 94.4
son 93.1
print 91.8
text 83.2
girl 81.8
family 81
wall 81
kneeling 80.9
baby 80.5
lithograph 80.3
color 79
retro 78.8

Imagga
created on 2019-07-08

comic book 65.9
jigsaw puzzle 46.2
puzzle 37.4
currency 35.9
money 34
cash 29.3
finance 28.7
paper 28.2
game 27.7
print media 26.3
financial 25
wealth 24.2
bank 20.6
economy 19.5
banking 19.3
exchange 19.1
banknote 18.4
business 17.6
art 17.3
bill 16.2
old 16
note 14.7
dollar 13.9
map 13.8
banknotes 13.7
symbol 13.5
pay 12.5
vintage 12.4
envelope 12.2
savings 12.1
investment 11.9
economics 11.7
bills 11.7
geography 11.6
notes 11.5
retro 11.5
mosaic 11.3
travel 11.3
pattern 10.9
global 10.9
world 10.6
profit 10.5
trade 10.5
close 10.3
commerce 10.3
letter 10.1
colorful 10
stamp 9.8
sign 9.8
country 9.7
payment 9.6
used 9.6
mail 9.6
ancient 9.5
color 9.5
culture 9.4
grunge 9.4
rich 9.3
design 9
religion 9
market 8.9
wealthy 8.8
rate 8.8
economic 8.7
hundred 8.7
decoration 8.7
church 8.3
antique 8.3
collection 8.1
success 8
drawing 8
postmark 7.9
foreign 7.9
postage 7.9
ten 7.9
postal 7.9
value 7.8
states 7.7
debt 7.7
change 7.7
texture 7.6
container 7.6
international 7.6
save 7.6
china 7.5
buy 7.5
tourism 7.4
many 7.4
border 7.2

Google
created on 2019-07-08

Painting 92.9
Art 85.9
Illustration 80.4
Miniature 71.3
History 60.4

Microsoft
created on 2019-07-08

painting 98.2
grass 98.1
cartoon 97.6
drawing 93.6
person 90.4
child art 79.9
clothing 78.5
human face 66.4
bedclothes 34.9
fabric 23.5
several 13.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-36
Gender Male, 54.1%
Happy 46.2%
Confused 45.7%
Calm 48%
Surprised 45.7%
Sad 48.7%
Angry 45.5%
Disgusted 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54%
Calm 45.9%
Angry 49.4%
Confused 45.4%
Surprised 45.3%
Disgusted 45.4%
Sad 48.3%
Happy 45.2%

AWS Rekognition

Age 27-44
Gender Male, 54.7%
Disgusted 45.3%
Happy 45.4%
Sad 45.5%
Confused 45.6%
Calm 51.9%
Angry 45.5%
Surprised 45.8%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Angry 45.3%
Calm 52.1%
Disgusted 45.1%
Sad 45.2%
Happy 45.8%
Confused 45.4%
Surprised 46%

AWS Rekognition

Age 26-43
Gender Male, 53%
Disgusted 45.6%
Sad 47.4%
Surprised 46.6%
Calm 49.1%
Angry 45.6%
Confused 45.5%
Happy 45.3%

AWS Rekognition

Age 23-38
Gender Male, 50.6%
Calm 51.5%
Confused 45.3%
Surprised 45.5%
Disgusted 46%
Happy 45.3%
Sad 45.9%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Confused 46%
Happy 46.6%
Disgusted 45.7%
Sad 45.7%
Calm 49.3%
Surprised 45.7%
Angry 46.1%

AWS Rekognition

Age 30-47
Gender Male, 55%
Disgusted 45.1%
Happy 45.1%
Calm 51.8%
Confused 45.7%
Angry 45.5%
Surprised 46.6%
Sad 45.3%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Sad 49.9%
Calm 49.7%
Angry 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.6%
Surprised 49.6%

AWS Rekognition

Age 6-13
Gender Male, 50.2%
Calm 49.9%
Disgusted 49.5%
Surprised 49.6%
Confused 49.6%
Sad 49.6%
Happy 49.6%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Male, 51.9%
Angry 45.8%
Happy 45.2%
Calm 48.3%
Sad 45.2%
Confused 45.7%
Disgusted 46.4%
Surprised 48.4%

AWS Rekognition

Age 35-55
Gender Male, 50.2%
Happy 45.3%
Confused 45.6%
Calm 52%
Disgusted 45.2%
Sad 45.9%
Angry 45.5%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Angry 49.7%
Calm 49.6%
Disgusted 50%
Happy 49.6%
Sad 49.5%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Angry 49.6%
Happy 49.6%
Calm 49.8%
Sad 49.9%
Confused 49.5%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Surprised 49.6%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Calm 49.9%
Disgusted 49.7%
Angry 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Confused 49.6%
Sad 49.8%
Angry 49.7%
Disgusted 49.5%
Surprised 49.6%
Happy 49.5%
Calm 49.7%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Happy 49.7%
Angry 49.5%
Surprised 49.6%
Disgusted 49.9%
Sad 49.6%
Confused 49.6%
Calm 49.6%

AWS Rekognition

Age 26-44
Gender Male, 50.4%
Surprised 49.5%
Happy 49.5%
Calm 50%
Disgusted 49.5%
Sad 49.9%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Confused 49.5%
Calm 50.2%
Angry 49.6%
Sad 49.6%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Happy 49.5%
Angry 49.5%
Sad 50.4%
Calm 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.2%
Surprised 49.5%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Happy 49.6%
Sad 50.1%
Disgusted 49.6%
Angry 49.6%
Surprised 49.6%
Confused 49.5%
Calm 49.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.1%
Person 99%
Person 98.9%
Person 98.9%
Person 98.1%
Person 98.1%
Person 98%
Person 97.7%
Person 97.7%
Person 97.6%
Person 97.3%
Person 97.1%
Person 97.1%
Person 96.6%
Person 95.6%
Person 95.6%
Person 95.5%
Person 94.8%
Person 94.6%
Person 94.1%
Person 93.6%
Person 86.5%
Person 84.8%
Person 84.8%
Person 65.1%
Painting 86.9%

Categories

Imagga

paintings art 99.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man playing chess in a field -100%

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image appears to be a historical painting or illustration, depicting a scene with multiple figures in traditional attire. The attire and style suggest it may be from a specific cultural or historical context, possibly Middle Eastern or South Asian. The figures are shown in a variety of colors and patterns, which indicate a rank or status. The clothing, headgear, and decoration are elaborate and detailed, suggesting a scene of significance, such as a royal court or an important event.

In the foreground, there are individuals sitting on the ground, suggesting a casual gathering or audience, while in the background rows of figures standing upright might indicate a formation of guards or attendants. There is an impression of activity and interaction, as one figure seems to be giving something to another. The ground is rendered in shades of green, which could represent grass, indicating this scene takes place outdoors. The use of color and placement of figures demonstrates attention to composition and hierarchy within the work.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a historical Mughal miniature painting depicting a court scene. The central figure is seated on a decorated carpet and has a turquoise-colored halo around their head, indicating their royal or important status. They are surrounded by courtiers and attendants wearing colorful period clothing including turbans, robes, and tunics in various shades of green, blue, brown, and orange. In the background, there is a line of soldiers or guards standing in formation, carrying what appear to be spears or similar weapons. The overall composition shows a formal court gathering, with the hierarchy clearly depicted through positioning and symbolic elements like the halo. The painting style is characteristic of Mughal art, with fine detail work, rich colors, and a flattened perspective typical of medieval Indian court paintings.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to depict a ceremonial or royal scene. In the center, a figure wearing elaborate, colorful robes and headwear is seated on the ground, surrounded by a large group of people in traditional Middle Eastern or Central Asian attire. The figures in the background are arranged in rows, suggesting they may be members of a court or entourage. The overall scene has a vibrant, ornate quality, with intricate patterns and details in the costumes and surroundings.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image depicts a vibrant and intricate painting, showcasing a scene of regal grandeur. At its center, a majestic figure sits on a richly patterned rug, surrounded by an array of attendants and guards. The central figure is adorned in resplendent attire, featuring a golden robe with blue accents, complemented by a matching turban and a striking blue halo. He holds an orange in his right hand, while his left hand rests on a small, ornate box.

To his left stands a man dressed in green, extending his hands towards the central figure. This gesture may symbolize an offering or a sign of respect. The surrounding attendants are attired in a diverse range of colors, including green, blue, yellow, and orange, adding to the visual splendor of the scene.

Above the central gathering, a line of guards stands at attention, their weapons at the ready. This adds a sense of solemnity and protection to the overall atmosphere. The background of the painting features a serene landscape, with a pale blue sky and a grassy terrain that stretches out behind the figures.

The painting's style is reminiscent of traditional Persian or Indian art, characterized by its use of bold colors, intricate patterns, and detailed depictions of figures and landscapes. The level of detail and craftsmanship evident in the painting suggests that it may be a work of significant cultural or historical importance.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of a gathering of men in traditional attire, with one man seated on a throne-like structure in the center. He is dressed in a gold robe and turban, holding an object in his hand. The surrounding men are seated on the ground, some with their legs crossed, while others stand behind them. In the background, a group of soldiers can be seen standing in formation, holding weapons.

The overall atmosphere of the image suggests a formal or ceremonial gathering, possibly a meeting of nobles or a royal court. The use of vibrant colors and intricate details in the clothing and accessories adds to the sense of luxury and importance. The presence of the soldiers in the background implies that the gathering may be taking place in a time of war or conflict, but the central figure's calm demeanor suggests that the meeting is focused on diplomacy or negotiation rather than military action.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a group of people gathered in a field, possibly for a meeting or an event. Some of them are sitting on the ground, while others are standing. The person in the middle is wearing a crown and holding a piece of paper, perhaps reading or presenting something. Some of the people are holding sticks, while others are holding birds. In the distance, there is a group of people standing in a row, possibly soldiers.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The painting depicts a scene from the Mughal Empire, featuring a central figure seated on a carpet, possibly a king or emperor, surrounded by courtiers and officials. The emperor is dressed in ornate clothing and holds an orange, symbolizing prosperity and wealth. The courtiers are depicted in various poses, some holding falcons, a common symbol of nobility and power in the Mughal era. In the background, a group of soldiers stands in a line, armed with swords and spears, signifying the military strength of the empire. The painting is richly colored and detailed, showcasing the artistic skills of the Mughal period.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

The image is a painting that seems to depict a scene of royalty or nobility, likely from a historical context in the Middle East or Asia. The style suggests a Persian or Mughal influence.

In the center, a man sits on a rug within a circular, light green aura, possibly indicating his elevated status or divinity. He is handing an orange-colored fruit to another man kneeling before him. Surrounding these two figures are other men who are seated or standing, observing the exchange. They are richly dressed in a variety of traditional garments, turbans, and headwear, suggesting varying levels of rank or affiliation.

In the background, a line of soldiers or guards stands at attention, holding rifles. Their uniforms appear uniform in style but vary in color. Some of the men in the foreground are also holding falcons, indicating that falconry may be associated with the scene.

The colors used in the painting are rich and varied, with intricate patterns and details in the clothing and the rug. The overall tone of the image is formal and ceremonial. The backdrop is a simple, unadorned field of light green.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

The image is a detailed miniature painting, likely of Persian or Mughal origin. It depicts a royal scene with several figures arranged in a hierarchical manner. The artwork uses vibrant colors and intricate details, typical of the style.

Key Elements and Composition:

  • Central Figure: A central figure, likely a ruler, is seated on a patterned rug with an elaborate halo around his head. He's the focal point, holding a small yellow object.
  • Surrounding Figures: A group of courtiers and attendants are arranged around the central figure. These figures are in various postures and gestures.
  • Soldiers/Guards: A line of soldiers stand in the background, holding what appear to be long guns or rifles. They are uniform and represent the ruler's power.
  • Figures with Falcons: Two figures hold falcons, indicating hunting or status.
  • Setting: The scene takes place outdoors, on a grassy plain.
  • Color Palette: The color scheme is rich, with reds, blues, greens, and golds dominating. Details are finely rendered with light and shadow.

Possible Narrative:

Based on the composition, the scene might depict:

  • A royal audience or presentation.
  • The giving of a gift or offering.
  • A ceremonial occasion or celebration.

Artistic Style:

The painting style is characterized by:

  • Detailed rendering of figures and objects.
  • Flat perspective with little to no depth.
  • Use of rich colors and decorative patterns.
  • The inclusion of text in Arabic/Persian script indicates a historical or religious context.

Overall, the image is a visually rich and detailed miniature painting with an important historical and artistic significance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a historical or mythological scene, likely from Persian or Islamic miniature art, characterized by its intricate detail and vibrant colors. The central figure, who appears to be a ruler or important dignitary, is seated on a throne-like chair. This figure is adorned with a large, ornate turban and richly decorated clothing, indicating high status.

Surrounding the central figure are several other individuals, some standing and some seated, all dressed in elaborate and colorful attire. These figures seem to be courtiers or advisors, engaging in conversation or presenting something to the central figure. One individual is handing an object, possibly an orange, to the central figure, which might symbolize a gift or tribute.

In the background, there is a large group of soldiers or warriors standing in formation, holding spears or other weapons, suggesting a military presence or a display of power. The scene is set outdoors, with a landscape that includes grassy hills and possibly a river or stream.

The overall composition and the detailed depiction of the figures and their attire suggest a scene of royal or imperial significance, possibly illustrating a historical event, a court gathering, or a moment from an epic or mythological narrative. The use of bright colors and intricate patterns is typical of Persian miniature art, which often depicts scenes from literature, history, and mythology.

Text analysis

Amazon

pys