Human Generated Data

Title

The Ransom

Date

c. 1860

People

Artist: John Everett Millais, British 1829 - 1896

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.539

Human Generated Data

Title

The Ransom

People

Artist: John Everett Millais, British 1829 - 1896

Date

c. 1860

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.539

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Art 100
Painting 100
Person 99.1
Person 97.7
Person 97.1
Adult 97.1
Female 97.1
Woman 97.1
Person 95.5
Person 94.8
Person 93.6
Face 87.7
Head 87.7
Photography 56.9
Portrait 56.9

Clarifai
created on 2023-10-18

people 99.9
art 99.5
painting 99.5
print 99.4
group 99.1
veil 99
woman 98.7
child 98.7
man 98.6
wear 98.3
son 98.3
adult 98.3
lid 97.4
illustration 97.3
baby 96.2
religion 95.5
costume 94.7
dress 93.9
weapon 93.1
flute 92.9

Imagga
created on 2018-12-18

man 29.6
person 23.8
male 23.4
people 22.3
weapon 19.3
gun 19.1
soldier 18.6
old 16
oriental 15.8
military 15.4
art 15.4
mask 14.9
uniform 14.9
culture 14.5
portrait 13.6
costume 13.3
camouflage 13.3
clothing 12.9
face 12.8
dress 12.6
war 12.6
traditional 12.5
adult 12.4
church 12
religion 11.6
guy 11.2
army 10.7
happy 10.6
holy 10.6
saint 10.6
faith 10.5
god 10.5
group 10.5
religious 10.3
protection 10
bible 9.8
lady 9.7
prayer 9.7
child 9.6
couple 9.6
antique 9.5
color 9.5
hat 9.4
leisure 9.1
vintage 9.1
fashion 9
attendant 8.9
warrior 8.8
love 8.7
spiritual 8.6
holiday 8.6
danger 8.2
style 8.2
paint 8.1
equipment 8.1
decoration 8.1
detail 8
colorful 7.9
together 7.9
catholic 7.8
men 7.7
attractive 7.7
cathedral 7.7
outdoors 7.5
figure 7.4
tradition 7.4
covering 7.2
design 7.2
activity 7.2
history 7.2
air gun 7.1
mother 7.1
romantic 7.1
kin 7.1

Google
created on 2018-12-18

Microsoft
created on 2018-12-18

person 98.2
people 69.4
painting 18.9
art 6.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-10
Gender Female, 100%
Sad 100%
Surprised 6.4%
Fear 6%
Confused 1%
Calm 0.2%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 67.4%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 39-47
Gender Male, 54.1%
Calm 95.4%
Surprised 6.7%
Fear 6.5%
Sad 2.3%
Confused 0.5%
Angry 0.4%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98.5%
Calm 69.9%
Fear 16.9%
Surprised 7.3%
Angry 3.8%
Sad 2.9%
Disgusted 2.1%
Happy 1.5%
Confused 0.9%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 90.5%
Surprised 6.7%
Fear 6.2%
Confused 6%
Sad 2.3%
Angry 0.7%
Disgusted 0.5%
Happy 0.2%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Adult 97.1%
Female 97.1%
Woman 97.1%

Categories

Imagga

people portraits 61.8%
events parties 33.5%
pets animals 3.3%

Captions

Azure OpenAI

Created by gpt-4 on 2024-12-13

This is an artwork that features a group of individuals dressed in attire that suggests a historical or renaissance theme. The characters are engaged in what appears to be a social gathering or a moment of interaction. The clothing is quite detailed, with visible textures and various accessories suggesting different social statuses or roles. There are hats with feathers, garments with fur trims, and vibrant colors. A person on the right side of the image is wearing a striped garment with red and blue colors and appears to be holding the hand of another character. Towards the bottom of the image, there are various footwear styles shown, including boots and shoes with buckles, indicative of the era the artist aimed to portray. The style of the drawing is somewhat loose and expressive, giving the impression of a sketch or a painting that captures a candid moment in time.

Created by gpt-4o-2024-05-13 on 2024-12-13

This image appears to be a historical or cultural painting featuring several individuals wearing elaborate and colorful period clothing. Among them, one person is dressed in armor, while another figure wears a fur-trimmed coat. A young person is present, dressed in a pink dress with intricate designs. The setting seems to convey a moment of social interaction or a gathering, and a dog is also depicted near the lower right corner of the image. The background is minimally detailed, keeping the focus on the individuals and their attire.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-13

The image depicts a group of people in historical European attire, possibly from the 16th or 17th century. In the center, there is a young girl standing between two men, one wearing armor and the other a colorful, ornate outfit. The men appear to be interacting with the girl, possibly in a ceremonial or formal context. Around them, there are several other figures, including a man with a beard and a woman in a long dress. The overall scene suggests a formal social gathering or event from that historical period.

Created by claude-3-5-sonnet-20241022 on 2024-12-13

This is a historical watercolor painting depicting a scene with several figures in Renaissance or Tudor-era clothing. The central figure is a young person in a light pink/gray dress with red trim, surrounded by men in various period attire including armor, fine clothing with slashed sleeves, and elaborate hats. One figure wears a striking red beret-style hat and armor, while another is dressed in blue and white striped clothing. The scene appears to show some kind of confrontation or dramatic moment, with the figures arranged in a way that suggests tension or action. The painting style is somewhat loose and atmospheric, with a dark greenish-gray background. The costumes and setting suggest this depicts a scene from either history or literature from around the 16th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-13

The image is a painting by John Singer Sargent, titled 'The Meeting of the Council of the Duchy of Burgundy' (1903). It depicts a scene of a council meeting, likely in the 15th century, showcasing the attire and setting typical of the period. The painting captures the essence of the era's nobility and politics, with Sargent's characteristic attention to detail and realism. **Key Features:** * **Setting:** The scene is set in a grand hall or chamber, characteristic of the nobility's residences during the 15th century. * **Attire:** The figures are dressed in elaborate and ornate clothing, reflecting the wealth and status of the nobility. * **Composition:** The composition is arranged to emphasize the importance of the council meeting, with figures arranged in a semi-circle around a central figure, possibly the leader or host of the council. * **Lighting:** The lighting in the painting is soft and diffused, with a focus on the central figures, creating a sense of drama and importance. * **Color Palette:** The color palette is muted, with shades of brown, beige, and blue dominating the scene, which adds to the sense of formality and gravity. **Symbolism:** * **Council Meeting:** The council meeting itself is a symbol of the power and authority of the nobility, highlighting their role in governing the Duchy of Burgundy. * **Nobility:** The figures in the painting represent the nobility of the Duchy of Burgundy, emphasizing their wealth, status, and influence. * **Duchy of Burgundy:** The painting serves as a representation of the Duchy of Burgundy, highlighting its importance and significance in the 15th century. **Artistic Style:** * **Realism:** The painting is characterized by Sargent's realistic style, which focuses on capturing the details and accuracy of the scene. * **Impressionism:** The soft lighting and muted color palette also reflect Sargent's interest in impressionism, which emphasizes capturing the fleeting moments and effects of light. **Historical Context:** * **15th Century:** The painting is set in the 15th century, a time of significant political and cultural change in Europe. * **Nobility:** The nobility played a crucial role in governing and shaping the Duchy of Burgundy during this period. * **Council Meetings:** Council meetings were an important part of the nobility's governance, allowing them to discuss and decide on matters of state and policy. **Conclusion:** John Singer Sargent's 'The Meeting of the Council of the Duchy of Burgundy' (1903) is a masterful portrayal of a council meeting in the 15th century. The painting captures the essence of the era's nobility and politics, with Sargent's characteristic attention to detail and realism. The scene is set in a grand hall, with figures dressed in elaborate and ornate clothing, reflecting the wealth and status of the nobility. The composition is arranged to emphasize the importance of the council meeting, with figures arranged in a semi-circle around a central figure, possibly the leader or host of the council. The lighting is soft and diffused, with a focus on the central figures, creating a sense of drama and importance. The color palette is muted, with shades of brown, beige, and blue dominating the scene, which adds to the sense of formality and gravity. The painting serves as a representation of the Duchy of Burgundy, highlighting its importance and significance in the 15th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-13

The image depicts a painting of a group of people in historical attire, with the central figure being a man in armor holding a young girl. The man is dressed in a suit of armor, complete with a helmet and a red and black hat. He has a beard and mustache, and his right arm is wrapped around the girl's waist as he holds her close. To the left of the man stands another man wearing a blue and white striped shirt, white pants, and a blue hat. He is holding a brown fur cloak over his left arm. On the right side of the man in armor are three other men, each dressed in different attire. One wears a purple shirt with gold accents, another sports a tan vest with a red and blue striped shirt underneath, and the third is dressed in black. In front of the man in armor stands the young girl, who is wearing a pink dress with a gold belt and blue tights. She has long brown hair and is looking up at the man in armor. The background of the painting is a muted greenish-gray color, which suggests that it may be an indoor setting. Overall, the image appears to be a historical or fantasy-themed painting, possibly depicting a scene from a story or legend.