Human Generated Data

Title

The Pillaging of the Convent of St. Lazare (13 July 1789)

Date

1789

People

Artist: Jean François Janinet, French 1752 - 1814

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Patrice Higonnet, M21315.8

Human Generated Data

Title

The Pillaging of the Convent of St. Lazare (13 July 1789)

People

Artist: Jean François Janinet, French 1752 - 1814

Date

1789

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Patrice Higonnet, M21315.8

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 97.7
Art 97.4
Drawing 94.5
Sketch 78.7

Clarifai
created on 2018-02-09

people 100
group 99.6
many 99.5
print 99.4
adult 98.7
engraving 96.4
administration 96
man 95.7
art 94.8
group together 93.5
leader 92.9
military 92.8
illustration 91.4
cavalry 91.4
lithograph 91.1
vehicle 90.9
soldier 90.1
crowd 90.1
war 89.4
wear 87

Imagga
created on 2018-02-09

architecture 60.1
building 49.6
cathedral 46.2
palace 40.3
church 38.9
university 33.9
old 32.1
religion 29.6
city 29.2
tower 28.7
ancient 27.7
house 26.9
tourism 26.5
structure 24.9
history 24.2
historic 23.9
stone 23.8
landmark 23.5
castle 22.9
travel 22.6
historical 20.7
sky 20.6
wall 19.1
brick 18.4
town 15.8
window 15.6
tourist 15.4
medieval 15.4
facade 15.2
fortress 15.2
monument 15
england 14.3
school 13.2
residence 13.2
urban 13.1
religious 12.2
st 11.7
door 11.4
vintage 10.8
arch 10.7
roof 10.7
skyscraper 10.5
construction 10.3
famous 10.3
street 9.2
fortification 8.9
century 8.8
temple 8.7
faith 8.6
culture 8.6
buildings 8.5
tree 8.5
art 8.5
place 8.4
republic 7.9
antique 7.8
catholic 7.8
dwelling 7.7
windows 7.7
great 7.7
capital 7.6
outdoors 7.5
vacation 7.4
home 7.2
museum 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

building 99.3
old 96.3
outdoor 92.5
drawn 87.5
black 85.2
white 82.3
people 74.5
vintage 54.4
carriage 41.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 11-18
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.6%
Calm 49.6%
Surprised 49.5%
Sad 49.8%
Confused 49.6%
Angry 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.5%
Sad 50%
Calm 49.5%
Happy 49.9%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Happy 45%
Angry 45%
Disgusted 45%
Calm 45%
Sad 54.9%
Surprised 45%
Confused 45%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Disgusted 49.6%
Calm 50.2%
Confused 49.6%
Surprised 49.5%
Sad 49.6%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.3%
Disgusted 50%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.8%
Calm 49.6%

AWS Rekognition

Age 23-38
Gender Male, 50.4%
Sad 49.6%
Calm 50.3%
Confused 49.5%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 4-9
Gender Female, 50.1%
Sad 49.7%
Calm 49.8%
Angry 49.6%
Surprised 49.6%
Confused 49.5%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Confused 49.7%
Surprised 49.6%
Disgusted 49.5%
Happy 49.5%
Sad 49.9%
Calm 49.7%
Angry 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Sad 49.8%
Disgusted 49.6%
Surprised 49.6%
Calm 49.6%
Angry 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 50%
Surprised 49.5%
Disgusted 49.5%
Confused 49.6%
Calm 49.6%
Happy 49.7%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Happy 49.5%
Sad 49.6%
Disgusted 49.6%
Surprised 49.5%
Calm 50.1%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 38-59
Gender Male, 50.3%
Happy 49.5%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.5%
Calm 50.1%
Sad 49.7%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Angry 49.6%
Calm 49.7%
Sad 49.6%
Confused 49.5%
Disgusted 49.6%
Happy 49.9%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.8%
Calm 49.7%
Surprised 49.5%
Sad 49.7%
Confused 49.6%
Angry 49.5%

Feature analysis

Amazon

Person
Painting

Clarifai

Person
Building
Window

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 92.2%

AWS Rekognition

Person 90.2%

AWS Rekognition

Person 88.6%

AWS Rekognition

Person 87.6%

AWS Rekognition

Person 86.8%

AWS Rekognition

Person 84.7%

AWS Rekognition

Person 81.1%

AWS Rekognition

Person 76.1%

AWS Rekognition

Person 47.3%

AWS Rekognition

Painting 93.7%

Clarifai

Person 83.7%

Clarifai

Person 49.4%

Clarifai

Person 48.5%

Clarifai

Person 46.3%

Clarifai

Person 44.4%

Clarifai

Person 43.9%

Clarifai

Person 38.1%

Clarifai

Person 38%

Clarifai

Person 34.4%

Clarifai

Person 34.3%

Clarifai

Person 33.9%

Clarifai

Building 77.4%

Clarifai

Building 45.3%

Clarifai

Building 40.4%

Clarifai

Window 41%

Clarifai

Window 37.5%

Clarifai

Window 33.6%

Categories

Imagga
created on 2018-02-09

streetview architecture 100%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-29

the massacre of the guillotine, 1793

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a drawing of a man in a suit and tie

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image depicts a tumultuous and violent scene in front of a large, ornate building, with an arched doorway prominently featured. The crowd appears chaotic, with individuals engaging in confrontations, brandishing weapons, and one figure lying on the ground, seemingly injured or dead. The architecture and clothing style suggest a historical context, possibly from the 18th or 19th century. The building has a pediment and several arched windows, adding to its imposing appearance. In the background, another building can be seen, and someone is gesturing from an upper window. The scene conveys a sense of unrest and disorder.

Created by gpt-4 on 2024-11-28

This is an etching or engraving depicting a historical scene outside of a large building with classical architecture. The building features arched doorways and windows, decorative sculptural elements, and a triangular pediment at the top, which is typical of neoclassical or classical architectural styles.

A dramatic scene unfolds in the foreground where a number of individuals appear to exhibit a range of intense activities and emotions. Some are lying on the ground in apparent distress, while others are engaged in physical confrontations or seem to be assisting the fallen individuals. There is a sense of chaos and turmoil visible in the gathering of the participants. The clothing and setting suggest this is likely a depiction of an event from a bygone era, perhaps a riot, revolution, or another significant historical incident.

The sky is rendered with cloudy patches that suggest a somber or tumultuous atmosphere, which complements the serious tone conveyed by the events occurring below. The scene is grim and filled with urgency, perhaps capturing a pivotal moment of conflict or crisis.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a historical illustration depicting a violent scene outside what looks like a prison or institutional building. The architecture shows a large facade with arched windows and a gated entrance. A crowd of people is shown in conflict - some appear to be rioting or fighting while others have fallen to the ground. The style suggests this is likely from the 18th or early 19th century, rendered in black and white or sepia tones. The dramatic sky and architectural details create a somber, threatening atmosphere that matches the chaotic scene below. The image captures what appears to be a moment of civil unrest or uprising against an institution.

Created by claude-3-5-sonnet-20241022 on 2024-12-26

This appears to be a historical illustration depicting a violent scene taking place outside what looks like a prison or institutional building. The architecture shows a large arched entrance with a grated door and classical styling. A crowd of people is shown in various states of conflict or combat in front of the building. The scene appears chaotic, with some figures wielding weapons or tools, while others are shown fallen on the ground. The artwork is rendered in a monochromatic style, possibly an engraving or similar print medium from what appears to be the 18th or early 19th century. The sky shows dramatic clouds, adding to the turbulent atmosphere of the scene. Given the style and content, this might be depicting a historical riot, prison break, or revolutionary action.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a chaotic scene of a large crowd gathered outside of what appears to be a public building or government structure. The crowd is engaged in some form of unrest or conflict, with many figures shown in various states of confrontation or struggle. The building has an ornate architectural style with columned entryways and decorative elements. The sky in the background appears overcast, adding to the somber and dramatic tone of the scene. Overall, the image conveys a sense of social upheaval and unrest taking place in an urban setting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

The image is a black-and-white drawing of a chaotic scene in front of a building. The building has a large arched doorway and several windows, with people gathered around it. Some individuals are fighting, while others appear to be fleeing or trying to intervene. In the foreground, there is a person lying on the ground, possibly injured or dead.

The atmosphere of the image suggests a sense of violence and disorder, with people in various states of distress or conflict. The drawing style is detailed and expressive, conveying a sense of drama and tension. Overall, the image depicts a dramatic and intense scene, likely from a historical or fictional context.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-25

The image depicts a scene of chaos and violence in front of a large building, possibly a church or government building. The scene is set in the 18th century, with people dressed in period clothing and armed with various weapons such as swords, clubs, and pitchforks.

In the foreground, a group of people are engaged in a violent struggle, with some lying on the ground and others fighting in the air. A man in a long coat and hat is standing in the center of the scene, holding a sword and appearing to be in charge of the group. He is surrounded by several other men, who are also armed and appear to be fighting.

To the left of the main group, a man is standing on a balcony, holding a cross and looking down at the scene below. He appears to be a religious figure, possibly a priest or monk, and may be trying to intervene in the violence.

In the background, the large building looms, its facade adorned with columns and arches. The sky above is cloudy and dark, adding to the sense of foreboding and tension in the scene.

Overall, the image suggests a dramatic and intense moment in history, possibly a riot or rebellion. The use of muted colors and the focus on the violence in the foreground create a sense of urgency and drama, drawing the viewer's attention to the central action of the scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-25

The image depicts a dramatic scene of a group of people storming a building, which appears to be a prison, in a black-and-white etching style. The building has a classical architectural design, with a grand entrance and multiple windows. Some of the windows have bars, indicating the building's function as a prison. In the foreground, a large crowd of people is engaged in a chaotic struggle, with some individuals wielding weapons and others appearing to be in distress. The scene conveys a sense of urgency and turmoil, with the crowd's movements and expressions suggesting a sense of desperation and determination. The sky in the background is cloudy, adding to the somber and intense atmosphere of the image.

Created by amazon.nova-pro-v1:0 on 2025-02-25

The image depicts a chaotic scene in front of a building, possibly a prison. The scene is filled with people, some of whom are holding weapons, and it appears that a fight is taking place. Some individuals are lying on the ground, and others are standing or walking around. The building in the background has a large entrance with a gate, and there are windows on the sides.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The print depicts a violent mob scene outside a large building, likely a church or monastery, with an arched gateway. In the foreground, several men are engaged in a physical altercation. Some are being attacked, with at least two lying injured or dead on the ground. The crowd is armed with various objects, including clubs, axes, and what appears to be a chair being used as a weapon.

To the left of the gateway, a man is standing on a balcony, holding a large, ornate chair above his head, possibly ready to throw it. In a window of the building to the right, a person is seen hanging out of the window.

The architectural style of the buildings suggests a European setting, and the clothing of the individuals indicates a period of social or political unrest. The overall atmosphere is chaotic and violent.

Created by gemini-2.0-flash-lite on 2025-04-27

This image is a monochrome illustration depicting a chaotic scene, possibly a historical event. Here's a breakdown:

Overall Composition:

  • The image is dominated by a large building, likely a governmental or religious structure, as suggested by the arched entrance, architectural details, and the presence of figures in ecclesiastical robes.
  • The scene takes place outdoors, with a gathering of people involved in violent activity, most likely a protest or riot.

Details:

  • Building: The building has a large arched entrance with a barred gate, suggesting confinement or protection. There are multiple windows and decorative elements on the facade.
  • People: A large crowd is gathered in front of the building, some are in the midst of fighting, others carrying what appear to be weapons like axes, and others holding or supporting wounded individuals. The clothing suggests an earlier historical period.
  • Action: The illustration appears to depict a moment of violence, possibly a clash between protesters and authorities or a mob attacking a building. The presence of fallen figures on the ground, some of whom are clearly injured or dead, confirms the violent nature of the scene.
  • Atmosphere: The overall tone is dark and dramatic, with the use of light and shadow adding to the sense of urgency.
  • Figure in Window: In one window, a figure looks down upon the events.
  • Figure on the building: there's a figure on the left with a raised weapon.

Possible Interpretation:

Based on the architectural style, clothing, and the chaotic scene, this image could represent a depiction of a historical event. Given the violent nature of the scene, it's a visual record of a historical moment involving conflict or unrest.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-27

The image depicts a historical scene of a violent confrontation in front of a large, imposing building. The architectural style of the building suggests it is from the 18th or early 19th century, possibly European.

In the foreground, a chaotic and violent scene unfolds. A group of people, some of whom appear to be armed with weapons such as swords and pikes, are engaged in a struggle. Several individuals are seen lying on the ground, presumably injured or killed. The expressions and postures of the people suggest a state of intense conflict and panic.

The building itself is grand, with classical architectural features such as columns and decorative elements above the entrance. There is a figure hanging from a lamppost on the left side of the image, indicating a possible execution or public display of punishment.

The overall mood of the image is dark and tumultuous, capturing a moment of significant unrest and violence. This scene could be representative of a historical event such as a revolution, riot, or uprising.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image depicts a dramatic and chaotic scene, likely from a historical event. It features a large building, which appears to be a church or a similar institution, with a notable triangular pediment on the top. The architecture suggests it is from a period that could be the 18th or 19th century, possibly influenced by classical design elements.

In the foreground, a group of people are engaged in what seems to be a violent confrontation. Some individuals are raising weapons or flags, while others appear to be in defensive postures. The scene is tumultuous, with several people lying on the ground, possibly injured or dead, adding to the intensity of the moment.

The sky is filled with dark, ominous clouds, contributing to the overall dramatic and somber mood of the image. Additionally, there are two figures in the window of a building to the right, one of whom appears to be observing the scene below. The style of the drawing is detailed and suggests it could be a historical illustration or engraving.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This is a black and white illustration depicting a chaotic scene outside a large building, likely a church or a similar structure. The building has multiple arched windows and a prominent door, with a statue on the left side. The sky is filled with dark clouds, adding to the tense atmosphere.

In front of the building, there is a group of people engaged in what appears to be a violent altercation. Some individuals are lying on the ground, possibly injured or dead, while others are actively involved in the conflict, with some wielding weapons like axes. The people are dressed in various styles of clothing, suggesting a diverse group. The overall scene conveys a sense of disorder and unrest.