Human Generated Data

Title

The Duel

Date

19th century

People

Artist: Louis-Gabriel-Eugène Isabey, French 1803 - 1886

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles K. Lock, 1978.574

Human Generated Data

Title

The Duel

People

Artist: Louis-Gabriel-Eugène Isabey, French 1803 - 1886

Date

19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles K. Lock, 1978.574

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 96.3
Tower 96.3
Steeple 96.3
Spire 96.3
Architecture 96.3
Building 96.3
Human 93.1
Urban 83.2
City 83.2
Street 83.2
Road 83.2
Town 83.2
Alley 57
Alleyway 57
Church 55.6
Drawing 55.3

Clarifai
created on 2020-04-24

people 99.9
group together 98.9
group 98.7
two 97.7
man 96.7
three 96.6
street 95.1
many 94.5
adult 94
four 93.8
home 93.4
child 92.4
vehicle 90.9
military 90.7
several 90.4
soldier 90.3
wear 90.2
art 88.8
war 88.1
one 87.3

Imagga
created on 2020-04-24

old 44.6
door 36.1
wall 31.2
device 30.2
architecture 29.5
building 28.5
guillotine 25.4
latch 24.2
house 23.4
instrument of execution 22.7
window 22
texture 20.8
ancient 20.8
stone 20.5
wood 20
fastener 20
aged 19.9
catch 18.4
dirty 18.1
vintage 17.4
grunge 17
instrument 16.4
structure 16.2
detail 16.1
wooden 15.8
weathered 15.2
home 15.2
city 15
antique 14.7
restraint 13.7
brick 13.4
street 12.9
construction 12.8
travel 12.7
structural member 12.6
frame 12.5
rough 11.9
entrance 11.6
rust 11.6
textured 11.4
town 11.1
exterior 11.1
historic 11
support 10.9
history 10.7
design 10.7
rusty 10.5
metal 10.5
upright 10
abandoned 9.8
art 9.8
broken 9.6
pattern 9.6
lock 9.6
color 9.5
black 9
retro 9
rural 8.8
ruin 8.8
messy 8.7
obsolete 8.6
grungy 8.5
box 8.4
traditional 8.3
paint 8.1
country 7.9
doorway 7.9
empty 7.7
closed 7.7
architectural 7.7
village 7.7
windows 7.7
medieval 7.7
painted 7.6
damaged 7.6
iron 7.5
jamb 7.4
tourism 7.4
brown 7.4
mailbox 7.3
fence 7.2
glass 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 99.5
drawing 97.1
painting 96.1
sketch 87.2
old 64.2
black and white 61.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-52
Gender Male, 50.1%
Confused 49.6%
Surprised 49.5%
Fear 49.5%
Angry 49.5%
Happy 49.6%
Sad 50.1%
Disgusted 49.5%
Calm 49.6%

AWS Rekognition

Age 26-42
Gender Male, 50.2%
Calm 49.5%
Confused 49.5%
Angry 49.9%
Happy 49.5%
Fear 49.7%
Disgusted 49.5%
Surprised 49.7%
Sad 49.6%

Feature analysis

Amazon

Painting
Person

Clarifai

Person
Building
Human face

AWS Rekognition

Painting 96.3%

AWS Rekognition

Person 93.1%

AWS Rekognition

Person 92.6%

AWS Rekognition

Person 92%

AWS Rekognition

Person 85%

AWS Rekognition

Person 65%

AWS Rekognition

Person 64%

AWS Rekognition

Person 54.6%

Clarifai

Person 66.4%

Clarifai

Person 62.4%

Clarifai

Person 58.3%

Clarifai

Person 57%

Clarifai

Person 55.3%

Clarifai

Person 46.3%

Clarifai

Person 40.3%

Clarifai

Person 38.7%

Clarifai

Person 36.8%

Clarifai

Building 62%

Clarifai

Building 48.9%

Clarifai

Human face 36%

Categories

Imagga
created on 2020-04-24

streetview architecture 99.9%

Captions

Microsoft
created by unknown on 2020-04-24

an old photo of a building 60.1%
an old photo of a person 51.4%
an old photo of a person 48.6%

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a city street

Created by general-english-image-caption-blip-2 on 2025-06-27

a black and white photo of a street scene with people walking around

OpenAI GPT

Created by gpt-4 on 2024-12-04

The image depicts a monochromatic drawing or painting of a European-style medieval town scene. It is set within what appears to be a cobblestone square flanked by old, slightly dilapidated buildings. A dominant building with a high steeple or tower rises in the background, possibly a church or town hall, which is a common feature in many European old town squares.

In the foreground, there seems to be a group of men dressed in period attire that includes what could be capes, tights, and hats with feathers, typical of 16th or 17th-century European fashion. They are involved in some kind of physical activity, possibly a dance or a form of entertainment. The expressive poses suggest movement and interaction.

The surrounding architecture is rich in detail, with arches, windows, and what looks like a balcony or an overhang of a building with a person leaning out to observe the scene below. The light source is high and diffused, casting soft shadows and contributing to the moody atmosphere of the scene.

The image is presented within a frame, with the top right corner slightly lifted, as if it were a print or a photograph that someone has placed on a surface for examination. The medium of the artwork could be charcoal, ink, or a similar medium conducive to varied gradations of shading and detail.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-27

This appears to be a black and white painting or artwork depicting a dramatic street scene in what looks like a medieval or Renaissance-era European town. The scene shows several figures engaged in what appears to be a sword fight or confrontation in a narrow street or alley. The architecture features a prominent church or building with a tall spire or bell tower in the background. The buildings have a Gothic architectural style with steep roofs and narrow passages between them. The composition creates a sense of tension and drama, with the figures positioned dynamically in the foreground while the tall spire looms above. The lighting in the painting creates strong contrasts between light and shadow, adding to the dramatic atmosphere of the scene.

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a black and white painting or artwork depicting a dramatic street scene in what looks like a medieval or Renaissance-era European city. The composition shows a narrow street with tall buildings and a prominent church or chapel with a spired tower in the background. In the foreground, there appears to be some kind of conflict or action scene with several figures engaged in what looks like a sword fight or skirmish. The architecture has a distinctly Gothic feel, with steep roofs and the characteristic church spire dominating the skyline. The lighting in the painting creates strong contrasts between light and shadow, adding to the dramatic atmosphere of the scene. The cobblestone street and the architectural details suggest this is set in an old European city, possibly during the 16th or 17th century.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a black and white painting or sketch depicting a medieval or historical European town scene. The focal point is a tall church spire or tower rising up in the background, surrounded by older, weathered buildings. In the foreground, there are several figures, possibly townspeople or soldiers, engaged in some kind of activity or interaction against the backdrop of the town's architecture. The overall mood of the image is quite moody and atmospheric, with a sense of drama or narrative unfolding within the scene.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

This image is a black-and-white photograph of a painting depicting a scene from the 17th century. The painting features a group of men in period attire, including hats and cloaks, gathered in front of a large stone building with a tall tower. The men appear to be engaged in conversation or possibly preparing for battle, as some are holding swords or other weapons.

The background of the painting shows a cloudy sky and additional buildings, suggesting a bustling urban environment. The overall atmosphere of the painting is one of tension and anticipation, as if the men are preparing for some kind of confrontation or event.

The photograph itself appears to be an old print, with visible signs of aging such as scratches and fading. It is likely that the photograph was taken many years ago, and has been preserved as a historical record of the painting.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a black-and-white painting of a street scene with people and buildings. The painting is in a vertical orientation, with a white border around it.

In the foreground, there are several people dressed in old-fashioned clothing, some of whom appear to be engaged in activities such as fighting or running. The background features a tall, pointed building with a clock tower, as well as other structures that appear to be part of a city or town.

The overall atmosphere of the painting suggests a sense of drama and tension, with the dark colors and dynamic composition creating a sense of energy and movement. The use of chiaroscuro, a technique that emphasizes contrasts between light and dark, adds depth and dimensionality to the scene.

The painting appears to be a study or sketch, rather than a finished work of art. The rough texture and visible brushstrokes suggest that it was created quickly, perhaps as a way to capture a moment or idea rather than to create a polished piece of art.

Overall, the image presents a vivid and engaging scene that invites the viewer to explore the details and story behind it.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a black-and-white drawing of a street scene, possibly from a historical or artistic context. The drawing features a group of people engaged in what appears to be a fight or altercation. Some individuals are standing, while others are seated on the ground, indicating a chaotic and intense situation. In the background, there is a building with a tower, possibly a church or a historical structure, adding to the setting's historical or cultural significance. The overall mood of the drawing is dramatic and intense, with a sense of conflict and tension.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a black-and-white painting of a street scene with several people in it. The painting is framed in a white border. The street is narrow, with a few people standing and sitting on the sides. On the left side, there are buildings with many windows and a tower in the distance. On the right side, there is a building with a balcony and a staircase.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image appears to be a black and white photograph of a painting. The painting depicts a dark, narrow street in what seems like a historical European town or city. The buildings are old, with varying heights and architectural styles.

In the foreground, there are several men, possibly engaged in some kind of conflict or chase. They are dressed in attire reminiscent of an earlier period, such as the 17th or 18th century. One man is on the ground, possibly injured or captured.

The street is paved with cobblestones, adding to the historical atmosphere. The lighting is dim and dramatic, with stark contrasts between light and shadow, which enhances the sense of intrigue and tension.

In the background, a tall church or cathedral tower rises above the other buildings, providing a focal point and a sense of grandeur to the scene. The sky is overcast, contributing to the overall somber mood of the painting.

Created by gemini-2.0-flash-lite on 2025-04-27

This is a black and white painting or illustration depicting a dramatic scene in a medieval or early modern European city. Here's a breakdown:

Setting:

  • Medieval/Early Modern City: The architecture, with its narrow streets, tall, gabled buildings, and a prominent church steeple in the background, is characteristic of a historical European town.
  • Dark and Atmospheric: The overall tone is somber, with deep shadows and a sense of foreboding. The lighting suggests a cloudy day or approaching night.

Figures:

  • A Group of Men in Action: Several men are positioned in the foreground and middle ground. They appear to be engaged in some kind of confrontation or chase. Some are armed (with swords). Their postures and expressions likely convey urgency, fear, or violence.
  • A Man Falling: In the foreground, a man is falling or has already fallen.
  • Other Characters: There might be other figures visible in the shadows or further down the street, adding to the chaos of the scene.

Composition:

  • Narrow Street: The painting is dominated by a narrow street or alleyway. The buildings on either side create a sense of claustrophobia and direct the viewer's eye towards the center of the action.
  • Perspective: The artist uses perspective to create depth, drawing the eye to the background, where the church steeple serves as a focal point.
  • Dramatic Lighting: The contrast of light and dark further enhances the dramatic atmosphere.

Style:

  • Illustrative: The style is clearly illustrative, created in a realistic manner.
  • Possible Medium: The quality of the image suggests that it might be an oil painting or a detailed ink illustration.

Overall:
The painting tells a story of intrigue and violence, perhaps depicting a scene from a historical event, a dramatic novel, or a play. The dark tones, dramatic poses, and implied narrative create a scene full of suspense and conflict.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a black-and-white photograph of a painting depicting a historical or dramatic scene. The painting shows a group of figures, likely soldiers or guards, in what appears to be a medieval or Renaissance-era setting. The figures are dressed in period attire, including armor and helmets, and are engaged in some form of action or confrontation.

The background features a large, imposing building with a tall tower, which could be a church or a castle. The architecture suggests a European style, with stone walls and a steeply pitched roof. The scene is set in a narrow, cobblestone street, adding to the sense of a historical urban environment.

The painting captures a moment of tension or conflict, with the figures positioned in a way that suggests movement and interaction. The overall mood of the painting is dramatic and somewhat somber, enhanced by the muted tones of the black-and-white photograph.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-27

The image depicts a black-and-white painting of a street scene that appears to be set in a historical or medieval context. The scene is framed within a photograph, which shows a corner of a building and a visible edge of a frame in the bottom left corner, suggesting the painting is on display or being photographed.

In the painting, there is a prominent church in the background with a tall spire, possibly indicating a European setting. The foreground shows a street with several people dressed in what appears to be 16th or 17th-century attire, engaging in various activities. Some of the figures are sitting or leaning against the buildings, while others are engaged in conversation or observing something off-screen. The architecture of the buildings is detailed, with visible beams, windows, and a sense of age and wear, contributing to the overall historical atmosphere of the scene. The lighting and shadows are dramatic, enhancing the mood and depth of the painting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-27

The image is a black and white painting or drawing depicting a historical scene set in what appears to be a medieval or Renaissance-era town. The scene is centered around a group of figures dressed in period clothing, possibly soldiers or guards, engaged in a conversation or confrontation in a narrow alleyway. The alleyway is framed by old, weathered buildings with timber framing and a prominent church steeple in the background. The buildings have a rustic appearance, with wooden beams and stone walls. The atmosphere of the scene is somewhat somber, with the figures standing or sitting in a cluster, and the overall lighting is dim, suggesting a sense of tension or seriousness. The painting is framed, and the frame is visible in the image.