Human Generated Data

Title

The Works of Mercy

Date

1747

People

Artist: Jacques Philippe Le Bas, French 1707 - 1783

Artist after: David Teniers II, Flemish 1610 - 1690

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12385

Human Generated Data

Title

The Works of Mercy

People

Artist: Jacques Philippe Le Bas, French 1707 - 1783

Artist after: David Teniers II, Flemish 1610 - 1690

Date

1747

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12385

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Painting 99.2
Art 99.2
Person 99.2
Person 97.6
Person 96.2
Person 95.5
Person 93.5
Person 92.8
Person 92.1
Person 88.7
Person 87.4
Person 82
Person 78.1
Person 66.1
Person 47.7

Clarifai
created on 2023-10-29

people 100
group 99.9
print 99.9
adult 99.6
many 99.5
art 99.3
man 98.2
cavalry 97.3
military 96.8
illustration 96.8
soldier 96.7
engraving 96.2
several 95.5
woman 95.2
weapon 95.1
veil 95.1
vehicle 94
lithograph 93.9
war 93.7
wear 92.8

Imagga
created on 2022-02-26

statue 60.2
architecture 48.7
sculpture 43.9
stone 41.9
building 32.6
temple 32
monument 31.8
tourism 31.4
ancient 31.2
travel 30.3
history 29.5
structure 29.3
landmark 28
old 27.9
city 27.5
fountain 26.4
religion 23.3
art 22.8
memorial 22.5
historic 22
culture 21.4
famous 19.6
sketch 18.6
church 16.7
column 16.2
cemetery 16
drawing 16
religious 14.1
god 13.4
historical 13.2
tourist 12.9
palace 12.9
sky 12.8
gravestone 12.7
tower 12.5
antique 12.1
facade 11.7
marble 11.6
representation 11.5
carving 11.2
traditional 10.8
castle 10.5
cityscape 9.5
university 9.4
cathedral 9.4
roman 8.8
brass 8.8
heritage 8.7
artistic 8.7
medieval 8.6
figure 8.6
construction 8.6
wall 8.6
world 8.5
vintage 8.3
arch 8.1
mythology 7.9
lion 7.8
ruin 7.8
holy 7.7
spirituality 7.7
spiritual 7.7
capital 7.6
destination 7.5
town 7.4
obelisk 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.4
drawing 96.5
old 92.8
sketch 86.1
painting 80.1
person 79.7
gallery 74.2
posing 65.8
clothing 58.1
illustration 52.9
picture frame 33.9
vintage 27.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-12
Gender Female, 99.8%
Fear 53.2%
Calm 23.1%
Sad 6.4%
Angry 6%
Confused 3.4%
Happy 3.4%
Disgusted 3.1%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Female, 99.7%
Calm 95.8%
Sad 3.4%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Male, 94.6%
Happy 68.2%
Calm 18.9%
Surprised 5.5%
Fear 2.6%
Disgusted 2.1%
Sad 1.1%
Angry 0.8%
Confused 0.7%

AWS Rekognition

Age 48-56
Gender Female, 55.2%
Disgusted 44.7%
Angry 31.4%
Fear 14.8%
Calm 3.5%
Sad 2.3%
Surprised 2.2%
Confused 0.8%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 98.1%
Surprised 0.4%
Angry 0.3%
Fear 0.3%
Confused 0.3%
Disgusted 0.3%
Happy 0.2%
Sad 0.1%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Disgusted 76.2%
Calm 8.3%
Sad 5.4%
Fear 4.1%
Surprised 2.6%
Angry 2.4%
Confused 0.6%
Happy 0.5%

AWS Rekognition

Age 27-37
Gender Female, 54.6%
Disgusted 85.6%
Calm 8.1%
Angry 2.8%
Sad 1%
Surprised 0.9%
Fear 0.8%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 14-22
Gender Female, 98.1%
Calm 65.8%
Sad 13%
Disgusted 6%
Angry 5.6%
Fear 4.4%
Confused 2%
Surprised 1.9%
Happy 1.3%

AWS Rekognition

Age 23-31
Gender Male, 97.3%
Calm 84.4%
Sad 12.4%
Confused 0.9%
Surprised 0.5%
Happy 0.5%
Disgusted 0.5%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 19-27
Gender Female, 85.5%
Calm 70.7%
Sad 8.7%
Fear 8.6%
Disgusted 3.6%
Angry 2.5%
Confused 2.3%
Surprised 1.9%
Happy 1.6%

AWS Rekognition

Age 27-37
Gender Male, 85.5%
Calm 96.5%
Sad 2.9%
Confused 0.3%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 7-17
Gender Male, 98.4%
Calm 99.9%
Sad 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 95.2%
Calm 44.3%
Sad 32.8%
Disgusted 11.9%
Fear 4.1%
Happy 3.6%
Angry 1.8%
Confused 1.2%
Surprised 0.5%

AWS Rekognition

Age 6-16
Gender Female, 99.4%
Sad 75.8%
Calm 22.5%
Surprised 0.6%
Confused 0.3%
Fear 0.2%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 89.1%
Calm 68%
Happy 20.5%
Angry 5.2%
Disgusted 2.4%
Sad 2.1%
Surprised 1%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 6-16
Gender Female, 60.8%
Calm 81.4%
Fear 7.6%
Disgusted 2.9%
Sad 2.8%
Angry 2.2%
Surprised 1.2%
Happy 1%
Confused 0.9%

AWS Rekognition

Age 18-26
Gender Male, 96.5%
Calm 97.9%
Disgusted 0.9%
Confused 0.4%
Angry 0.3%
Surprised 0.2%
Sad 0.1%
Happy 0.1%
Fear 0%

Feature analysis

Amazon

Person
Painting
Person 99.5%
Person 99.2%
Person 97.6%
Person 96.2%
Person 95.5%
Person 93.5%
Person 92.8%
Person 92.1%
Person 88.7%
Person 87.4%
Person 82%
Person 78.1%
Person 66.1%
Person 47.7%
Painting 99.2%

Categories

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-28

The image is a detailed, black and white engraving depicting a historical scene with numerous figures engaged in various activities. The setting appears to be a village or small town with a large, elaborate building in the background, possibly a manor or a church. In the foreground, there are people gathered around a table laden with food, suggesting a communal meal or charitable distribution. The villagers include men, women, and children, some engaged in conversation, while others are receiving or handling food. The image is highly detailed, with fine textures in the clothing, architecture, and natural surroundings. There is also a mix of outdoor and indoor activities, giving a sense of daily life and community interaction in a historical context. The engraving is titled "Les oeuvres de misericorde au Roy" and includes additional text and an emblem at the bottom.

Created by gpt-4 on 2025-01-28

This image depicts a busy scene reminiscent of a bygone era, possibly the 17th or 18th century based on the architectural and clothing styles. The setting is a village or town with structures that feature steep roofs and a prominent building with an arched doorway on the right. A group of individuals is gathered around a table filled with various food items, suggesting a communal meal or feast. In the background, a hilly landscape with trees and a distant building with a spire is visible, which could indicate a rural environment. On the left, outside a building, a person in period attire is working near a barrel, with pots and pans visible. Further to the left, a soldier holding a pike is conversing with two children, one of whom appears to be rolling a hoop with a stick, an old-fashioned children's game. In the foreground, a person is sitting with an infant in her lap, and several children are around, with one of them reaching for the table. Nearby, vessels such as jars and pots suggest domestic or cooking activities. The characters are engaged in various interactions, creating a lively social scene. The clothing and objects indicate a historical or allegorical narrative, and the overall atmosphere is one of rustic community life. The image also contains some text at the bottom, which appears to be in French and may provide context or a title for the scene, attributing it to specific works or themes of charity ("de Misericorde"). However, due to the resolution and angle, it's challenging to decipher all of the text accurately. The print seems to be an etching or an engraving, commonly used for book illustrations and artworks in the past centuries.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-01-28

This is a historical engraving titled "Les Oeuvres de Misericorde" (The Works of Mercy). The scene depicts a village setting with various figures engaged in charitable activities. In the background, there's a distinctive building with a tower or steeple, and several other buildings are visible in the landscape. The composition shows a crowd gathered around what appears to be a distribution point, possibly for food or other necessities. There's a table with goods on it, and various people are shown both giving and receiving aid. The scene includes adults and children, with some carrying baskets and others waiting in line. The artwork is rendered in a detailed black and white engraving style typical of the period, with careful attention to shading and perspective. The sky features dramatic clouds, and the overall composition leads the eye from the foreground activity to the architectural elements in the background. This type of image was common in European art, particularly during the 17th and 18th centuries, and often depicted scenes of Christian charity and moral virtue. The quality of the engraving suggests it was created by a skilled artist of the period.

Created by claude-3-opus-20240229 on 2025-01-28

The image depicts a detailed engraving or illustration titled "Les oeuvres de misericorde" (The Works of Mercy). It shows a bustling scene in front of a large, Gothic-style building or church, with many figures engaged in various charitable acts. In the foreground, people are distributing food, drink and clothing to the poor and needy. Children and adults alike are receiving the offerings. Some sit on the ground while others gather around. The imposing building in the background has ornate architecture with spires, arched windows and intricate details. A few small trees and shrubs are scattered in the scene. The overall composition has a triangular structure, with the activity concentrated in the lower portion and the building rising up and filling the top part of the frame. The detailed linework and shading give the scene a sense of depth and realism typical of engravings from past centuries. Below the main illustration is an ornate title and caption in French script.

Created by claude-3-haiku-20240307 on 2025-01-28

The image appears to be an engraved print depicting a scene of people engaged in various activities in a village setting. In the foreground, there is a group of people gathered around a table, seemingly sharing a meal or distributing food. The scene also shows other people going about their daily lives, such as children playing and adults working. In the background, there is a large, ornate building, likely a church or other significant structure, surrounded by smaller buildings and a cloudy sky. The overall impression is one of a bustling, vibrant community engaged in acts of charity and mutual support. The details and composition suggest this is a work of art, possibly from a historical or allegorical series, rather than a direct representation of a specific place or event.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-28

The image is a black-and-white drawing of a group of people gathered in an outdoor area. Some are standing, and some are sitting on chairs. A woman is holding a baby in her hands. A barrel is placed beside her. Some people are standing near the barrel. Some houses are located at a distance, and a few trees are in front of the houses. A watermark is in the middle of the image.

Created by amazon.nova-lite-v1:0 on 2025-01-28

The image is a black-and-white etching that depicts a scene of people gathered around a table with food, likely in a village. The scene appears to be set in the 18th century, as suggested by the clothing and architecture. The title of the image is "Les Oeuvres de Misericorde au Roy" which translates to "The Works of Mercy to the King." The image is surrounded by a decorative border and has a watermark in the bottom left corner.

Text analysis

Amazon

LES
Roy
au Roy
DE
au
DE MISERICORDE
(EUVRES
and
Dedie
MISERICORDE
-
Gotte
Down
+
,
Round - + hundring
Organial
18
Premium L the and - , 18 - مدة مسات ...
de
L
Gotte de Tabless Organial human 'p' : from
april happened Down Manuk
Premium
مسات
Round
happened
the
Tabless
human
مدة
:
'p'
Manuk
from
april
hundring
UVA
...

Google

LES EUVRES DE MISERICORDE Dedie Roy
LES
EUVRES
DE
MISERICORDE
Dedie
Roy