Human Generated Data

Title

The Rake and His Family in Debtor's Prison

Date

1735

People

Artist: William Hogarth, British 1697 - 1764

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1820

Human Generated Data

Title

The Rake and His Family in Debtor's Prison

People

Artist: William Hogarth, British 1697 - 1764

Date

1735

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1820

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Painting 98.5
Art 98.5
Person 95.8
Person 91.2
Person 89.8
Person 89.6
Person 88.2
Person 86.2
Person 74.4
Person 73.5
Person 70.1

Clarifai
created on 2023-10-27

people 100
group 99.9
print 99.9
art 99.4
adult 99.3
engraving 99.2
man 98.6
many 98.3
child 98.2
woman 98.2
illustration 97.7
family 96.6
administration 95.6
several 95.4
wear 94.7
furniture 94.2
interaction 93.7
royalty 92.8
war 92.1
baby 91.4

Imagga
created on 2022-01-23

money 31.5
currency 30.5
art 29.3
cash 28.4
paper 27.4
dollar 26.9
old 25.8
ancient 24.2
bank 23.6
bill 22.8
finance 22.8
vintage 22.6
antique 21.6
financial 21.4
history 19.7
banking 19.3
sculpture 19
business 18.2
wealth 18
us 17.4
retro 17.2
savings 16.8
dollars 16.4
rich 15.8
architecture 15.8
hundred 15.5
letter 13.8
grunge 13.6
exchange 13.4
carving 13.3
close 13.1
drawing 13
postmark 12.8
one 12.7
stamp 12.7
religion 12.6
pay 12.5
mail 12.4
sketch 12
temple 12
franklin 11.8
postage 11.8
postal 11.8
statue 11.7
loan 11.5
symbol 11.4
decoration 11.2
church 11.1
banknotes 10.8
bills 10.7
finances 10.6
god 10.5
economy 10.2
note 10.1
closeup 10.1
profit 9.6
representation 9.5
culture 9.4
religious 9.4
face 9.2
investment 9.2
historic 9.2
envelope 9.1
aged 9.1
sign 9
printed 8.9
banknote 8.7
notes 8.6
newspaper 8.5
travel 8.5
commerce 8.4
texture 8.3
creation 8.3
pattern 8.2
building 8.2
graffito 8.1
detail 8
market 8
wall 7.9
1967 7.9
philately 7.9
circa 7.9
card 7.9
funds 7.8
artistic 7.8
value 7.8
economic 7.8
spirituality 7.7
structure 7.6
capital 7.6
figure 7.4
stone 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99
drawing 98.7
sketch 96.4
old 93.7
person 91.3
vintage 72.8
clothing 72.3
black 71.6
cartoon 51.1
posing 43.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 28-38
Gender Male, 97.9%
Angry 35.7%
Calm 20.5%
Confused 20.4%
Fear 14.1%
Surprised 4.2%
Disgusted 2.1%
Sad 1.8%
Happy 1.1%

AWS Rekognition

Age 18-24
Gender Female, 74.4%
Angry 90.3%
Surprised 6.5%
Disgusted 0.7%
Fear 0.7%
Sad 0.6%
Confused 0.5%
Calm 0.4%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 94.4%
Fear 4.4%
Surprised 0.5%
Sad 0.3%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 51-59
Gender Male, 94.7%
Angry 84.3%
Disgusted 6.5%
Calm 4.2%
Surprised 1.4%
Fear 1.3%
Sad 1%
Confused 0.8%
Happy 0.5%

AWS Rekognition

Age 16-22
Gender Female, 99.2%
Calm 78.5%
Fear 15.2%
Happy 2.9%
Sad 0.8%
Angry 0.8%
Disgusted 0.8%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 66.4%
Fear 11.8%
Confused 6.7%
Angry 6.4%
Surprised 3.6%
Disgusted 3.6%
Sad 1.2%
Happy 0.3%

AWS Rekognition

Age 39-47
Gender Female, 87.8%
Calm 86.9%
Happy 9.1%
Confused 1.8%
Angry 1.1%
Disgusted 0.4%
Sad 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Female, 63.8%
Calm 53.8%
Happy 11.4%
Surprised 10.7%
Angry 9.7%
Confused 5%
Disgusted 4.7%
Fear 2.4%
Sad 2.3%

AWS Rekognition

Age 35-43
Gender Female, 98.7%
Calm 92.2%
Happy 2%
Sad 1.9%
Disgusted 1.3%
Angry 1.3%
Surprised 0.5%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 45-53
Gender Male, 77.4%
Calm 96.9%
Disgusted 1%
Angry 0.4%
Sad 0.4%
Surprised 0.4%
Happy 0.3%
Fear 0.2%
Confused 0.2%

Microsoft Cognitive Services

Age 39
Gender Female

Feature analysis

Amazon

Person
Painting
Person 99.6%
Person 95.8%
Person 91.2%
Person 89.8%
Person 89.6%
Person 88.2%
Person 86.2%
Person 74.4%
Person 73.5%
Person 70.1%
Painting 98.5%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-23

The image you've provided appears to be an engraving or etching, depicting a scene from a bygone era. It shows a group of individuals in what seems to be a domestic or tavern setting. Various activities are taking place in the room, which features old-fashioned furnishings and is lit by natural light filtering through a window. On the left side of the image, there is a large hearth with a broad mantelpiece behung with onions and other household items, while a birdcage hangs from the ceiling adjacent to it. Nearby, a person is engaged in some sort of activity by the fireside. The center of the room is dominated by a group of individuals gathered around a table engaged in a lively interaction. Among other items, there are jugs, books, and a globe on the table. In the background, to the right, a figure stands beside what appears to be a latticed window or door, and another individual is walking away or entering another room. On the far right, a person stands with their back turned, working on something attentively. The characters are dressed in attire suggestive of the 17th or 18th century, with some wearing caps or bonnets and others with jackets and knee breeches. The abundance of objects around the room and the animated poses of the figures suggest a scene of social gathering and discussion. Below the image, there is text, most likely providing context or a title to the scene depicted. The artwork conveys an atmosphere of casual camaraderie or domestic life in an earlier period, rich with historical and cultural details.

Created by gpt-4o-2024-05-13 on 2024-12-23

The image is an intricate black and white etching from a historical period, possibly the 18th century. The scene is set indoors, in a room with stone walls and large grid-like windows. Angel statues or figures appear to decorate the space. In the left portion of the image, women are gathered around a central female figure who is seated in distress on a bench or stool. They appear to be trying to comfort her. Various objects like a spilling basket of items and disarrayed fabric can be seen scattered on the floor near their feet. To the right, two men are sitting at a small round table with papers, accompanied by other people standing beside them. One figure appears to be holding a set of keys, seemingly indicating a prison or guarded premise setting. The individuals seated at the table seem engrossed in a discussion or focused activity involving the papers. The overall atmosphere of the image is dramatic and crowded, with the inclusion of numerous characters and elements adding to the narrative complexity of the scene. An inscription at the bottom provides a poetic or explanatory context to the etching.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-23

The image appears to depict a chaotic and crowded scene inside what looks like a dilapidated building. There are numerous figures, including adults and children, engaged in various activities. Some appear to be in distress or ill, while others seem to be providing care or assistance. The scene conveys a sense of hardship and poverty. The image is rendered in a detailed, engraved style characteristic of 18th or 19th century artwork.

Created by claude-3-5-sonnet-20241022 on 2024-12-23

This is a historical engraving that appears to be from the 18th century, showing a chaotic scene in what looks like a prison cell or dungeon. The image shows several figures in period dress engaged in various activities in a stone-walled room with barred windows. There appears to be some kind of disturbance or commotion taking place, with papers scattered on the floor and animated interactions between the figures. The artistic style is typical of satirical or social commentary engravings of the period, with fine line work and dramatic shading. At the bottom of the image, there appears to be text or a caption, though it's not clearly legible in this reproduction. The composition includes interesting details like a barred window letting in light from above and various props and furniture scattered throughout the scene.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-23

The image depicts a scene from William Hogarth's engraving "The Rake's Progress," specifically the fifth plate, titled "Madness and Melancholy." The engraving shows a group of people in a room, with a man sitting on a chair, holding a glass and looking distressed. A woman is standing next to him, holding his hand, while another woman is sitting on a bench, looking worried. A man is standing behind them, holding a bottle and looking concerned. In the background, there are several other people, including a woman who appears to be crying and a man who is lying on the floor. The engraving is rendered in a detailed and realistic style, with intricate lines and shading that create a sense of depth and texture. The scene is set in a dimly lit room, with a brick wall and a wooden floor. The atmosphere is one of chaos and disorder, with people milling about and objects scattered everywhere. Overall, the image conveys a sense of turmoil and confusion, as the characters struggle to come to terms with their own personal demons. The engraving is a powerful commentary on the human condition, highlighting the complexities and contradictions of human nature.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a black and white etching of a chaotic scene, with multiple figures in various states of distress. The scene appears to be set in a crowded and cluttered room, with people of different ages and genders present. In the foreground, a woman is shown holding a child, while another woman is depicted in a state of distress, possibly crying or screaming. A man is seated on a chair, looking down at a piece of paper or document, while another man stands behind him, gesturing towards the woman in distress. The background of the image is filled with various objects, including furniture, clothing, and other household items. The overall atmosphere of the image is one of chaos and disorder, with the figures in the scene appearing to be in a state of turmoil or upheaval. The image also includes a caption or title, which is written in a decorative font at the bottom of the page. The caption reads: "A Rake's Progress, Plate 5: The Madhouse." This suggests that the image is part of a larger series of etchings, possibly depicting the life and misadventures of a rake or a libertine. Overall, the image presents a vivid and dynamic portrayal of a chaotic scene, with a focus on the emotional and psychological states of the figures present. The use of black and white etching creates a sense of contrast and drama, highlighting the intensity of the emotions depicted in the image.

Text analysis

Amazon

Stretch
the
Guilty
Reflection
constant
back
early
But
idle
Thought
And
can
that
June
Happy
Talents
Evening
send
Helm
To
lan
approving
The
of his
From
lan send Remembrance back to fetch
gild
Gift
Who
Parliament
Gives
Remembrance
of Heaven
Andevery
to
Ray
to fetch
a
No
The Gloom of Age, & caft a Ray
Life's
&
broken
InSeas
of Age,
roving
caft
in
According
Gloom
InSeas of Jad Reflection loft,
of Jad
unus'd,
thro
To gild the Evening of his Day!
Treasures from
meet his
And Gives the Helm to madDespair.
Pleafures
of pafe
Treasures from Life's earlieft Stretch
loft,
But broken Faith & wrested Truth,
Happy the Manwhafe constant Thought Who self approving can review
Truth,
No Pleafures meet his roving Mind,
Junes of pafe Vertues that Shine thro
Net So the Guilty Wretch confind Talents idle de unus'd,
Wretch
wrested
Andevery Gift of Heaven abusd.-
review
Junes
Reafon
Net
According 4. act of Parliament June 4/25
Horrons.
So
Reafon the Velsel leaves to Steer
Vertues
Shine
4/25
No Blekings Fetafid from early Youth
From Horrons. Still to Herres toft,
(The in the Stheet of Hardhip taught.
Youth
to Steer
earlieft
Faith
Still
self
(The
Blekings
Mind,
de
Day!
taught.
to madDespair.
4.
Velsel leaves
act of
Herres
confind
toft,
Pablished
di Pablished
Fetafid from
Manwhafe
di
abusd.-
Stheet of Hardhip

Google

Not o the Guity Wretch onfinid 1Talents idle, & unusd, Happy the Mannhofe canstant Thought Who Jelf-approving can revien (The in the Sihoot of Hardfhup taught.) Sienes of pafe lirtues that hine thro No Pleaferes meet his roving Mind, And every Gife of Heaven abusid,And Geves ihe Helm to mad Despair lan send Remembranie back to fetch The Gloom gf Age, & caft a Ray, Freasures from Lafki eartigt ireteh. A Plate 7 Reafon the lelsel leaves to Steer No Blijsings fetpid from earty Youth, In Seas of Sad Reflection lofe, T6 gild the Evenung of his Day: But broken Faith, k nrested Fruth, From Horroni ill o Herren toft, ldicoriting te dtf Partament Tene yf a5. 0725. Inventeti lyWKogarth i Pablsh.
Not
o
the
Guity
Wretch
onfinid
1Talents
idle,
&
unusd,
Happy
Mannhofe
canstant
Thought
Who
Jelf-approving
can
revien
(The
in
Sihoot
of
Hardfhup
taught.)
Sienes
pafe
lirtues
that
hine
thro
No
Pleaferes
meet
his
roving
Mind,
And
every
Gife
Heaven
abusid,And
Geves
ihe
Helm
to
mad
Despair
lan
send
Remembranie
back
fetch
The
Gloom
gf
Age,
caft
a
Ray,
Freasures
from
Lafki
eartigt
ireteh.
A
Plate
7
Reafon
lelsel
leaves
Steer
Blijsings
fetpid
earty
Youth,
In
Seas
Sad
Reflection
lofe,
T6
gild
Evenung
Day:
But
broken
Faith,
k
nrested
Fruth,
From
Horroni
ill
Herren
toft,
ldicoriting
te
dtf
Partament
Tene
yf
a5.
0725.
Inventeti
lyWKogarth
i
Pablsh.