Human Generated Data

Title

The Illness of Pierrot

Date

19th century

People

Artist: Thomas Couture, French 1815 - 1879

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.793

Human Generated Data

Title

The Illness of Pierrot

People

Artist: Thomas Couture, French 1815 - 1879

Date

19th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.793

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Art 100
Painting 100
Adult 98.9
Bride 98.9
Female 98.9
Person 98.9
Wedding 98.9
Woman 98.9
Adult 98.6
Bride 98.6
Female 98.6
Person 98.6
Woman 98.6
Adult 97.2
Bride 97.2
Female 97.2
Person 97.2
Woman 97.2
Adult 96.2
Bride 96.2
Female 96.2
Person 96.2
Woman 96.2
Face 86.4
Head 86.4
Candle 77.5
Bed 76.5
Furniture 76.5
Clothing 69.3
Footwear 69.3
Shoe 69.3
Machine 65.2
Wheel 65.2
Shoe 61.8
Shoe 61.8
Drawing 56.2
Architecture 55.6
Building 55.6
Hospital 55.6

Clarifai
created on 2023-10-18

people 100
adult 99.5
group 99.3
print 99.2
art 99.2
illustration 98.9
man 98.4
furniture 98.3
two 98.2
engraving 97.8
seat 96.4
woman 96.1
veil 96.1
three 94.8
wear 93.7
cavalry 93.1
military 92.7
leader 92.5
weapon 92.2
reclining 91.5

Imagga
created on 2018-12-18

sculpture 24.3
statue 22.4
art 22.3
old 21.6
furniture 20.8
architecture 19.5
antique 17.5
ancient 16.4
drawing 16.1
religion 16.1
vintage 15.7
decoration 15.7
building 15.1
sketch 15
city 15
design 14.6
interior 14.1
seat 13.5
god 13.4
grunge 12.8
church 12
history 11.6
holy 11.5
decor 11.5
retro 11.5
chair 11.3
stone 11
catholic 10.7
baby bed 10.4
frame 10.4
monument 10.3
representation 9.9
cradle 9.9
furnishing 9.7
style 9.6
pattern 9.6
faith 9.6
wall 9.5
luxury 9.4
man 9.4
marble 9.4
religious 9.4
classic 9.3
house 9.2
tourism 9.1
aged 9
dirty 9
water 8.7
spiritual 8.6
culture 8.5
historical 8.5
travel 8.4
traditional 8.3
tourist 8.2
device 8.1
landmark 8.1
light 8
room 8
figure 7.9
artistic 7.8
color 7.8
royal 7.7
cathedral 7.7
horse 7.6
elegance 7.6
rocking chair 7.5
famous 7.4
symbol 7.4
gold 7.4
tradition 7.4
window 7.3
support 7.3
bed 7.3
detail 7.2
colorful 7.2
carving 7

Google
created on 2018-12-18

Microsoft
created on 2018-12-18

wall 96.5
old 96
text 94.3
black 73.8
vintage 71.2
white 65.2
fashioned 50.3
clothes 23.7
museum 23.7
art 10.7
illustration 10.2
child 9.7
black and white 8.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 18-24
Gender Female, 96.2%
Calm 94%
Surprised 6.3%
Fear 6.2%
Sad 3.6%
Angry 0.9%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 38-46
Gender Female, 66.5%
Angry 35.9%
Calm 30.6%
Confused 13.1%
Surprised 8%
Sad 7.9%
Fear 6.6%
Happy 3.3%
Disgusted 2.6%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Candle
Bed
Shoe
Wheel
Adult 98.9%
Adult 98.6%
Adult 97.2%
Adult 96.2%
Bride 98.9%
Bride 98.6%
Bride 97.2%
Bride 96.2%
Female 98.9%
Female 98.6%
Female 97.2%
Female 96.2%
Person 98.9%
Person 98.6%
Person 97.2%
Person 96.2%
Woman 98.9%
Woman 98.6%
Woman 97.2%
Woman 96.2%
Candle 77.5%
Bed 76.5%
Shoe 69.3%
Shoe 61.8%
Shoe 61.8%
Wheel 65.2%

Categories

Imagga

paintings art 99.3%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a suit and a woman in a bed -100%

OpenAI GPT

Created by gpt-4 on 2024-12-13

This is a detailed illustration of a historical scene inside what appears to be a bedroom. The room is furnished with heavy curtains around the bed and a high canopy. To the right, there is a side table with a single candlestick. Beneath the bed is a warming pan lying on the floor, and several bottles are scattered around the floor.

On the left, a character stands holding a chair and a walking stick, conversing with a seated individual who is gesturing expressively. In the background, another figure is interacting with the curtains.

The attire of the characters suggests a setting from a past century, possibly the 17th or 18th, as indicated by their tricorn hats, breeches, and ruffled shirts. The scene has a comedic undercurrent, and each character's posture and expression add to the narrative being conveyed. There's a caption in French at the top of the image, which may provide context or a comment on the scene depicted.

Created by gpt-4o-2024-05-13 on 2024-12-13

The image depicts a scene set in what appears to be a historical period, possibly the 18th century. The focus is on a sick person lying in a bed, who is being attended to by a group of people. The room is furnished with a grand canopy bed adorned with heavy curtains. One individual, likely a doctor, is seated on a chair next to the bed and appears to be examining the patient. This doctor is dressed in period-appropriate attire, including a tricorne hat, and holds a walking stick. Another person, possibly a servant, stands by holding items like a bedpan and a pitcher, suggesting they are assisting with the patient's care. There is also a person adjusting the curtains around the bed. The room is dimly lit, with bottles and a light source on a table nearby. The overall feel of the image evokes a scene of medical care in a bygone era.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-13

The image depicts a scene from what appears to be a historical or dramatic setting. It shows a bedridden individual, possibly a sick or injured person, surrounded by others who seem to be attending to their care. In the foreground, there is a figure seated in a chair, possibly a doctor or caregiver. The scene is set in an interior space with elaborate curtains and decorations, suggesting a high-status or formal environment. The overall composition and style of the image convey a sense of gravity and solemnity.

Created by claude-3-5-sonnet-20241022 on 2024-12-13

This appears to be a historical illustration or sketch depicting what seems to be a medical or domestic scene. The setting shows an interior room with elegant curtains and furnishings. There's a person lying in a bed with white linens, while others are in the room including someone seated in a chair and what appears to be a servant or attendant. There are bottles on the floor and a small table with items that might be medical supplies. The style of dress suggests this is from the 18th or early 19th century, with the figures wearing period-appropriate clothing including ruffled collars and formal attire. There's text in French at the top of the image. The artwork appears to be done in a grayscale or monochromatic style, possibly graphite or charcoal.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-13

The image is a drawing of a scene from the 18th century, depicting a man lying in bed, attended to by two other men. The man in bed is wearing a nightgown and has a bandage on his head. He is surrounded by various objects, including a table with bottles and a candle, and a chair with a sword and a hat.

The two men attending to him are dressed in 18th-century attire, with one holding a cane and the other standing over the bed, gesturing towards the man's head. The background of the image features a curtain and a wall, with a quote written in French on the wall.

Overall, the image appears to be a depiction of a medical scene from the 18th century, with the man in bed possibly being a patient undergoing treatment or examination. The presence of the sword and hat on the chair suggests that the scene may be set in a domestic or private setting, rather than a hospital or medical facility.

The quote on the wall adds an air of mystery to the image, and its meaning is unclear without further context. However, it may be related to the medical treatment or diagnosis being administered to the man in bed.

Overall, the image provides a glimpse into the medical practices and daily life of the 18th century, and invites the viewer to interpret the scene and its significance.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-13

The image is a black-and-white drawing of a man sitting on a chair next to a bed, where another man lies. The man sitting wears a tricorn hat and holds a cane in his right hand, while the man in bed has his left arm extended, with his hand resting on the sitting man's hand.

In the background, a woman stands on the left side of the image, holding a sword behind her back. On the right side, a man stands behind the bed, holding a sword above his head. The room is decorated with curtains, a table, and various objects on the floor.

The overall atmosphere of the image suggests a scene from a play or a historical event, with the characters engaged in a dramatic or intense moment.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-26

The image is a black-and-white etching of a scene from the 18th century. It depicts a room where a doctor is attending to a patient lying on a bed. The doctor is seated on a chair and holding a cane, while the patient lies on the bed with a pillow under their head. There are several bottles on the floor, some of which are broken. A woman is standing behind the doctor, holding a ladle and a jug. Another person is standing behind the bed, holding a sword. The image has a French caption that translates to "Science makes a doctor, who is not, and the world sees him as a doctor."

Created by amazon.nova-pro-v1:0 on 2025-02-26

The image is a black-and-white drawing that depicts a scene in a bedroom. There is a bed in the center of the room, with a person lying on it. The person is wearing a nightcap and appears to be sick. A doctor is sitting on a chair beside the bed, holding a cane and looking at the patient. Another person is standing beside the doctor, holding a basin. There are several bottles and other objects on the floor. The image has a watermark with the text "T.C." in the bottom left corner.

Google Gemini

Created by gemini-2.0-flash on 2025-05-01

The image shows an illustration depicting a scene with several characters and objects, primarily rendered in shades of gray. In the background, a bed is draped with curtains, and a figure lies in it, dressed in what appears to be period clothing. Another figure, clad in attire reminiscent of historical performers, is standing beside the bed, potentially interacting with the person in the bed.

In the foreground, a man is seated on a chair, also dressed in historical clothing. He is holding a cane and seems to be observing or interacting with the scene unfolding near the bed. Beside him, a woman stands holding what looks like a kettle or pot.

Bottles are scattered on the floor near the bed and the side table, suggesting a setting of revelry or disorder. The overall composition suggests a moment frozen in time, possibly a historical scene or a satirical commentary.

There is a line of text written at the top left of the image. "LA SCIENCE FAIT VOIR A CE DOCTEUR CE QUI N'EST PAS, ET L'EMPECHE DE VOIR CE QUE TOUT LE MONDE DEVINE." in english it translates to "Science shows this doctor what is not, and prevents him from seeing what everyone guesses."

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Scene:

The image is a historical or satirical drawing depicting a scene in a bedroom. The style is a detailed, black and white etching.

Key Elements and Details:

  • Main Figure: A man wearing 18th-century attire (coat, breeches, cravat, and a tricorne hat) is seated in a chair. He holds a cane and seems to be examining the person lying in the bed.
  • Patient: A person lies in a large bed with a ruffled collar, seemingly in a state of illness or unconsciousness. The person is covered with white sheets and pillows.
  • Attendant: A woman dressed in a bonnet and a long dress, likely a maid or nurse, is standing to the left. She appears concerned, and is holding a pan and a large jug.
  • Another Figure: In the background, a man in a more ornate costume (perhaps a jester or courtier) is seemingly trying to touch the bed curtains.
  • Furniture and Setting: The room is simply furnished, with a bed, a nightstand with objects on it (candle, glass), and a chair. There are bottles and corks on the floor near the bed.
  • Text: There's French text near the top left corner: "LA SCIENCE FAIT VOIR A CE DOCTEUR CE QUI N'EST PAS, ET L'EMPECHE DE VOIR CE QUE TOUT LE MONDE DEVINE." (Science shows the doctor what is not, and prevents him from seeing what everyone else guesses). The artist's initials "T.C" are in the lower left corner.

Possible Interpretation:

The scene seems satirical. The text implies a criticism of scientific arrogance or medical ignorance. The doctor is perhaps overly focused on something unseen while missing the obvious condition of the patient. The bottles on the floor suggest possible excessive drinking or the reason behind the patient's state. The man in the background adds a level of strangeness or the ridiculousness of the situation, perhaps representing the truth. The drawing is therefore a critique of scientific reasoning versus popular consensus.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This image is a detailed lithograph by Honoré Daumier, a French artist known for his political and social commentary through caricature and satirical art. The scene depicts a bedroom where a doctor is attending to a patient lying in bed. The doctor, dressed in formal attire, is seated on a chair beside the bed and appears to be examining the patient. The patient is reclined, looking unwell.

Several other figures are present in the room:

  1. A woman, possibly a nurse or a family member, is standing behind the doctor, holding a small child.
  2. Another woman, who appears to be a maid, is in the background near the window, holding up a curtain.
  3. A third woman, perhaps a relative, is seated on the bed, comforting the patient.

The room is cluttered with various items, including bottles on the floor, a table with a lamp, and other personal belongings. The atmosphere suggests a scene of illness and care, with an emphasis on the role of the doctor and the concern of those around the patient.

The caption at the top of the image reads, "La science fait voir à ce docteur ce qui n'est pas, et l'empêche de voir ce que tout le monde devine," which translates to "Science makes this doctor see what is not there, and prevents him from seeing what everyone else guesses." This statement critiques the doctor's inability to accurately diagnose the patient's condition, highlighting a disconnect between medical science and common sense or intuition.

Text analysis

Amazon

LE
LA
SCIENCE
ET
VOIR
EMPECHE
TOUT
A
DOCTEUR
MONDE
T.C
LA SCIENCE FAIT VOIR A CE
N'EST
CE
FAIT
QUI
DOCTEUR CE QUI N'EST P.A.S.
TOUT LE MONDE DEVINE .
DEVOIR
ET L EMPECHE DEVOIR CEIQUE
P.A.S.
CEIQUE
L
DEVINE .