Human Generated Data

Title

The Madhouse

Date

19th century

People

Artist: Caspar Heinrich Merz, German 1806 - 1875

Artist: Samuel Amsler, German 1791 - 1849

Artist after: Wilhelm von Kaulbach, German 1805 - 1874

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12891

Human Generated Data

Title

The Madhouse

People

Artist: Caspar Heinrich Merz, German 1806 - 1875

Artist: Samuel Amsler, German 1791 - 1849

Artist after: Wilhelm von Kaulbach, German 1805 - 1874

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12891

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.9
Human 99.9
Person 99.2
Person 98.8
Person 98.6
Person 97.9
Painting 97.7
Art 97.7
Person 96.7
Person 91.5
Person 87.5
Person 87.5
Person 87.3
Person 68.7
Person 67.6
People 62.9
Person 60.6
Person 60.5
Archaeology 60.3
Person 55
Person 42.5

Clarifai
created on 2023-10-29

people 100
group 100
print 99.6
adult 99.5
many 99.4
child 98.3
man 98.3
art 98.2
several 98.2
interaction 97.6
woman 96.1
leader 96.1
son 94.6
illustration 94.1
kneeling 94
military 93.7
group together 93.2
royalty 92.9
soldier 92.4
wear 92

Imagga
created on 2022-02-26

sketch 100
drawing 100
representation 100
art 28.1
currency 23.3
money 22.1
ancient 21.6
cash 19.2
paper 18.8
finance 17.7
dollar 17.6
sculpture 17.4
financial 16
old 16
architecture 15.6
wealth 15.3
banking 14.7
religion 14.4
bank 14.3
history 14.3
bill 14.3
business 14
carving 13.8
vintage 13.2
antique 13
travel 12.7
temple 12.3
capital 12.3
decoration 12.3
savings 12.1
detail 12.1
economy 12.1
pattern 11.6
dollars 11.6
us 11.6
symbol 11.5
statue 11.4
culture 11.1
note 11
investment 11
stone 11
design 10.8
loan 10.5
exchange 10.5
artistic 10.4
grunge 10.2
retro 9.8
bills 9.7
banknote 9.7
god 9.6
wall 9.4
religious 9.4
rich 9.3
banknotes 8.8
close 8.6
monument 8.4
decorative 8.4
texture 8.3
sign 8.3
historic 8.3
figure 8.2
black 7.8
hundred 7.7
finances 7.7
spirituality 7.7
pay 7.7
historical 7.5
traditional 7.5
famous 7.4
man 7.4
artwork 7.3
nobody 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

drawing 99.1
posing 99
sketch 98.5
old 96.9
wall 95.7
text 95.6
group 92.6
person 88.9
cartoon 87.2
clothing 79.5
man 77.7
gallery 61.2
team 51.1
sculpture 47.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 66-76
Gender Male, 95.6%
Happy 37.8%
Surprised 24.5%
Fear 20.6%
Calm 6.6%
Angry 4.1%
Disgusted 2.9%
Confused 2.1%
Sad 1.3%

AWS Rekognition

Age 23-33
Gender Female, 98.9%
Surprised 80.9%
Angry 8.7%
Calm 6.1%
Disgusted 1.6%
Confused 1.2%
Fear 0.7%
Sad 0.6%
Happy 0.3%

AWS Rekognition

Age 49-57
Gender Female, 99.4%
Calm 60.9%
Sad 27.4%
Angry 3.5%
Confused 2.8%
Happy 2.4%
Disgusted 1.4%
Fear 1.1%
Surprised 0.4%

AWS Rekognition

Age 41-49
Gender Male, 90.8%
Calm 68.3%
Angry 19.1%
Confused 6.1%
Sad 2.7%
Disgusted 1.9%
Surprised 0.7%
Fear 0.7%
Happy 0.5%

AWS Rekognition

Age 48-56
Gender Female, 71.2%
Happy 94.4%
Calm 1.7%
Fear 0.7%
Angry 0.7%
Surprised 0.7%
Disgusted 0.7%
Sad 0.7%
Confused 0.5%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 96.9%
Confused 1.8%
Angry 0.5%
Sad 0.3%
Disgusted 0.3%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Female, 95.2%
Calm 99.1%
Sad 0.2%
Confused 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Female, 85.7%
Calm 89.6%
Angry 3.3%
Sad 3%
Disgusted 1.5%
Confused 1.1%
Surprised 0.5%
Fear 0.5%
Happy 0.5%

AWS Rekognition

Age 18-26
Gender Female, 54.6%
Calm 95.5%
Angry 2.2%
Disgusted 1%
Confused 0.3%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 99.6%
Sad 83.6%
Calm 10.6%
Confused 2.6%
Disgusted 1.3%
Fear 1%
Angry 0.5%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Angry 57.8%
Sad 31%
Confused 3.5%
Surprised 2.8%
Calm 2.1%
Fear 1.4%
Disgusted 0.9%
Happy 0.5%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 95.5%
Disgusted 2.1%
Confused 0.7%
Angry 0.6%
Sad 0.5%
Surprised 0.3%
Happy 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 68
Gender Female

Feature analysis

Amazon

Person
Painting
Person 99.9%
Person 99.2%
Person 98.8%
Person 98.6%
Person 97.9%
Person 96.7%
Person 91.5%
Person 87.5%
Person 87.5%
Person 87.3%
Person 68.7%
Person 67.6%
Person 60.6%
Person 60.5%
Person 55%
Person 42.5%
Painting 97.7%

Categories

Imagga

paintings art 99.5%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-28

This image is an illustration of a group of people engaged in various activities, possibly in a village or rural setting. The individuals are dressed in historical attire, reminiscent of 19th-century European peasantry. They are gathered around an outdoor space near a building with a small window. The scene includes a man with a large hat and a cane, a woman carrying a bundle, individuals talking, resting, and tending to children. The background shows a serene landscape with open fields.

Created by gpt-4 on 2025-01-28

The image is a monochrome illustration, likely from a 19th-century publication, judging by the clothing style and the print quality. It depicts a scene with multiple figures wearing period-appropriate attire, engaging in various activities. Some individuals are seated, while others stand or are engaged in conversation. The attire suggests a range of different social statuses and roles. There's a building to the right, which appears to be made of stone, and a barred window can be seen on its wall. The background features an open landscape with a clear sky.

Anthropic Claude

Created by claude-3-opus-20240229 on 2025-01-28

The image depicts a group of people, likely peasants or villagers, gathered outside a rustic building. The figures are dressed in simple clothing, with some of the women wearing long dresses and head coverings. The men are wearing trousers, shirts, and hats. They appear to be engaged in conversation or some kind of social interaction. In the background, there is a plain building with a few small windows and what looks like a thatched roof. The scene has a rural, countryside feeling to it based on the simple architecture and the clothing of the people. The drawing style is sketch-like and loose, using shading and line work to define the forms and details. The overall tone is sepia or brown, giving it an aged, historical appearance. The composition groups the figures closely together in the foreground, emphasizing their interaction and community.

Created by claude-3-haiku-20240307 on 2025-01-28

The image appears to be a detailed pencil sketch or engraving depicting a large group of people in what seems to be a rural or village setting. The scene shows a diverse array of figures, including men, women, and children, engaged in various activities and interactions. The image has a strong narrative quality, with the figures appearing to be in the midst of some sort of event or gathering. The different poses and expressions of the individuals suggest a range of emotions and interactions taking place. The level of detail in the drawing is quite impressive, with careful attention paid to the clothing, facial features, and body language of the figures. The overall composition and use of perspective create a sense of depth and spatial arrangement within the scene. While I cannot identify any specific individuals, the image seems to capture a vivid and thought-provoking moment in time, inviting the viewer to imagine the stories and connections between the various characters depicted.

Created by claude-3-5-sonnet-20241022 on 2025-01-28

This appears to be a historical illustration titled "Familienelende" (Family Misery). It's a black and white drawing showing a group of people in what seems to be a scene of poverty or hardship. The figures are dressed in early 19th century clothing, with several people sitting on stone blocks or the ground. Some appear distressed or dejected in their postures, while others are interacting with each other. The scene is set outside what appears to be a building with a barred window. In the background, there's a simple landscape with some trees or bushes on the horizon. The artistic style suggests this is likely from the 1800s, and the composition effectively conveys a sense of social commentary about poverty and family struggles during that period.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-28

The image is a black-and-white drawing of people gathered outside a building. The people are wearing different types of clothing, including hats and shoes. Some are sitting on the ground, while others are standing. There are also people sitting on a bench. The people in the image are engaged in various activities, such as talking, reading, and playing musical instruments. The image has a watermark that reads "KARL BENZHAUS."

Created by amazon.nova-lite-v1:0 on 2025-01-28

The image is a black-and-white etching that depicts a scene of people gathered in an outdoor area. Some individuals are seated on the ground, while others are standing. The people are engaged in various activities, such as smoking, drinking, and conversing. There are two individuals in the center of the scene who appear to be arguing or having a heated discussion. The background of the image features a building with a window and a door, and there are some trees and plants in the distance. The image has a vintage or antique feel, suggesting that it may be an old print or illustration.

Text analysis

Amazon

NARRENHAUS

Google

NARRENELAUS
NARRENELAUS