Human Generated Data

Title

Before Confession

Date

1875

People

Artist: Adolph Menzel, German 1815 - 1905

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.90

Human Generated Data

Title

Before Confession

People

Artist: Adolph Menzel, German 1815 - 1905

Date

1875

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.90

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 98.7
Person 98.7
Female 98.7
Woman 98.7
Adult 97.6
Male 97.6
Man 97.6
Person 97.6
Face 92
Head 92
Clothing 57.6
Coat 57.6
Photography 55.9
Portrait 55.9

Clarifai
created on 2023-10-29

painting 99.6
people 99.3
art 98.8
adult 97.9
man 97.5
woman 97.5
illustration 95.8
group 95.6
wear 94.8
war 94
child 93.5
religion 93.3
print 93
son 90.3
weapon 90.2
military 89.4
nude 88.5
veil 88.4
two 88.3
soldier 88.2

Imagga
created on 2018-12-29

sculpture 20.1
stone 16.9
carving 16.8
man 16.8
cell 16.7
travel 14.8
religion 14.3
architecture 14.1
rock 13.9
cadaver 13.9
turkey 13.4
person 13.2
ancient 13
wall 12.8
male 12.8
art 12.7
old 12.5
history 12.5
religious 12.2
prison 12.1
bird 11.7
temple 11.6
face 11.4
statue 11.3
building 11.2
color 11.1
monument 10.3
park 9.9
adult 9.9
correctional institution 9.7
people 9.5
dark 9.2
traditional 9.1
tourism 9.1
scene 8.7
colorful 8.6
outdoor 8.4
cliff 7.7
outside 7.7
culture 7.7
cock 7.7
god 7.7
head 7.6
historical 7.5
wood 7.5
figure 7.5
desert 7.5
famous 7.4
guillotine 7.4
inside 7.4
tourist 7.4
light 7.3
penal institution 7.3

Google
created on 2018-12-29

painting 91.2
art 79.8
picture frame 66.5
artwork 54.7
art gallery 50.1

Microsoft
created on 2018-12-29

stone 35.8
painting 35.8
art 9.9
person 3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 98.9%
Calm 89.4%
Fear 9.4%
Surprised 7.3%
Sad 2.2%
Disgusted 0.5%
Angry 0.3%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Calm 98.9%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.1%
Male 99.1%
Man 99.1%
Person 99.1%
Female 98.7%
Woman 98.7%

Captions

Azure OpenAI

Created by gpt-4 on 2024-12-12

This image portrays a painting or artwork with a vintage or classical style. It features two figures in period clothing. The figure on the left appears to be seated on an ornate wooden chair or bench, wearing what looks like a dark green dress with a full skirt, and the figure has a hat adorned with some decorations. The second figure is standing to the right, dressed in a dark brown, double-breasted jacket and knee-length trousers accompanied by long socks and shoes. The standing figure seems to be holding onto a cane or staff. The scene may depict a moment in an interior space with architectural features such as columns or ornate walls that suggest a setting in a historical or classical environment. There is substantial depth to the image, as indicated by the shadows and lighting differences between the foreground and background. The artist's signature is visible in the bottom right corner of the artwork. The overall impression is one of an artwork capturing a scene from a bygone era, filled with details that could tell a story about the individuals and their setting.

Created by gpt-4o-2024-05-13 on 2024-12-12

The image depicts an artwork with three figures dressed in historical attire, possibly from the late 19th or early 20th century. One figure, a woman, is sitting or kneeling on the left side of the image, wearing a dark dress with a green skirt. She appears to be positioned near a large, ornate architectural column. The other two figures, both men, are standing and kneeling near the column. They are dressed in traditional or period clothing which includes knee-high socks and jackets. The artwork features detailed and realistic textures and colors, capturing the essence of a historical or classical scene. There is also the signature "A. Morzel" in the bottom right corner.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-12

The image depicts a scene from what appears to be a 19th century setting. In the foreground, a woman wearing dark, elaborate clothing and a decorative headdress is seated, with her head bowed. Behind her, three men are shown, one of whom is standing and seems to be addressing the others. The scene has a somber, dramatic tone, with the contrast between the seated woman and the standing men suggesting some kind of interaction or confrontation. The overall composition and artistic style suggest this is a painting or illustration rather than a photographic image.

Created by claude-3-5-sonnet-20241022 on 2024-12-12

This appears to be a historical painting depicting a scene inside what looks like a church or religious building. In the image, there are several figures - a woman in a dark dress and decorative hat sitting near what appears to be a wooden church pew or furniture piece on the left side, and two figures in more casual, working-class attire standing in the background on the right. The painting has a dark, muted color palette with browns and blacks dominating the scene. The architectural elements suggest an interior space with stone columns or walls. The style and clothing indicate this is likely from the 19th century. The composition creates an interesting dynamic between the seated figure in the foreground and the standing figures in the background, separated by architectural elements. The brushwork appears loose and expressive, typical of period genre painting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-12

The image is a painting of a woman sitting on a bench, a man standing in the doorway, and another man walking down the steps. The woman is wearing a black dress with a green skirt and has a hat on her head. She is sitting on a bench with her head in her hands. The man in the doorway is wearing a brown jacket and pants, and he is holding a cane in his hand. The man walking down the steps is wearing a black jacket and pants, and he has a mustache. The background of the painting is a wall with a doorway and a staircase. The overall atmosphere of the painting is one of sadness and contemplation, as the woman sits alone on the bench with her head in her hands. The man in the doorway looks concerned, and the man walking down the steps seems to be lost in thought. The painting is signed by the artist, but the signature is not legible.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-12

The image is a painting of a woman sitting on a chair, with two men standing in the background. The woman is wearing a dark-colored dress and has her head bowed down, looking at something in her lap. She appears to be reading or writing. The two men are standing behind her, one of them is looking at her while the other is looking away. They are both wearing dark-colored clothing and have serious expressions on their faces. The background of the painting is a light-colored wall with a doorway or archway leading to another room. There are some plants or trees visible through the doorway, suggesting that the scene is set outdoors or in a garden. The overall atmosphere of the painting is one of quiet contemplation and introspection, with the woman lost in thought and the men observing her from a distance.

Text analysis

Amazon

too Monzal