Human Generated Data

Title

Vanitas

Date

17th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Antonia Paepcke DuBrul Fund, 1985.28

Human Generated Data

Title

Vanitas

People

Artist: Unidentified Artist,

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Antonia Paepcke DuBrul Fund, 1985.28

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.7
Person 98.7
Painting 98.6
Art 98.6

Clarifai
created on 2018-03-16

painting 99.7
people 99.6
art 99.4
one 99
illustration 98.9
adult 98.2
print 97.4
Renaissance 97.3
religion 96.3
man 93.8
indoors 93.3
lithograph 92.3
son 92
baby 90.9
child 90.5
text 89.2
wear 88.7
ancient 87.8
veil 86
two 85.6

Imagga
created on 2018-03-16

religion 44.8
temple 41.5
statue 38.8
sculpture 34.5
culture 25.6
ancient 25.1
god 24.9
art 24.3
religious 23.4
travel 23.2
child 21.6
architecture 20.3
plaything 18.6
spiritual 18.2
holy 17.3
gold 17.3
history 17
stone 16.9
person 16.8
old 16
doll 15.4
juvenile 15.3
monument 14.9
east 14.9
tourism 14.8
prayer 14.5
meditation 14.4
pray 13.6
spirituality 13.4
traditional 13.3
carving 13.1
oriental 12.5
figure 12.2
famous 12.1
peace 11.9
face 11.4
golden 11.2
faith 10.5
antique 10.4
teddy 10.3
church 10.2
historic 10.1
world 9.8
carved 9.8
building 9.5
sitting 9.4
decoration 9.4
tourist 9.1
portrait 9.1
toyshop 9
bangkok 8.9
body 8.8
heritage 8.7
wall 8.5
historical 8.5
lady 8.1
man 8.1
southeast 7.9
praying 7.8
people 7.8
belief 7.8
color 7.8
worship 7.7
palace 7.7
head 7.6
style 7.4
posing 7.1

Google
created on 2018-03-16

art 91.1
painting 81.1
poster 76.8
muscle 70.7
human behavior 69.1
barechestedness 68.4
chest 59.2
modern art 58.8
artwork 53.5
album cover 52.8
visual arts 52.4

Microsoft
created on 2018-03-16

text 94.8
indoor 93.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-13
Gender Male, 50.6%
Angry 4.1%
Happy 3.8%
Calm 72.8%
Surprised 11.7%
Confused 2.9%
Disgusted 2%
Sad 2.7%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 98.7%
Painting 98.6%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image is a painting that shows a seated figure draped in red fabric, an hourglass on a small wooden table to their right, and a large human skull resting on the ground near the figure's feet. In the background, we can observe a landscape that includes a fortress-like structure with multiple cylindrical towers and a wall. A small window on the wall reveals another skull. A vase with various flowers stands on a ledge to the right. Below the painting is a section of text in an old script, such as Gothic script, commonly associated with historical documents in Europe. This text is likely in German, given its appearance, and would typically provide context or a message related to the themes of the painting, which often pertain to mortality and the transience of life, given the presence of the hourglass and skulls.

Created by gpt-4o-2024-05-13 on 2025-01-04

The image depicts a classic allegorical painting. A cherubic figure, draped in a red cloth, is seated against a dark backdrop. The child-like figure holds an hourglass and is surrounded by motifs symbolizing mortality, such as a skull and bones. There's also an engraved text in Gothic script at the bottom of the painting. In the background, a castle on a hill is visible, and to the right, there's a vase of flowers. The artwork seems to represent themes of life, time, and death.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a historical painting, likely from the medieval or Renaissance period. It shows a cherubic figure draped in red cloth, seated beside various symbolic objects including an hourglass and a skull. In the background, there's a castle or fortress with towers, and on the right side of the composition is a vase containing flowers. The image appears to be a memento mori - a artistic reminder of mortality - given the presence of the skull and hourglass. At the bottom of the painting is text in Gothic German script. The overall composition has a somber, contemplative mood despite the youthful subject, creating an interesting contrast between youth and mortality themes. The painting technique and style suggest it's from around the 16th or 17th century.

Created by claude-3-haiku-20240307 on 2024-11-27

The image is a painting that depicts a young, nude child sitting on a stool in a room with various objects and a castle-like structure visible in the background. The child has curly, light-colored hair and a cheerful expression on their face. The painting has a dark, dreamlike quality, with the child surrounded by various objects and symbols, including a lantern, rocks, and a vase of flowers. The text at the bottom of the painting appears to be in an older script, but I cannot read or reproduce it as that would violate copyright restrictions.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a painting of a young child, possibly a cherub, sitting on a skull. The child is depicted in a classical style, with a red cloth draped over their left shoulder and around their waist. They are seated on a human skull, which is positioned on the ground in front of them. To the left of the child is an hourglass, while to the right is a vase filled with flowers. In the background, there appears to be a castle or other large building, as well as a wall with a small window or door. The overall atmosphere of the painting suggests that it may be a representation of mortality or the transience of life. At the bottom of the image, there is a section of text written in an old-fashioned script. Unfortunately, the text is not legible, making it difficult to determine its meaning or significance in relation to the rest of the image.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a painting of a nude child sitting on a skull, with a castle in the background. The child has red hair and is wearing a red cloth draped over their left shoulder. They are sitting on a skull, with their right leg bent and their left leg extended. The child is holding a lantern in their right hand. In the background, there is a castle with towers and a wall. There is also a vase of flowers on a table to the right of the child. The overall atmosphere of the painting is one of mystery and intrigue, with the child's pose and expression suggesting a sense of contemplation or introspection. The painting appears to be an allegorical representation of death and mortality, with the child's nudity and the presence of the skull symbolizing the transience of life. The castle in the background may represent a sense of grandeur or power, while the vase of flowers adds a touch of beauty and fragility to the scene. Overall, the image is a thought-provoking and visually striking representation of the human experience, inviting the viewer to reflect on the nature of life and death.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a young boy sitting on a stool. He is wearing a red robe and has curly hair. He is holding a lantern in his left hand, and a skull is placed in front of him. The painting has a golden border, and there is a vase of flowers on the right side. The painting also has a castle in the background.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a small painting of a nude child, representing the personification of Time, seated on a skull. The child holds a small hourglass in his hand, symbolizing the fleeting nature of time. The painting features a castle in the background, with a flower vase on the right side and a small window on the wall. The painting is inscribed with a German text that reads, "Warum holst du raub und edlen + du musz doch nunder salben werden + der munthch 21 jahr und 11 wenn macht + schch nur der mund vermodet ihn sprache." This translates to, "Why do you steal wealth and nobility + you must now become a servant + the mouth 21 years and 11 when makes + only the mouth decays in speech." The painting is a reminder of the transience of life and the inevitability of death.

Text analysis

Amazon

gmad
cshch
loub
wnrt
Der
Saum
u
amd
mmacht
2nuft
me
cshch me Der ommucki regandf mm mmacht
u 2nuft Dol wnrt adou SOUen
Stltnerst
Saum Stltnerst Du loub San10 Swen
Swen
Dol
regandf
DET
adou
lfoub
DET snmf 2f lfoub amd n iff gmad
San10
snmf
Du
mm
2f
SOUen
ommucki
iff
n

Google

arum ich
arum
ich