Human Generated Data

Title

Trial of Susanna

Date

16th-17th century

People

Artist: Nicolaes de Bruyn, Flemish 1571 - 1656

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R5797

Human Generated Data

Title

Trial of Susanna

People

Artist: Nicolaes de Bruyn, Flemish 1571 - 1656

Date

16th-17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R5797

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99
Human 99
Person 98.9
Painting 98.2
Art 98.2
Person 98.1
Person 97.8
Person 97.8
Person 96.9
Person 96
Person 93.1
Person 92.8
Person 92.6
Person 91.7
Person 91.6
Person 85.6
Person 85
Person 82.8
Lizard 68.5
Animal 68.5
Reptile 68.5
Person 62

Clarifai
created on 2023-10-29

people 100
group 99.9
art 99.8
print 99.4
illustration 98.2
adult 98.2
many 98.1
man 97.1
engraving 95.2
woman 93.9
painting 92.4
several 91.9
wear 90.7
leader 90.2
gown (clothing) 89.2
religion 89.2
monarch 88.9
kneeling 87.2
vintage 87.1
baby 86.4

Imagga
created on 2022-02-26

sculpture 47.2
architecture 38.1
column 37.1
art 36.3
religion 30.5
statue 30.1
old 27.9
church 27.8
monument 27.1
cathedral 26.8
carving 26.5
ancient 25.9
history 25
landmark 24.4
god 23
stone 22.6
altar 21.7
temple 21.3
structure 21
building 20.8
tourism 20.6
culture 19.7
antique 18.8
travel 18.3
holy 18.3
famous 17.7
city 17.5
historical 16.9
historic 16.5
religious 15.9
vintage 15.7
arch 15.2
catholic 14.8
spirituality 14.4
tile 13.9
detail 13.7
marble 13.4
statues 12.8
sketch 12.1
carved 11.7
worship 11.6
faith 11.5
symbol 11.4
decoration 10.9
figure 10.8
spiritual 10.6
door 10.5
gown 10.2
traditional 10
cemetery 9.9
saint 9.6
medieval 9.6
ornament 9.5
wall 9.4
destination 9.4
vestment 9.2
tourist 9.1
gold 9
retro 9
drawing 8.9
pray 8.7
artistic 8.7
heritage 8.7
decorative 8.4
exterior 8.3
museum 8.2
representation 8
carvings 7.9
sculptures 7.9
holiday 7.9
chapel 7.8
century 7.8
angel 7.8
facade 7.8
baroque 7.8
sacred 7.8
capital 7.6
cross 7.5
palace 7.5
tradition 7.4
memorial 7.4
ornate 7.3
covering 7.2
design 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.1
book 98.4
drawing 97.5
person 95.7
clothing 94.4
sketch 94.3
old 81.3
cartoon 79.7
group 66
painting 53

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 33-41
Gender Female, 94.6%
Calm 89.6%
Disgusted 3.7%
Angry 3%
Surprised 1.2%
Happy 0.8%
Sad 0.8%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 34-42
Gender Male, 98.8%
Calm 98.6%
Angry 0.3%
Confused 0.3%
Disgusted 0.3%
Sad 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 67.2%
Calm 99.6%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 96.1%
Confused 1.2%
Disgusted 0.9%
Angry 0.8%
Surprised 0.4%
Sad 0.3%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.3%
Calm 83.4%
Angry 6%
Disgusted 2.5%
Confused 2.2%
Sad 2.2%
Fear 1.5%
Surprised 1.5%
Happy 0.7%

AWS Rekognition

Age 40-48
Gender Male, 99.1%
Calm 82.2%
Fear 6.7%
Disgusted 5.4%
Confused 1.8%
Angry 1.4%
Surprised 1.3%
Sad 0.8%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Female, 95.4%
Calm 98.3%
Angry 0.5%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%
Happy 0.1%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 89.6%
Fear 4.6%
Disgusted 2.9%
Confused 1.1%
Angry 0.6%
Surprised 0.6%
Sad 0.4%
Happy 0.3%

AWS Rekognition

Age 51-59
Gender Male, 100%
Fear 46.5%
Calm 42.7%
Confused 2.2%
Sad 2.1%
Angry 1.9%
Surprised 1.7%
Disgusted 1.6%
Happy 1.3%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Calm 99.5%
Surprised 0.2%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 45-51
Gender Male, 96.3%
Calm 96.5%
Fear 1.4%
Confused 0.8%
Disgusted 0.5%
Happy 0.3%
Surprised 0.2%
Angry 0.2%
Sad 0.2%

AWS Rekognition

Age 35-43
Gender Male, 97.6%
Fear 65.6%
Calm 17.6%
Happy 4.1%
Confused 3.5%
Angry 2.6%
Sad 2.6%
Disgusted 2%
Surprised 1.9%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Calm 98.6%
Surprised 0.5%
Fear 0.3%
Disgusted 0.2%
Happy 0.2%
Confused 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 95.7%
Sad 1.2%
Angry 1.1%
Disgusted 0.8%
Confused 0.7%
Fear 0.2%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 18-24
Gender Female, 95.4%
Happy 94.2%
Angry 2.8%
Calm 1.5%
Disgusted 0.5%
Surprised 0.5%
Sad 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Female, 85%
Calm 96.2%
Fear 2.3%
Disgusted 0.3%
Angry 0.3%
Sad 0.3%
Surprised 0.3%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 92%
Fear 54.3%
Calm 12.8%
Surprised 8.4%
Disgusted 7.3%
Angry 5.6%
Confused 5.3%
Happy 4.1%
Sad 2.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 97.1%
Surprised 0.7%
Confused 0.6%
Disgusted 0.5%
Angry 0.4%
Sad 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 37-45
Gender Male, 98.4%
Calm 99.8%
Fear 0.1%
Disgusted 0%
Happy 0%
Confused 0%
Surprised 0%
Sad 0%
Angry 0%

AWS Rekognition

Age 20-28
Gender Male, 84.5%
Calm 96.7%
Disgusted 1.8%
Angry 0.5%
Confused 0.2%
Surprised 0.2%
Fear 0.2%
Sad 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 94.2%
Calm 53.6%
Disgusted 44.3%
Surprised 1%
Happy 0.5%
Angry 0.3%
Confused 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 67%
Calm 99.9%
Angry 0%
Sad 0%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 37-45
Gender Female, 62.1%
Happy 57.3%
Calm 36.9%
Disgusted 3.4%
Angry 0.6%
Sad 0.6%
Fear 0.6%
Confused 0.4%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 94.9%
Calm 99.3%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Happy 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.6%
Angry 43.2%
Calm 37.3%
Fear 13.3%
Disgusted 3.7%
Happy 1.6%
Sad 0.3%
Surprised 0.3%
Confused 0.3%

Feature analysis

Amazon

Person
Painting
Lizard
Person 99%
Person 98.9%
Person 98.1%
Person 97.8%
Person 97.8%
Person 96.9%
Person 96%
Person 93.1%
Person 92.8%
Person 92.6%
Person 91.7%
Person 91.6%
Person 85.6%
Person 85%
Person 82.8%
Person 62%
Painting 98.2%
Lizard 68.5%

Categories

Imagga

paintings art 99.3%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-28

This image depicts a historical or ceremonial scene set in an architectural setting resembling a theater or courtroom. At the center of the composition, there is a group of ornately dressed individuals engaged in a discussion or observation. Surrounding them, more figures are gathered, some sitting and some standing, all wearing elaborate, period-specific clothing, suggesting a scene from a past era. Above the main group, there are additional figures seated on a ledge or gallery, observing the proceedings below. Prominently hanging above, in the upper part of the image, is a large figure of a lizard or salamander, which appears to be a decorative or symbolic element of the scene. The overall atmosphere is formal and structured, likely depicting a moment of importance or significance.

Created by gpt-4 on 2025-01-28

The image appears to be a detailed, monochromatic artwork, likely an etching or engraving from a historical period. The central scene takes place beneath an archway, where various figures are assembled. Many individuals, wearing garments that suggest a scene from the past, are gathered around what appears to be a focal event or ceremony. Above them hangs a large lizard-like creature. The architecture, clothing, and the way the figures are positioned give the artwork a formal and composed feel, indicative of a significant moment being depicted. The precise meaning or context of the scene is unclear from the image alone but may relate to a historical, mythological, or allegorical narrative.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-01-28

This appears to be a historical artwork, likely from the Renaissance period, showing a crowded indoor scene with multiple figures in period clothing including robes and medieval dress. The composition is arranged under an arched ceiling or doorway, with people seated along the top level and a large group gathered below. Most notable is a large lizard or salamander-like creature depicted at the very top of the arch. The image has a sepia or monochromatic tone, suggesting it might be a drawing or print rather than a painting. The scene appears to depict some kind of formal gathering or ceremony, with the figures arranged in a way that suggests a hierarchical or important social situation. The architectural elements include stone masonry and an arched design typical of medieval or Renaissance structures.

Created by claude-3-opus-20240229 on 2025-01-28

The image depicts a detailed illustration or painting from an earlier time period, likely the Renaissance era based on the clothing and architectural style. The scene shows a large gathering of people, possibly at a public event or ceremony, under an arched structure with hanging lizards or salamanders above. The people are wearing flowing robes and head coverings typical of the time. They appear to be intently focused on some central event or person(s) that are obscured from view in this particular framing of the scene. The realistic yet stylized rendering of the figures and setting suggests this is the work of a skilled artist capturing a moment of significance. The aged, sepia tone of the artwork lends an antique quality and air of historical importance to the mysterious scene that draws the viewer in to study the intricate details and ponder the story unfolding among the assembled crowd. It provides an intriguing glimpse into life, culture and artistry of a bygone era.

Created by claude-3-haiku-20240307 on 2025-01-28

The image appears to depict a large crowd of people in what seems to be a public setting or marketplace. There are a variety of figures present, including those wearing formal robes and garments, as well as more casually dressed individuals. In the background, there is an arched structure with a large, fantastical creature depicted above it. The overall scene conveys a sense of activity and interaction among the diverse group of people in the image.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-28

The image is an etching of a scene depicting a group of people gathered in an open space. The people are dressed in clothing from a past era, and some are wearing hats. In the center of the image, there is a man wearing a robe and holding a stick. A few people are sitting on the floor. Some people are standing on the platform, and a crocodile is hanging from the ceiling.

Created by amazon.nova-lite-v1:0 on 2025-01-28

The image is a vintage drawing depicting a scene with a large, lizard-like creature hanging from the ceiling. The drawing features a crowd of people gathered in a room, with some standing and others sitting. The crowd appears to be watching or observing something, possibly the creature hanging above them. The drawing has a monochromatic color scheme, giving it an antique and historical feel. The people in the drawing are dressed in period clothing, suggesting that the scene is set in a historical context. Overall, the image conveys a sense of wonder and curiosity, as the crowd is captivated by the strange and unusual creature in the room.

Text analysis

Amazon

and