Human Generated Data

Title

Portraits of the Family of Monte Catini

Date

19th century

People

Artist: Joseph Saunders, British 1773 - 1830

Artist after: Fra Bartolommeo della Porta, Italian 1472 - 1517

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3537

Human Generated Data

Title

Portraits of the Family of Monte Catini

People

Artist: Joseph Saunders, British 1773 - 1830

Artist after: Fra Bartolommeo della Porta, Italian 1472 - 1517

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3537

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.1
Human 99.1
Person 98
Art 96.6
Person 92.2
Person 87.2
Person 85.3
Painting 81.8
Person 79.5
Person 75.2
Person 74.5
Person 73.3
Person 70.4
Person 68.7
Person 65.4
Angel 65
Archangel 65
Person 65
Person 64.7
Person 63.2
Person 63
Person 62
Person 60.1
Person 47.7

Clarifai
created on 2018-03-16

people 100
illustration 99.7
art 99.5
group 99.3
man 98.1
print 97.4
adult 96.8
engraving 95.7
many 92.7
one 92.5
woman 89.8
several 89.3
child 89
veil 88.2
two 86.4
painting 85.5
leader 85.4
administration 82.6
visuals 82.4
music 81.2

Imagga
created on 2018-03-16

sculpture 71.7
carving 60.3
art 47.3
comic book 42
temple 41
architecture 40.9
ancient 33.8
religion 33.2
history 31.3
statue 31
culture 29.9
stone 29.3
monument 24.3
plastic art 23.7
old 23.7
travel 22.6
religious 22.5
god 21.1
famous 19.6
building 18.3
figure 18.1
holy 17.4
print media 16.8
tourism 16.5
landmark 16.3
decoration 16.1
historical 16
carved 15.7
structure 15.1
heritage 14.5
detail 14.5
sculptures 13.8
historic 13.8
spirituality 13.5
city 13.3
church 13
traditional 12.5
tourist 11.8
spiritual 11.5
symbol 11.5
wall 11.1
cemetery 11
southeast 10.9
statues 10.8
memorial 10.4
china 10.3
brass 9.8
antique 9.7
faith 9.6
east 9.3
cathedral 9
bas reliefs 8.9
museum 8.8
century 8.8
facade 8.8
worship 8.7
meditation 8.6
holiday 8.6
face 8.5
tradition 8.3
12th 7.9
mythology 7.9
artistic 7.8
lion 7.8
marble 7.8
palace 7.7
attraction 7.7
relief 7.4
graffito 7.4
gold 7.4
exterior 7.4

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

text 98
book 97.7
old 63.6
posing 54.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 19-36
Gender Female, 52.7%
Disgusted 45.1%
Surprised 45%
Sad 54.2%
Calm 45.4%
Angry 45.1%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Happy 45.1%
Angry 45.3%
Disgusted 45%
Calm 52%
Sad 47%
Surprised 45.1%
Confused 45.4%

AWS Rekognition

Age 27-44
Gender Female, 54.8%
Sad 49.9%
Disgusted 45.1%
Confused 46.4%
Surprised 45.3%
Calm 46.6%
Angry 46%
Happy 45.5%

AWS Rekognition

Age 2-5
Gender Female, 54.5%
Sad 52.2%
Confused 45.6%
Happy 45.2%
Disgusted 45.2%
Angry 45.6%
Surprised 45.3%
Calm 45.9%

AWS Rekognition

Age 48-68
Gender Male, 53.5%
Sad 47.6%
Calm 51.1%
Confused 45.3%
Angry 45.3%
Happy 45.4%
Disgusted 45.1%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 45.6%
Calm 46.3%
Happy 45.8%
Angry 45.7%
Sad 50.7%
Confused 45.6%
Surprised 45.3%

AWS Rekognition

Age 16-27
Gender Male, 51.1%
Angry 45.9%
Disgusted 45.3%
Happy 45.1%
Sad 51.6%
Calm 46.4%
Confused 45.2%
Surprised 45.3%

AWS Rekognition

Age 45-63
Gender Female, 51.5%
Sad 53.9%
Angry 45.1%
Disgusted 45.8%
Surprised 45%
Calm 45.1%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 10-15
Gender Female, 53.3%
Happy 45.3%
Disgusted 45.3%
Calm 46.1%
Surprised 45.2%
Angry 45.4%
Sad 52.4%
Confused 45.3%

AWS Rekognition

Age 17-27
Gender Female, 54.2%
Sad 46.4%
Surprised 45.6%
Confused 45.3%
Happy 46.3%
Calm 45.5%
Disgusted 45.8%
Angry 50.1%

AWS Rekognition

Age 45-63
Gender Male, 50.5%
Sad 46.5%
Disgusted 48.3%
Surprised 45.4%
Confused 45.4%
Angry 46%
Happy 46.1%
Calm 47.3%

AWS Rekognition

Age 26-43
Gender Female, 53.5%
Confused 45.1%
Surprised 45.1%
Calm 45.1%
Sad 52.4%
Disgusted 46.5%
Happy 45.6%
Angry 45.3%

AWS Rekognition

Age 38-59
Gender Female, 52.2%
Sad 53.4%
Surprised 45.1%
Calm 45.5%
Happy 45.1%
Angry 45.7%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 53.6%
Calm 46.2%
Sad 48.7%
Confused 45.7%
Happy 45.8%
Disgusted 47.2%
Angry 45.6%
Surprised 45.6%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Surprised 45.4%
Happy 45.2%
Disgusted 50.6%
Calm 45.9%
Sad 46.9%
Angry 45.6%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Male, 51.9%
Disgusted 45.4%
Angry 45.4%
Calm 52.5%
Sad 45.6%
Happy 45.6%
Confused 45.2%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Sad 50.5%
Disgusted 46.1%
Surprised 45.7%
Confused 45.3%
Angry 46.3%
Happy 45.5%
Calm 45.6%

AWS Rekognition

Age 35-52
Gender Male, 53.3%
Happy 45.4%
Confused 45.4%
Calm 45.3%
Sad 46.2%
Angry 51.9%
Disgusted 45.6%
Surprised 45.3%

AWS Rekognition

Age 6-13
Gender Female, 51.2%
Calm 45.1%
Angry 45.1%
Disgusted 45.2%
Happy 45%
Confused 45.1%
Surprised 45.1%
Sad 54.5%

AWS Rekognition

Age 29-45
Gender Female, 52.1%
Sad 45.8%
Surprised 45.4%
Disgusted 46.9%
Confused 45.9%
Calm 49.9%
Happy 45.2%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Calm 54.1%
Sad 45.4%
Confused 45.1%
Disgusted 45.1%
Happy 45.1%
Surprised 45.2%
Angry 45.1%

AWS Rekognition

Age 57-77
Gender Female, 52.2%
Calm 46.8%
Angry 46.1%
Happy 45.5%
Disgusted 48%
Sad 47.7%
Surprised 45.4%
Confused 45.5%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Happy 46.4%
Disgusted 50.5%
Confused 45.3%
Calm 45.6%
Sad 46.1%
Angry 45.6%
Surprised 45.5%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Angry 45.8%
Sad 46%
Happy 45.3%
Surprised 45.3%
Confused 45.3%
Disgusted 45.9%
Calm 51.5%

AWS Rekognition

Age 38-59
Gender Male, 55%
Surprised 45.2%
Happy 45.3%
Disgusted 48.1%
Calm 47.5%
Sad 45.5%
Angry 46.3%
Confused 47.1%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Disgusted 45.3%
Surprised 45.2%
Angry 45.9%
Sad 52.8%
Confused 45.2%
Happy 45.2%
Calm 45.6%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Sad 49.6%
Calm 49.9%
Confused 49.5%
Angry 49.6%
Happy 49.6%
Disgusted 49.7%
Surprised 49.5%

AWS Rekognition

Age 38-59
Gender Female, 51.3%
Confused 45.2%
Sad 47.3%
Angry 45.4%
Calm 47.4%
Happy 48.9%
Surprised 45.2%
Disgusted 45.6%

AWS Rekognition

Age 26-43
Gender Female, 53.1%
Surprised 46.2%
Disgusted 45.2%
Confused 45.3%
Sad 52.5%
Angry 45.4%
Happy 45.1%
Calm 45.2%

AWS Rekognition

Age 4-9
Gender Female, 53.3%
Sad 45.3%
Surprised 45.6%
Disgusted 46.7%
Confused 45.4%
Calm 51.1%
Happy 45.2%
Angry 45.7%

AWS Rekognition

Age 35-53
Gender Female, 52.5%
Calm 51.4%
Surprised 45.4%
Happy 45.7%
Sad 46.3%
Disgusted 45.2%
Confused 45.3%
Angry 45.7%

AWS Rekognition

Age 35-52
Gender Female, 54.7%
Calm 48.2%
Angry 45.8%
Disgusted 46.2%
Sad 47.5%
Surprised 45.6%
Happy 46%
Confused 45.6%

AWS Rekognition

Age 45-65
Gender Female, 52%
Calm 52.6%
Sad 46.1%
Confused 45.3%
Happy 45.3%
Disgusted 45.2%
Angry 45.2%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Happy 45.7%
Calm 51.5%
Surprised 45.4%
Angry 45.3%
Confused 45.2%
Disgusted 46.4%
Sad 45.5%

Feature analysis

Amazon

Person 99.1%
Painting 81.8%

Captions

Azure OpenAI

Created by gpt-4o-2024-05-13 on 2024-12-16

The image is an elaborate and detailed classical artwork depicting a central figure surrounded by numerous other figures. The central figure is elevated on steps and appears to be holding a gesture that suggests a moment of significance or blessing. There are angels around the central figure, some holding ribbons with inscriptions. The surrounding figures appear engaged in various interactions, with some kneeling or reaching out towards the central figure, and others holding young children. The scene carries a sense of reverence, divinity, and importance, typical of religious or mythological themes. At the bottom center, there is a coat of arms. The image is rendered in a monochromatic, engraved style, giving it a timeless and historically significant feel. The words "MISERICORDIE SVB UMBRAM" are written on a banner held by the angels and the inscription "MC: PLTATE: ET: MIR: IESUNDOF" is on the steps.

Created by gpt-4 on 2024-12-16

This image is a black and white engraving or print that depicts a grand classical scene with a multitude of figures, likely intended to represent a mythological, historical, or allegorical narrative. The background features architectural elements such as stairs or a pedestal, and a large assembly of figures is presented in a dramatic arrangement. The scene includes drapery and several figures who look like they are either in motion or displaying a range of emotions. The bottom of the print contains an emblem or coat of arms, and there are inscriptions in Latin throughout the image, which suggest a serious, perhaps religious or commemorative, context for the artwork.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-16

This image appears to be a religious or allegorical scene, depicted in an intricate engraved style. At the center is a woman in flowing robes, likely representing the Virgin Mary, surrounded by numerous figures. Above her are winged angelic figures. The overall composition has a grand, dramatic quality, with the central figure occupying a raised platform and being venerated by the people below. The textual elements, including the Latin inscription, suggest this is a religious or devotional work of art, though without being able to identify any specific individuals, I can only describe the general elements and composition of the image.

Created by claude-3-5-sonnet-20241022 on 2024-12-16

This appears to be a religious artwork, likely an engraving or print from a classical period. The composition shows a central female figure in robes standing on steps with her arms outstretched, surrounded by cherubs or angels in the upper portion holding drapery or banners. There is text in Latin visible, including "MISERICORDIA SVA" at the top. The lower portion shows a crowd of figures gathered on either side of the steps, including what appears to be clergy, common people, and a mother with a child. The style is typical of religious Renaissance or Baroque art, with dramatic lighting and careful attention to the folds of fabric and facial expressions. The overall theme appears to be related to mercy or divine intervention, given the Latin text and the upward-reaching posture of the central figure.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-16

The image depicts a black-and-white illustration of the Virgin Mary, surrounded by angels and people. The Virgin Mary is positioned at the center of the image, wearing a long robe and a head covering. She has her arms outstretched, with her right hand pointing upwards and her left hand pointing downwards. Above her, there are two cherubs holding a banner with Latin text that reads "MISERIOR SVR FVRBAM". Below the Virgin Mary, there are several people gathered around her, including men, women, and children. Some of them are kneeling or sitting on the ground, while others are standing. In the foreground, there is a woman holding a baby, who appears to be Jesus Christ. The background of the image features a cloudy sky with a few wispy clouds. Overall, the image conveys a sense of reverence and devotion to the Virgin Mary, who is often depicted as a symbol of hope and salvation in Christian art. The presence of angels and cherubs adds to the heavenly atmosphere, while the people gathered around her represent the faithful who seek her intercession and guidance.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-16

The image depicts a black-and-white engraving of a religious scene, featuring a central figure of the Virgin Mary surrounded by a crowd of people and angels. At the top of the image, two cherubs are shown holding a banner with the inscription "MISEREOR SYT EVREAM," which translates to "Have pity on us, O Lord." Below the cherubs, a woman is depicted standing on a set of stairs, wearing a long robe and a veil over her head. She is shown with her arms outstretched, as if in prayer or supplication. The woman is surrounded by a large group of people, who are all dressed in robes and veils, suggesting that they are also religious figures. Some of the people are kneeling or prostrating themselves before the woman, while others are standing or sitting around her. In the background, there is a subtle depiction of clouds and a sky, which adds to the overall sense of reverence and spirituality in the image. Overall, the image appears to be a representation of a religious scene, possibly depicting the Virgin Mary or another important figure in Christian theology. The use of angels, cherubs, and other religious symbols reinforces this interpretation, and the overall mood of the image is one of reverence and devotion.

Text analysis

Amazon

MISEREORL
MISEREORL 5VE
FVRBAME
5VE
TUIS
TUIS r
r