Human Generated Data

Title

Friar Angelo Ferretti as Saint Peter Martyr

Date

1549

People

Artist: Lorenzo Lotto, Italian 1480 - 1556/1557

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes in memory of Alice F. Cary, 1964.4

Human Generated Data

Title

Friar Angelo Ferretti as Saint Peter Martyr

People

Artist: Lorenzo Lotto, Italian 1480 - 1556/1557

Date

1549

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes in memory of Alice F. Cary, 1964.4

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Art 100
Painting 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Face 95.7
Head 95.7
Photography 95.7
Portrait 95.7
Fashion 56.5
Text 55.7

Clarifai
created on 2023-10-18

people 99.3
man 98.7
portrait 98.7
art 98.4
painting 97.7
one 97.2
veil 96.4
wear 96.1
gown (clothing) 95.8
religion 95.7
facial hair 95.3
cross 95.2
adult 94.6
book series 94.4
cape 94
priest 94
Easter 92.3
sword 91.8
book 91.7
Renaissance 90.9

Imagga
created on 2018-12-27

man 32.9
person 27.9
male 24.9
adult 19.6
people 19
old 17.4
portrait 16.2
face 15.6
device 14.3
black 13.8
religion 13.4
sitting 12
sculpture 11.9
art 11.9
musical instrument 11.4
home 11.2
lady 10.5
stringed instrument 10.2
alone 10
happy 10
handsome 9.8
attractive 9.8
human 9.7
guy 9.6
grandfather 9.5
color 9.5
model 9.3
smile 9.3
head 9.2
hat 8.8
boy 8.7
rest 8.7
spiritual 8.6
serious 8.6
expression 8.5
religious 8.4
dark 8.3
fashion 8.3
holding 8.3
family 8
interior 8
lifestyle 7.9
labor 7.8
statue 7.8
men 7.7
holy 7.7
repair 7.7
faith 7.7
god 7.7
casual 7.6
relax 7.6
dirty 7.2
dress 7.2
work 7.1
hair 7.1
worker 7.1
job 7.1

Google
created on 2018-12-27

painting 88
portrait 86.4
art 77.3
gentleman 74.3
facial hair 66.7
human behavior 64.9
artwork 50.1

Microsoft
created on 2018-12-27

person 99.4
man 94.6
cellphone 90.1
art 57.5
clothing 47
music 32.1
portrait 24.6
museum 18.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 4.8%
Confused 3%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-01-27

The image shows a person dressed in a traditional habit, possibly indicative of a monastic order, with a white undergarment and a dark, possibly black, cape or mantle. The individual holds a small, green book in one hand, which is slightly open, while the other hand points downwards. Resting on the shoulder is the handle of a tool which appears to be a long-handled hammer or a mallet with a distinctive design, indicative of a specific profession or symbolic meaning. The backdrop is nondescript, providing a simple, dark background that offers little distraction from the subject. The attire and the tool suggest a historical or religious context, potentially denoting a figure of significance within a bygone era.

Created by gpt-4o-2024-05-13 on 2025-01-02

The image depicts a person wearing a hooded brown robe over a white garment. In their left hand, they hold a small book with a greenish cover. Their right hand is pointing downward. The individual has a loaf of bread tucked under their left arm, and a long saw is positioned horizontally above their head. Additionally, a dagger with a golden hilt rests on their right shoulder.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a man in monastic attire, wearing a dark cowl and cloak. He is holding a book in his hands, suggesting he is a scholarly or religious figure. His expression is solemn, and he appears to be deep in thought or contemplation. The painting has a dark, earthy tone, and the man's face is illuminated, drawing the viewer's attention to his pensive gaze.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

This image is a painting of a man dressed in a white robe and a brown cape, holding a book in his left hand. The man has short dark hair and a beard. He is wearing a white robe with long sleeves and a brown cape draped over his shoulders. In his left hand, he is holding a black book with a white label on the cover. The label has some illegible text written on it.

On the man's right shoulder, there is a dagger with a black handle and a gold tip. The background of the painting is a dark brown color. The overall atmosphere of the painting suggests that the man is a religious figure, possibly a monk or a priest, and the book he is holding may be a sacred text. The dagger on his shoulder adds a sense of protection and defense to the image.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a painting of a man dressed in a white robe and a dark brown cloak, holding a book in his left hand and a sword in his right. The man has short brown hair and a beard, and is wearing a white robe with long sleeves and a dark brown cloak draped over his shoulders. He holds a small black book in his left hand, with a white label on the cover, and a sword in his right hand, with the blade pointing upwards and the hilt resting on his shoulder.

The background of the painting is a warm, earthy tone, with subtle shading and texture that adds depth and dimension to the scene. The overall effect is one of serenity and contemplation, as if the man is lost in thought as he gazes out at the viewer.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image features a portrait of a man, possibly a religious figure, dressed in a white tunic and a dark cloak. He holds a small book in his left hand, and a sword is prominently displayed behind his head. The man's facial expression is solemn, and he appears to be looking intently at something or someone outside the frame. The background is dark, with the sword's handle and the man's head creating a striking contrast against the muted tones. The overall composition suggests a sense of solemnity and introspection, with the man's attire and the presence of the sword hinting at a religious or historical context.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a man with a beard and mustache wearing a white robe with a black cape. He is holding a book in his left hand and a sword in his right hand. He is looking to the right and pointing with his right hand. He has a beard and mustache. He is wearing a white robe with a black cape. The painting is on a brown background.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a portrait of a religious figure, presumably a saint, set against a dark, neutral background. The man has a stern, contemplative expression. He has a dark beard and a receding hairline. He is wearing a white robe with a brown scapular, which indicates that he is a member of a monastic order.

Above his head, on either side, are symbols of his martyrdom. On one side, a large, rusty cleaver is lodged in his head, and on the other, a dagger is placed near his neck. This imagery suggests that the man was killed in a violent manner. He also has a faint halo around his head, further indicating his sainthood.

In his hands, he holds a small book, possibly a bible or book of religious teachings. His right hand is gesturing outwards. The overall impression is one of religious solemnity and martyrdom.

Created by gemini-2.0-flash-lite on 2025-04-26

Here is a description of the image:

The image is a classic portrait of a religious figure, likely a saint, rendered in the style of an old master painting. Here are the key features:

  • Subject: A man is the central figure, appearing to be a monk or a member of a religious order, as indicated by his attire. He has a serious and focused expression, with a beard, and he has a halo above his head, suggesting a saintly status.
  • Attire: He is wearing a dark, hooded cloak draped over a white robe, typical of the religious order.
  • Symbols: The painting is rich with symbolic elements that help identify the figure. A large cleaver-like blade is positioned over the head, suggesting martyrdom. A dagger is positioned across his chest. He is holding a small book with a golden edge.
  • Artistic Style: The painting has a dark and somber color palette and a high degree of detail and realism. The brushstrokes are visible but well blended, typical of the period in which it was painted. The lighting is focused on the face and hands, drawing the viewer's attention.

Overall, it seems to be a portrait of a martyr saint.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a portrait of a man dressed in religious attire, likely a monk or friar, given the black hooded robe he is wearing over a white habit. The man has a beard and mustache, and his head is adorned with a halo, suggesting that he is a saint or a figure of religious significance.

He is holding a book in his left hand, which appears to be a religious text, possibly a Bible or prayer book. His right hand is pointing downward, possibly indicating a gesture of teaching or preaching. A dagger is stuck into his head, which is a distinctive attribute often associated with Saint Peter Martyr (also known as Saint Peter of Verona), a Dominican friar who was martyred in the 13th century.

The background is dark and plain, focusing attention on the figure. The overall composition and attire suggest that this is a religious portrait, likely from the Renaissance or Baroque period, given the style and detailing.

Text analysis

Amazon

WANA
NI
REDO
Nower
Nower Teflametum
Teflametum