Human Generated Data

Title

Joos van der Burch and Saint Simon of Jerusalem

Date

c. 1493

People

Artist: Gerard David, Netherlandish c. 1460 - 1523

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of George W. Harris in memory of John A. Harris (to Harvard College), 1906.6.B

Human Generated Data

Title

Joos van der Burch and Saint Simon of Jerusalem

People

Artist: Gerard David, Netherlandish c. 1460 - 1523

Date

c. 1493

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of George W. Harris in memory of John A. Harris (to Harvard College), 1906.6.B

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Adult 99.9
Female 99.9
Person 99.9
Woman 99.9
Face 96.6
Head 96.6
Adult 94.5
Person 94.5
Male 94.5
Man 94.5
Cross 89.2
Symbol 89.2
Person 80.3
Person 73.7
Person 64.1
Accessories 56.5
Jewelry 56.5
Ring 56.5
Photography 56.4
Portrait 56.4

Clarifai
created on 2018-02-09

people 99
religion 96.7
painting 95.7
one 95.1
man 94.4
art 94
adult 93
wear 89.3
god 83.8
sculpture 82.2
portrait 81.8
veil 81.2
woman 80.8
spirituality 79.3
music 77.8
leader 74.8
church 73.3
temple 73.1
print 72.5
statue 72.2

Imagga
created on 2018-02-09

man 34.9
portrait 32.3
grandma 30.2
person 29.8
male 26.2
senior 24.4
fan 21.4
old 20.2
people 20.1
handsome 19.6
adult 19.5
elderly 19.1
happy 18.8
face 17
mature 16.7
follower 15.7
couple 15.7
hair 14.3
love 14.2
smiling 13.7
grandfather 13.3
black 13.2
mother 13
gown 12.5
happiness 11.8
retired 11.6
smile 11.4
together 11.4
vestment 10.9
grandmother 10.8
interior 10.6
retirement 10.6
wife 10.4
expression 10.2
church 10.2
lifestyle 10.1
art 9.9
human 9.7
lady 9.7
husband 9.7
one 9.7
outdoors 9.7
hat 9.7
married 9.6
clothing 9.6
eyes 9.5
glasses 9.3
head 9.2
aged 9
family 8.9
call 8.7
golden 8.6
casual 8.5
pretty 8.4
attractive 8.4
vintage 8.3
fun 8.2
gray 8.1
religion 8.1
looking 8
women 7.9
sitting 7.7
god 7.7
age 7.6
laughing 7.6
dark 7.5
mosaic 7.5
traditional 7.5
closeup 7.4
life 7.3
currency 7.2
colorful 7.2
romance 7.1
beard 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 96
man 90.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Calm 62.1%
Confused 14.7%
Fear 9.4%
Surprised 8.3%
Sad 7.3%
Angry 1.7%
Disgusted 1%
Happy 0.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Ring
Adult 99.9%
Adult 94.5%
Female 99.9%
Person 99.9%
Person 94.5%
Person 80.3%
Person 73.7%
Person 64.1%
Woman 99.9%
Male 94.5%
Man 94.5%
Ring 56.5%

Categories

Captions

Microsoft
created on 2018-02-09

a man wearing a costume 79.2%
a person wearing a costume 79.1%
a man wearing a hat 66.5%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This is a detailed artwork depicting two individuals. One is dressed in elaborate, ornate religious attire that includes a richly decorated garment and a tall, ornate headdress adorned with jewels and intricate patterns. The other individual is clad in luxurious, fur-lined clothing with a vibrant red inner garment. The person in religious attire holds a golden staff decorated with figures and scenes, suggesting significant religious or ceremonial importance. In the background, there is a scenic view through a window, showing a hilly landscape with a crucifix and a distant town or village, suggesting a setting of historical or religious context. To the left, there is a scroll with Latin text visible, adding to the historical and cultural richness of the artwork.

Created by gpt-4 on 2024-01-27

This is an image of a classic painting, depicting a figure in ornate religious garb, such as a bishop or a high-ranking cleric. The figure can be seen wearing a detailed mitre decorated with intricate patterns, precious stones, and religious iconography. The clothing includes a lush green robe with golden borders that highlight its luxurious texture, a red garment underneath, and a black cloak draped over one shoulder. This individual is holding what appears to be a golden crosier, indicating a position of ecclesiastical authority. In the background, to the left of the figure, there is a view of a pastoral landscape with people and a clear blue sky; to the right is a dark interior with a window pane showing a small stained glass design.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts two figures, one a young man in a red garment and the other an older man wearing an ornate, jewel-encrusted ecclesiastical headdress. The young man has a serious expression on his face and is holding a scroll or document. The older man, likely a high-ranking religious figure, is looking off to the side with a contemplative gaze. The background includes a landscape with a town or castle in the distance, suggesting a religious or historical setting. The overall composition and attention to detail suggest this is a Renaissance-era painting or work of art.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image depicts a painting of two men, one holding a scroll and the other wearing a bishop's attire. The man on the left has short brown hair and is dressed in a black robe with a red shirt underneath. He holds a white scroll in his right hand, which features illegible text written in an old language. Behind him stands a man wearing a bishop's hat and holding a gold staff adorned with intricate designs. The bishop's attire includes a green robe with gold accents and a red lining visible around his neck. The background of the painting features a landscape with rolling hills and a blue sky, suggesting a serene and peaceful atmosphere. Overall, the image appears to be a historical or religious painting, possibly depicting a scene from the Bible or a significant event in Christian history. The use of rich colors and detailed designs adds depth and complexity to the image, inviting the viewer to explore its meaning and significance.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image is a painting of a young man and an older man, likely a bishop or cleric, set against a backdrop of a landscape and a stained glass window. The young man has short brown hair and wears a red shirt with a black jacket, holding a white scroll in his hands. The older man, dressed in ornate attire, including a gold crown and a green robe, stands behind the young man, holding a staff in his right hand. The painting is rendered in a style reminiscent of the Northern Renaissance, characterized by its attention to detail and realism. The use of color and composition creates a sense of depth and dimensionality, drawing the viewer's eye through the scene. The stained glass window in the background adds a touch of vibrancy and texture to the painting, while the landscape outside serves as a reminder of the world beyond the confines of the room. Overall, the image presents a captivating and detailed portrayal of two figures, set against a richly textured and colorful backdrop. The painting's style and composition evoke a sense of history and tradition, inviting the viewer to ponder the story and context behind the scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting features two people standing next to each other. The person on the left is wearing a black coat and holding a piece of paper. The person on the right is wearing a green and red robe and holding a golden object. The person on the right is also wearing a hat. Behind them is a window with a view of a city and a mountain range.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The panel shows the donor, Ulrich Fugger, kneeling before St Nicholas. The panel was probably part of a diptych, the other wing of which is lost. The donor is shown in the left wing, the patron saint in the right wing. The landscape in the background shows a battle scene. The panel is signed and dated on the scroll held by the donor: "ANNO DOMINI 1493 / HIC FUGIT / ULR[ICHUS] FUGGER".

Text analysis

Amazon

CD
to
and to CD
and