Human Generated Data

Title

Saint Roch as a Pilgrim

Date

c. 1730

People

Artist: Giovanni Battista Tiepolo, Italian 1696 - 1770

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.123

Human Generated Data

Title

Saint Roch as a Pilgrim

People

Artist: Giovanni Battista Tiepolo, Italian 1696 - 1770

Date

c. 1730

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.123

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 99.3
Art 99.3
Person 97.2
Human 97.2
Apparel 55.4
Clothing 55.4
Face 55.2

Clarifai
created on 2018-03-16

painting 99.9
people 99.8
adult 99.7
art 99.3
illustration 99.1
one 99.1
wear 98.4
print 97.4
weapon 96.9
furniture 96.3
mammal 96
woman 95.6
lithograph 95.1
veil 94.9
man 94.9
two 94.7
reclining 94.3
seat 94
interaction 93.6
religion 91.8

Imagga
created on 2018-03-16

comic book 55.1
person 31.9
jacket 23.4
fashion 22.6
print media 22
people 21.7
book jacket 21.4
adult 20.2
portrait 18.8
attractive 18.2
man 18.1
male 14.9
face 14.2
weapon 13.8
sexy 13.6
elegance 13.4
style 13.3
gun 13.3
lady 13
stringed instrument 12.8
one 12.7
wrapping 12.7
model 12.4
smoke 12.1
hair 11.9
women 11.1
dress 10.8
lute 10.8
posing 10.7
human 10.5
sitting 10.3
elegant 10.3
expression 10.2
musical instrument 10.2
youth 10.2
covering 10.1
hat 10
dark 10
protection 10
sensuality 10
pretty 9.8
warrior 9.8
outdoors 9.7
body 9.6
costume 9.5
wall 9.4
culture 9.4
outdoor 9.2
studio 9.1
sensual 9.1
old 9.1
performer 9
soldier 8.8
happy 8.8
smile 8.5
dancer 8.5
sorcerer 8.5
black 8.4
fun 8.2
art 8.2
danger 8.2
dance 8.1
blond 8.1
happiness 7.8
military 7.7
war 7.7
arms 7.6
sport 7.4
suit 7.4
make 7.3
sun 7.2
lifestyle 7.2

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

book 93.5
person 91
text 89.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Female, 80.3%
Angry 2.4%
Calm 42.4%
Happy 1%
Disgusted 2.8%
Surprised 0.9%
Sad 48%
Confused 2.5%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.3%
Person 97.2%

Categories

Imagga

events parties 99.9%

Captions

Microsoft
created on 2018-03-16

a person holding a cat 38.4%
a person holding a dog 38.3%
a person holding a dog 38.2%

OpenAI GPT

Created by gpt-4 on 2024-01-27

This image depicts a painting of a seated individual dressed in a mix of garments reminiscent of classical attire, such as a draped cloth and leggings. Adjacent to this person is a rifle propped upright, adorned with a feathered plume attached near the barrel. At the individual's feet lies a resting dog with black and white coloring, seemingly asleep. In the background, there's a dramatic landscape featuring towering cliffs and a vibrant sky with an array of blues and warm golden hues, suggesting a setting or rising sun. A castle or built structure is visible in the distance, nestled among the rugged terrain. The painting captures a serene moment, possibly after a hunt or during a moment of reflection in the wilderness.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a man, likely a religious or historical figure, seated outdoors in a rugged, mountainous landscape. He is wearing a long, flowing cloak and appears to be carrying a staff or walking stick. At his feet lies a dog or other animal. The scene has a dramatic, almost somber quality, with the contrast between the man's pensive expression and the wild, rocky surroundings creating a sense of isolation or introspection.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a painting of Saint Roch, a Christian saint known for his healing powers and protection against the plague. He is shown sitting on a rock, wearing a brown tunic and a black cape with a yellow collar. In his right hand, he holds a staff adorned with a white cloth, while his left hand grasps a white cloth that covers his leg. A dog lies at his feet, and in the background, a cross and a cityscape are visible. The overall atmosphere of the painting conveys a sense of devotion and reverence for the saint.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a painting of a man sitting on a stone bench, holding a staff and wearing a black and orange robe with a yellow collar. He has long hair and a beard and is looking at the viewer with a serious expression. The man is sitting on a stone bench, with his legs crossed and his right hand resting on his knee. In his left hand, he holds a staff that has a feather tied to the end of it. The background of the painting is a blue sky with clouds, and there are buildings and trees in the distance. The overall atmosphere of the painting is one of contemplation and introspection, as the man sits in quiet reflection.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The painting depicts Saint Roch, a French nobleman who became a hermit after a pilgrimage to Rome. He is shown sitting on a rock, dressed in a black and red cloak, with a white cloth on his lap and a staff in his hand. A dog is lying at his feet, and a bird is perched on the staff. The landscape behind him features a rocky outcrop and a distant view of the sea. The painting is signed and dated "1636" in the lower right corner.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a man sitting on a rock with a dog beside him. He is holding a stick with a cloth tied to it. He is wearing a long-sleeve shirt, a vest, and a pair of sandals. The man's face is serious, and his eyes are looking to the right. Behind him, there is a large rock formation, and the sky is blue with some clouds.