Human Generated Data

Title

Giotto Painting Dante's Portrait

Date

c. 1859

People

Artist: Dante Gabriel Rossetti, British 1828 - 1882

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.488

Human Generated Data

Title

Giotto Painting Dante's Portrait

People

Artist: Dante Gabriel Rossetti, British 1828 - 1882

Date

c. 1859

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.488

Machine Generated Data

Tags

Amazon
created on 2020-05-03

Art 99.9
Painting 99.9
Person 99.4
Human 99.4
Person 98.3
Person 97.2

Clarifai
created on 2020-05-03

art 99.9
painting 99.7
people 99.6
Renaissance 99.5
saint 99.3
Mary 99.2
illustration 98.9
baby 98.5
religion 98.5
woman 98.1
gown (clothing) 98
veil 97.9
print 97.2
aura 96.4
adult 96
bonnet 95.7
baroque 95
seat 94.7
virgin 94.6
god 93.8

Imagga
created on 2020-05-03

person 34.7
man 30.9
couple 27
people 25.7
white 25.6
mother 25.5
adult 24.3
male 23.5
costume 21.6
home 20.7
happy 20.7
love 20.5
together 20.1
dress 19.9
portrait 19.4
sitting 18.9
happiness 18
family 17.8
lifestyle 15.9
attractive 15.4
old 15.3
fashion 15.1
couch 14.5
smiling 14.5
face 14.2
room 14.1
senior 14.1
child 13.8
clothing 13.6
husband 13.6
parent 13.4
monk 13.2
lady 13
traditional 12.5
indoors 12.3
two 11.9
smile 11.4
wife 11.4
reading 10.5
patient 10.2
casual 10.2
romantic 9.8
pretty 9.8
interior 9.7
daughter 9.5
hair 9.5
golden 9.5
culture 9.4
model 9.3
cute 9.3
art 9.2
book 9.1
vintage 9.1
robe 9
religion 9
handsome 8.9
father 8.7
affectionate 8.7
married 8.6
bathrobe 8.6
elderly 8.6
living 8.5
togetherness 8.5
mature 8.4
joy 8.3
20s 8.2
fun 8.2
style 8.2
kin 7.9
mask 7.9
boy 7.8
sofa 7.8
color 7.8
men 7.7
garment 7.7
expression 7.7
loving 7.6
hand 7.6
sit 7.6
elegance 7.6
house 7.5
human 7.5
tradition 7.4
joyful 7.3
groom 7.3
decoration 7.3
makeup 7.3
indoor 7.3
children 7.3
aged 7.2
sexy 7.2
holiday 7.2
women 7.1
kid 7.1

Google
created on 2020-05-03

Microsoft
created on 2020-05-03

painting 99.8
drawing 99.2
text 95.5
sketch 95.4
person 87.2
clothing 81.5
art 79.1
woman 73.8
old 64.1
human face 59.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 99.8%
Calm 71.8%
Angry 10.2%
Confused 3.4%
Happy 0.6%
Sad 11.9%
Disgusted 0.6%
Fear 0.9%
Surprised 0.6%

AWS Rekognition

Age 19-31
Gender Male, 99.4%
Fear 0%
Sad 0.4%
Happy 0.1%
Surprised 0.1%
Calm 98.8%
Disgusted 0.1%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 22-34
Gender Male, 54.1%
Angry 45%
Fear 45%
Surprised 45%
Happy 45%
Sad 47.7%
Confused 45%
Calm 52.1%
Disgusted 45%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.9%
Person 99.4%

Categories

Imagga

pets animals 94.9%
people portraits 3.3%

Captions

Microsoft
created on 2020-05-03

a group of people around each other 50.3%

Azure OpenAI

Created by gpt-4 on 2024-12-12

This image appears to be a painting or painting-like illustration of a scene with three individuals engaged in an activity around a table. The central figure is seated and is wearing a rich burgundy garment. This individual's hands are positioned as if they are interacting with a small, ornately decorated box bearing a circular motif, which may suggest the object is of significance within the depicted scene. Another figure to the left, wearing a vivid green robe with a pattern of yellow motifs, is seen offering a rectangular object towards the central figure. The rightmost figure is captured mid-gesture, and the portrayal suggests the action of holding a slender item, possibly a tool or implement, adding to the sense of an exchange or interaction taking place among the group. The setting includes a muted, warm-toned background, with sketch-like lines indicating the preliminary stages of the painting process, as if the artist has begun to outline additional details or figures that are yet to be fleshed out. The unfinished state of this portion of the scene gives viewers insight into the artist's method, with the penciled-in contours providing a peek into the development stages of the artwork. Additionally, though some faces are obscured, the visible clothing and the overall style suggest a historical or allegorical subject, often characteristic of traditional European religious or mythological art.

Created by gpt-4o-2024-05-13 on 2024-12-12

The image appears to be a painting that shows three individuals. Two of them are standing while one is seated. The person standing on the left is wearing a green garment adorned with a pattern resembling leaves, and is holding a book. The person in the middle is dressed in red and black clothes and appears to be holding a pomegranate. The individual seated on the right, wearing white, is extending a hand holding a tool, perhaps offering something or engaging in an activity together. The background of the painting has a muted, unfinished quality with visible sandy-colored brush strokes. The overall scene gives a sense of interaction or instruction among the figures.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-12

The image depicts three figures from a historical or dramatic scene. The central figure appears to be a woman in a red robe, sitting and holding some kind of object. To her left is a man with a beard and long hair, who seems to be examining or interacting with the woman. To the right, another man stands, also with long hair and a beard, appearing to be observing the interaction between the other two figures. The scene has a sense of artistic drama and seems to portray some sort of narrative or interaction between the characters.

Created by claude-3-5-sonnet-20241022 on 2024-12-12

This is a Pre-Raphaelite style painting showing three figures in medieval or Renaissance-era clothing. The composition shows a scene with three people - one wearing a green robe with decorative patterns, another in a deep red robe with a head covering, and a third figure in white who appears to be an artist holding a brush. The scene suggests an artist at work, possibly painting or sketching. The figures are arranged in an intimate grouping, with rich, deep colors characteristic of Pre-Raphaelite artwork. The background is minimally detailed with warm, neutral tones. The painting has an unfinished quality, particularly visible in the rightmost portion where the white-robed figure is less fully rendered than the others.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-12

The image depicts a painting of three men in a studio setting, with one man actively painting and the other two observing. The central figure, dressed in a red robe, holds a paintbrush and palette, while the man to his left, wearing a green robe, holds a book. The man on the right, partially obscured by a sketch of himself, appears to be the subject of the painting. The background of the painting is a warm, beige color, with subtle hints of yellow and brown. The overall atmosphere of the image is one of creativity and contemplation, as the three men engage in a shared activity that brings them together. The painting's style is reminiscent of the Impressionist movement, with its emphasis on capturing light and color. The use of muted tones and soft brushstrokes creates a sense of intimacy and quiet reflection, drawing the viewer into the serene world of the studio.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-12

The image depicts a painting of three men, with one man sitting and two standing. The man on the left is wearing a green robe with gold designs, while the man in the middle is dressed in a red robe and black hat. The man on the right is depicted in a white robe, holding a paintbrush and palette. The background of the painting features a beige wall with yellow accents. The overall atmosphere of the image suggests that it may be a scene from an artist's studio, with the man on the right possibly being the artist himself. The presence of the paintbrush and palette supports this interpretation. The image appears to be a work of art, likely created by a skilled painter.