Human Generated Data

Title

Virgin and Child with the Infant Saint John the Baptist, Saint Jerome, and an Unidentified Male Saint

Date

16th century

People

Artist: Bartolommeo Neroni, called il Riccio, Italian c. 1500 - before 1571

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Evelyn S. Griswold, Gladys S. May, and Eirene W. Smyth, 1958.85

Human Generated Data

Title

Virgin and Child with the Infant Saint John the Baptist, Saint Jerome, and an Unidentified Male Saint

People

Artist: Bartolommeo Neroni, called il Riccio, Italian c. 1500 - before 1571

Date

16th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Evelyn S. Griswold, Gladys S. May, and Eirene W. Smyth, 1958.85

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 98.7
Person 98.7
Person 96.7
Person 93.9
Art 92.1
Person 92
Painting 76.8
Photography 67.5
Photo 67.5
Portrait 67.5
Face 67.5
Jaw 63.2

Clarifai
created on 2020-04-24

people 100
portrait 99.2
adult 98.9
two 98.6
man 98.5
three 97.9
group 97.8
affection 97
baby 95.2
facial expression 93.2
art 93.2
administration 93
son 92.8
four 91.6
child 90.9
group together 90.8
interaction 90.2
actor 90
family 89.8
music 89.2

Imagga
created on 2020-04-24

family 63.2
child 60.8
father 55.7
mother 50.9
male 46
happy 45.8
kin 44.5
love 44.2
together 42.1
parent 41.7
grandfather 39
dad 37.6
man 36.3
smiling 34.7
people 31.8
couple 31.4
husband 28.6
portrait 28.5
son 28.2
daughter 28
kid 27.5
fun 26.9
adult 26.5
home 25.5
smile 25
wife 24.7
happiness 24.3
children 22.8
senior 22.5
brother 21.6
cute 21.5
boy 20.9
sibling 20.9
togetherness 20.8
casual 19.5
baby 19.2
kids 18.8
lifestyle 18.8
hug 18.4
person 17.8
loving 17.2
laughing 17
childhood 16.1
two 16.1
joy 15.9
affectionate 15.5
sitting 15.5
cheerful 15.4
married 15.3
mature 14.9
old 14.6
mom 14.5
face 14.2
grandmother 13.7
group 13.7
parents 13.7
playing 13.7
couch 13.5
affection 13.5
little 13.3
interior 12.4
hugging 11.7
30s 11.5
elderly 11.5
attractive 11.2
juvenile 11
life 10.9
handsome 10.7
outdoors 10.5
men 10.3
relaxing 10
studio 9.9
generations 9.9
sister 9.8
retired 9.7
retirement 9.6
generation 9.6
enjoying 9.5
camera 9.2
adorable 9.2
leisure 9.1
holding 9.1
park 9.1
60s 8.8
embracing 8.8
indoors 8.8
diversity 8.7
four 8.6
race 8.6
black 8.4
pretty 8.4
blond 8.3
clothing 8.2
gray 8.1
grandma 7.9
women 7.9
grandparents 7.9
mommy 7.9
bond 7.9
parenthood 7.8
color 7.8
boys 7.8
play 7.8
infant 7.7
comfort 7.7
laugh 7.7
youth 7.7
ethnic 7.6
house 7.5
friends 7.5
relationship 7.5
girls 7.3
room 7.3
day 7.1

Google
created on 2020-04-24

Portrait 65.1
Photography 62.4
Photo caption 54.7
Art 50.2

Microsoft
created on 2020-04-24

text 100
book 99.7
human face 97.1
baby 94.7
sketch 94.2
person 92.3
drawing 90.9
painting 77.8
posing 68.2
toddler 60.5
man 50.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-25
Gender Female, 95.4%
Calm 67.7%
Fear 0.3%
Angry 1%
Sad 29.6%
Surprised 0.1%
Disgusted 0.2%
Happy 0.1%
Confused 0.9%

AWS Rekognition

Age 35-51
Gender Male, 98.6%
Calm 20.6%
Disgusted 0.4%
Surprised 0.3%
Fear 0.7%
Happy 0.2%
Angry 2.8%
Sad 71.5%
Confused 3.6%

AWS Rekognition

Age 34-50
Gender Male, 89.9%
Disgusted 5.4%
Fear 3.1%
Sad 18.2%
Calm 48.5%
Happy 1.8%
Confused 5.2%
Surprised 4.9%
Angry 12.8%

AWS Rekognition

Age 51-69
Gender Male, 97.1%
Disgusted 0.9%
Fear 0.4%
Sad 86.7%
Happy 0.4%
Angry 2.2%
Surprised 0.3%
Calm 7.1%
Confused 2.1%

AWS Rekognition

Age 21-33
Gender Female, 80.8%
Surprised 0.2%
Sad 1.4%
Confused 0.6%
Disgusted 0.6%
Fear 0.1%
Angry 60.9%
Happy 0.2%
Calm 35.9%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 98.7%
Person 96.7%
Person 93.9%
Person 92%
Painting 76.8%

Categories

Imagga

people portraits 59.5%
paintings art 40.1%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-04

The image shows a grayscale photo or a reproduction of a classic piece of art. It appears to be a traditional painting, perhaps from the Renaissance or a similar period, judging by the clothing and the style of the artwork. The central figure seems to be seated and is holding a young child on their lap, with another figure standing to the side, possibly interacting with the seated figure or the child. The clothing suggests draped robes or garments typical of historical or religious artwork. The scene might represent a family or a religious group. The intricate frame surrounding the artwork features decorative elements, adding to the classical look of the piece. The use of light and shadow creates a three-dimensional effect on the figures' drapery and contributes to the overall solemn and contemplative atmosphere of the scene.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a classical religious painting, likely from the Renaissance period. The composition shows five figures in a traditional style - a central female figure wearing draped clothing and a head covering, flanked by two older male figures with beards, and two young children or cherubs in the foreground. The painting has a dark background and is displayed in an ornate decorative frame with a leaf or feather pattern border. The artwork demonstrates the careful attention to light, shadow, and fabric textures characteristic of Renaissance painting techniques. The black and white reproduction suggests this may be an archival photograph of the original artwork.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a black and white painting or artwork depicting a religious scene. The central figure is a woman, likely the Madonna or Virgin Mary, holding two infant children. The woman is surrounded by two older male figures, who appear to be religious figures or saints. The scene has a somber, serious tone, and the use of chiaroscuro lighting and shadowing creates a dramatic, atmospheric effect. The ornate frame around the painting also adds to the formal, classical style of the artwork.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

The image is a black-and-white painting of the Holy Family, depicting Mary, Joseph, and the infant Jesus. The painting is framed in an ornate white frame with a leafy design. Mary is seated in the center of the painting, holding the infant Jesus on her lap. She wears a long-sleeved dress with a draped neckline and a headscarf. Joseph stands behind her, looking down at the child. He has a long beard and wears a robe. To the left of Mary stands a young John the Baptist, who is holding a staff and looking at the child. The background of the painting is dark, which helps to focus attention on the figures in the foreground. The overall mood of the painting is one of serenity and devotion, capturing a tender moment between the Holy Family and their young cousin. The use of muted colors and soft lighting adds to the sense of calm and reverence, making the painting a beautiful representation of this important biblical scene.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-25

The image depicts a painting of the Holy Family, featuring Mary, Joseph, and Jesus. The painting is rendered in black and white, with Mary seated in the center, holding the infant Jesus on her lap. Joseph stands to the left of Mary, while an older man, likely Saint Joseph, stands to the right. The painting is framed by an ornate border, adding to its aesthetic appeal. The overall composition of the painting is one of serenity and devotion, capturing a tender moment in the lives of the Holy Family.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a black-and-white painting of a woman holding a baby. She is sitting in front of a man with a beard and another man with a mustache. The man with a beard is looking down, while the man with a mustache is looking to the side. The baby is holding the hand of another baby, who is holding a piece of paper. The painting is framed in a silver frame.

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a black-and-white painting of the Holy Family, which includes Mary, Jesus, Joseph, and John the Baptist. The painting is framed in a silver frame with intricate designs. The Holy Family is depicted in a serene and peaceful atmosphere, with Mary holding Jesus on her lap, and Joseph and John the Baptist standing beside them. The painting has a vintage look, and the figures are rendered in a detailed and realistic style. The painting is likely an old artwork, possibly from the Renaissance or Baroque period.

Text analysis

Amazon

in
in e 0M6
0M6
e