Human Generated Data

Title

Madonna and Child with Saints Nicholas of Tolentino, Monica, Augustine, and John the Evangelist

Date

15th century

People

Artist: Girolamo di Benvenuto di Giovanni del Guasta, Italian 1470 - 1524

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes in memory of Richard Norton, 1927.206

Human Generated Data

Title

Madonna and Child with Saints Nicholas of Tolentino, Monica, Augustine, and John the Evangelist

People

Artist: Girolamo di Benvenuto di Giovanni del Guasta, Italian 1470 - 1524

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes in memory of Richard Norton, 1927.206

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Art 99.5
Painting 99.5
Person 95.2
Human 95.2
Person 94.5
Person 93.3
Person 83.4
Person 76.7
Mural 57.8
Figurine 55.3
Person 50

Clarifai
created on 2018-03-24

painting 99.6
religion 99.6
art 99.4
saint 99.3
people 99.2
illustration 98.5
god 98.1
veil 96.7
gown (clothing) 96.4
woman 96.4
aura 96
crown 95.7
Mary 95.6
holy 95.1
adult 93.9
wear 93.4
cape 92.6
royalty 92.4
group 91.4
man 91.2

Imagga
created on 2018-03-24

vestment 74.7
gown 59
outerwear 44.8
religion 39.4
art 37.8
culture 30.8
religious 30
clothing 29.2
temple 26.5
church 25
metropolitan 24.1
gold 23
traditional 22.4
old 22.3
faith 22
covering 21.6
travel 20.4
sculpture 20.3
ancient 19.9
architecture 19.5
spirituality 19.2
spiritual 18.2
god 18.2
colorful 17.9
sacred 17.5
prayer 17.4
holy 17.3
prayer rug 16.8
decoration 16.6
worship 16.4
golden 16.3
altar 16.1
detail 16.1
tourism 15.7
rug 15.4
statue 15.2
consumer goods 15.1
historic 14.7
icon 14.2
face 14.2
symbol 14.1
antique 13.8
saint 13.5
history 13.4
east 13.1
pray 12.6
costume 12.3
tradition 12
color 11.7
catholic 11.5
interior 11.5
historical 11.3
structure 11.1
design 10.7
museum 10.7
people 10.6
style 10.4
floor cover 10.2
furnishing 10.1
figure 10
vintage 9.9
oriental 9.8
bible 9.8
belief 9.7
throne 9.7
building 9.5
painted 9.5
famous 9.3
mosaic 9.1
pattern 8.9
shrine 8.8
festival 8.6
holiday 8.6
monument 8.4
crown 8.3
ornate 8.2
landmark 8.1
virgin 7.9
bangkok 7.9
artistic 7.8
chair of state 7.8
cathedral 7.7
door 7.6
stone 7.6
letter 7.6
man 7.4
makeup 7.3
person 7.2
celebration 7.2

Google
created on 2018-03-24

art 93.5
painting 80
tapestry 70.1
middle ages 68.9
history 61.6
artwork 60.2
collection 53.4
monarch 52.6
miniature 50.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 92.2%
Sad 6%
Angry 2.3%
Happy 1.7%
Surprised 4%
Disgusted 2.4%
Calm 81.5%
Confused 2%

AWS Rekognition

Age 1-5
Gender Female, 52.4%
Happy 45.1%
Calm 45%
Sad 54.6%
Surprised 45%
Angry 45.1%
Disgusted 45.1%
Confused 45%

AWS Rekognition

Age 35-52
Gender Female, 52.3%
Calm 49.2%
Happy 45.3%
Surprised 45.7%
Confused 45.9%
Angry 45.7%
Sad 45.9%
Disgusted 47.3%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Confused 45.8%
Happy 45.1%
Angry 46.2%
Calm 48.9%
Sad 48.5%
Disgusted 45.2%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Female, 53.9%
Angry 45.1%
Happy 45%
Sad 54.7%
Surprised 45%
Calm 45%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Surprised 45.1%
Disgusted 45.1%
Calm 45.3%
Sad 53.8%
Happy 45.1%
Confused 45.3%
Angry 45.4%

AWS Rekognition

Age 23-38
Gender Female, 54%
Disgusted 45.1%
Sad 54.8%
Calm 45%
Angry 45.1%
Surprised 45%
Confused 45%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Disgusted 45.2%
Surprised 45.1%
Angry 45.5%
Sad 53.8%
Happy 45.1%
Calm 45.2%
Confused 45.1%

AWS Rekognition

Age 60-90
Gender Male, 99.9%
Disgusted 0.6%
Sad 2%
Happy 0.8%
Confused 1.7%
Angry 2.5%
Calm 91.6%
Surprised 0.9%

AWS Rekognition

Age 4-7
Gender Female, 54.6%
Confused 45.1%
Happy 45.1%
Sad 52%
Disgusted 45%
Surprised 45.1%
Angry 45.2%
Calm 47.4%

AWS Rekognition

Age 20-38
Gender Female, 96.9%
Calm 33%
Angry 4.8%
Confused 4.5%
Sad 52.1%
Surprised 1.7%
Happy 1.8%
Disgusted 2%

AWS Rekognition

Age 38-57
Gender Male, 98.5%
Sad 3.8%
Surprised 1.4%
Calm 88.6%
Disgusted 0.5%
Happy 0.7%
Confused 2.3%
Angry 2.6%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 72
Gender Female

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.5%
Person 95.2%

Captions

Azure OpenAI

Created on 2024-01-25

This image is a detailed painting depicting a scene with several figures in what appears to be a luxurious interior setting, characterized by a decorative floor with geometric patterns and intricate architectural details, such as Corinthian columns and a throne-like chair. Two central figures are richly dressed in voluminous robes featuring deep blues and vibrant reds, seated with an intimate and regal air. To the left, an individual wearing a golden robe and ornate mitre is shown in a kneeling position, hands raised in prayer or veneration. On the right, a figure stands holding an open book, clad in a blue cloak draped over a pink garment, suggesting scholarly or religious authority. The background is adorned with elements like a gold-leafed wall, floral motifs, and a slender red standard, giving the setting a sumptuous feel. Decorative vases and a bird, likely symbolic, accompany the group, while the foreground shows the edge of a patterned rug or textile.