Human Generated Data

Title

Madonna and Child and Saint John

Date

18th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lawrence Brooks, 1939.150

Human Generated Data

Title

Madonna and Child and Saint John

People

Artist: Unidentified Artist,

Date

18th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lawrence Brooks, 1939.150

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.7
Human 98.7
Person 96.9
Person 94.7
Art 92
Painting 86.3
Drawing 66.8
Drink 63.7
Beverage 63.7
Alcohol 62.7
Liquor 61.9
Photography 56.5
Portrait 56.5
Face 56.5
Photo 56.5
Sculpture 56.2

Clarifai
created on 2020-04-24

people 99.8
adult 98.1
two 97.6
man 97.3
woman 95.6
soldier 94.4
art 94.3
portrait 93.1
three 91.8
wear 91.4
war 91
one 89.5
military 89.5
weapon 88.9
veil 85.2
retro 83.3
actor 82.6
helmet 82.3
cross 80.9
religion 79.4

Imagga
created on 2020-04-24

call 53.7
art 20.9
telephone 20.8
portrait 20.7
face 20.6
pay-phone 18.8
church 18.5
person 17.4
religion 17
adult 16.8
god 16.3
one 15.7
people 15.6
man 15.5
statue 14.5
human 14.2
electronic equipment 14.2
fashion 13.6
sculpture 12.6
dark 12.5
holy 12.5
black 12.2
hair 11.9
pray 11.6
lady 11.4
old 11.1
culture 11.1
model 10.9
world 10.9
bible 10.8
male 10.6
interior 10.6
religious 10.3
money 10.2
currency 9.9
antique 9.6
faith 9.6
expression 9.4
vintage 9.2
pretty 9.1
attractive 9.1
make 9.1
gold 9
sexy 8.8
closeup 8.8
prayer 8.7
saint 8.7
spiritual 8.6
golden 8.6
mask 8.6
close 8.6
historical 8.5
stone 8.4
dollar 8.3
banking 8.3
cash 8.2
sensual 8.2
posing 8
body 8
business 7.9
architecture 7.8
sacred 7.8
ancient 7.8
catholic 7.8
figure 7.7
equipment 7.7
worship 7.7
wall 7.7
spirituality 7.7
rich 7.4
famous 7.4
symbol 7.4
paint 7.2
device 7.2
icon 7.1
love 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 97.8
drawing 97.3
human face 97.1
painting 93.9
sketch 93.8
man 91.5
clothing 88.2
person 87.6
woman 73.5
black and white 69.3
posing 40.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 95.8%
Happy 1.2%
Fear 4.9%
Disgusted 1.1%
Surprised 2.2%
Sad 44.5%
Confused 4.1%
Calm 39.1%
Angry 3%

AWS Rekognition

Age 26-40
Gender Male, 96.7%
Confused 1%
Fear 1.6%
Calm 13.9%
Disgusted 0.2%
Surprised 0.4%
Happy 0.1%
Sad 81.5%
Angry 1.3%

AWS Rekognition

Age 33-49
Gender Female, 57.3%
Surprised 0.7%
Confused 2%
Disgusted 1.9%
Fear 1.2%
Calm 71%
Happy 0.9%
Angry 3%
Sad 19.3%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 86.3%

Categories

Captions

Microsoft
created on 2020-04-24

a black and white photo of a man 76.6%
an old photo of a man 76.5%
a man holding a book 42.3%

Azure OpenAI

Created on 2024-12-04

The image is a grayscale photo of what appears to be a classical religious painting. It shows three figures dressed in traditional robes that fit the artistic styles common in medieval or Renaissance religious art. The central figure is seated and has a visible hand resting gracefully in their lap, indicating a pose of composure or significance. The rightmost figure is holding a scroll or a book that has visible Latin text on it, hinting at a biblical or liturgical reference. The left side of the photo shows damage or degradation, suggesting the painting may be quite old with some wear or previous restoration attempts. The frame of the painting is visible, featuring a simple, unadorned design, which is typical for historical artwork. The color and intricate designs on the robes are rendered in a monochrome palette due to the photo's grayscale conversion, yet they maintain a level of detail that gives depth to the folds and textures of the garments.

Anthropic Claude

Created on 2024-11-27

The image appears to be a religious painting or icon depicting the Virgin Mary holding the infant Jesus, with a figure of a male religious figure, likely a saint, to the side. The figures are painted in a traditional Byzantine or Eastern Orthodox style, with stylized features and intricate decorative elements. The overall composition and artistic style suggest this is a religious work of art, likely from a church or religious setting.

Meta Llama

Created on 2024-11-24

The image is a black-and-white photograph of an old painting depicting the Holy Family. The painting shows Mary, Joseph, and Jesus in a close-up view. Mary is on the left, wearing a dark robe with a head covering that has a veil hanging down the front. She is holding Jesus in her lap and gently touching his right foot. Jesus is wearing a light-colored robe and has his hands clasped together in front of him. He is looking up at Mary. Joseph is on the right, wearing a light-colored robe and holding a staff in his left hand. He is looking down at Jesus. The background of the painting is a light-colored wall with a decorative pattern. The painting is framed in a thin, ornate frame that is also light-colored. The overall atmosphere of the painting is one of serenity and devotion, capturing a tender moment between the Holy Family.

Text analysis

Amazon

DEI
AGN
ECCE

Google

EXCE AGN DEI
EXCE
AGN
DEI