Human Generated Data

Title

Joos van der Burch and Saint Simon of Jerusalem

Date

c. 1493

People

Artist: Gerard David, Netherlandish c. 1460 - 1523

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of George W. Harris in memory of John A. Harris (to Harvard College), 1906.6.B

Human Generated Data

Title

Joos van der Burch and Saint Simon of Jerusalem

People

Artist: Gerard David, Netherlandish c. 1460 - 1523

Date

c. 1493

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of George W. Harris in memory of John A. Harris (to Harvard College), 1906.6.B

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Adult 99.9
Female 99.9
Person 99.9
Woman 99.9
Face 96.6
Head 96.6
Adult 94.5
Person 94.5
Male 94.5
Man 94.5
Cross 89.2
Symbol 89.2
Person 80.3
Person 73.7
Person 64.1
Accessories 56.5
Jewelry 56.5
Ring 56.5
Photography 56.4
Portrait 56.4

Clarifai
created on 2018-02-09

people 99
religion 96.7
painting 95.7
one 95.1
man 94.4
art 94
adult 93
wear 89.3
god 83.8
sculpture 82.2
portrait 81.8
veil 81.2
woman 80.8
spirituality 79.3
music 77.8
leader 74.8
church 73.3
temple 73.1
print 72.5
statue 72.2

Imagga
created on 2018-02-09

man 34.9
portrait 32.3
grandma 30.2
person 29.8
male 26.2
senior 24.4
fan 21.4
old 20.2
people 20.1
handsome 19.6
adult 19.5
elderly 19.1
happy 18.8
face 17
mature 16.7
follower 15.7
couple 15.7
hair 14.3
love 14.2
smiling 13.7
grandfather 13.3
black 13.2
mother 13
gown 12.5
happiness 11.8
retired 11.6
smile 11.4
together 11.4
vestment 10.9
grandmother 10.8
interior 10.6
retirement 10.6
wife 10.4
expression 10.2
church 10.2
lifestyle 10.1
art 9.9
human 9.7
lady 9.7
husband 9.7
one 9.7
outdoors 9.7
hat 9.7
married 9.6
clothing 9.6
eyes 9.5
glasses 9.3
head 9.2
aged 9
family 8.9
call 8.7
golden 8.6
casual 8.5
pretty 8.4
attractive 8.4
vintage 8.3
fun 8.2
gray 8.1
religion 8.1
looking 8
women 7.9
sitting 7.7
god 7.7
age 7.6
laughing 7.6
dark 7.5
mosaic 7.5
traditional 7.5
closeup 7.4
life 7.3
currency 7.2
colorful 7.2
romance 7.1
beard 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 96
man 90.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Calm 62.1%
Confused 14.7%
Fear 9.4%
Surprised 8.3%
Sad 7.3%
Angry 1.7%
Disgusted 1%
Happy 0.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.9%
Female 99.9%
Person 99.9%
Woman 99.9%
Male 94.5%
Man 94.5%
Ring 56.5%

Categories

Captions

Microsoft
created on 2018-02-09

a man wearing a costume 79.2%
a person wearing a costume 79.1%
a man wearing a hat 66.5%

Azure OpenAI

Created on 2024-01-27

This is an image of a classic painting, depicting a figure in ornate religious garb, such as a bishop or a high-ranking cleric. The figure can be seen wearing a detailed mitre decorated with intricate patterns, precious stones, and religious iconography. The clothing includes a lush green robe with golden borders that highlight its luxurious texture, a red garment underneath, and a black cloak draped over one shoulder. This individual is holding what appears to be a golden crosier, indicating a position of ecclesiastical authority. In the background, to the left of the figure, there is a view of a pastoral landscape with people and a clear blue sky; to the right is a dark interior with a window pane showing a small stained glass design.

Anthropic Claude

Created on 2024-03-29

The image depicts two figures, one a young man in a red garment and the other an older man wearing an ornate, jewel-encrusted ecclesiastical headdress. The young man has a serious expression on his face and is holding a scroll or document. The older man, likely a high-ranking religious figure, is looking off to the side with a contemplative gaze. The background includes a landscape with a town or castle in the distance, suggesting a religious or historical setting. The overall composition and attention to detail suggest this is a Renaissance-era painting or work of art.

Text analysis

Amazon

CD
to
and to CD
and