Human Generated Data

Title

Birth of John the Baptist

Date

1475-1500

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.26

Human Generated Data

Title

Birth of John the Baptist

People

Artist: Unidentified Artist,

Date

1475-1500

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.26

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Art 100
Painting 100
Adult 98.5
Male 98.5
Man 98.5
Person 98.5
Person 98.1
Adult 97.7
Person 97.7
Bride 97.7
Female 97.7
Wedding 97.7
Woman 97.7
Adult 97.6
Person 97.6
Bride 97.6
Female 97.6
Woman 97.6
Adult 96.8
Person 96.8
Bride 96.8
Female 96.8
Woman 96.8
Adult 84.1
Person 84.1
Bride 84.1
Female 84.1
Woman 84.1
Face 83.6
Head 83.6
Archaeology 56.5
Drawing 56.1
Mural 55.9
Accessories 55.5
Ornament 55.5
Tapestry 55.5

Clarifai
created on 2023-10-18

art 99.8
religion 99.8
painting 99.8
saint 99.7
god 99.2
church 99
aura 98.7
illustration 98
fresco 97.1
mosaic 97
holy 96.5
Gothic 96.4
old 95.9
book 95.8
ancient 95.7
interior 94.8
spirituality 94.6
sacred 94.5
people 94.2
culture 94.2

Imagga
created on 2018-12-18

sculpture 36.2
religion 34.1
art 32.3
carving 30.2
temple 24.9
comic book 23.8
chest 23.7
currency 21.5
box 21
ancient 20.8
church 20.4
travel 19.7
religious 19.7
god 19.1
culture 18.8
architecture 18.7
money 18.7
finance 18.6
container 18.3
holy 18.3
golden 17.2
decoration 16.8
gold 16.4
cash 15.6
statue 15.4
old 15.3
tourism 14.9
bank 14.3
wealth 13.5
spirituality 13.4
bill 13.3
plastic art 13.3
dollar 13
prayer 12.6
history 12.5
financial 12.5
faith 12.4
symbol 12.1
detail 12.1
icon 11.9
tourist 11.8
bible 11.8
sacred 11.7
pray 11.6
vintage 11.6
exchange 11.5
antique 11.4
paper 11
banking 11
dollars 10.6
spiritual 10.6
figure 10.4
mosaic 10.3
business 10.3
colorful 10
traditional 10
banknote 9.7
museum 9.7
print media 9.5
stone 9.3
economy 9.3
graffito 8.8
worship 8.7
artist 8.7
door 8.6
rich 8.4
letter 8.3
historic 8.2
investment 8.2
close 8
masterpiece 7.9
orthodox 7.8
belief 7.8
saint 7.7
wall 7.7
throne 7.5
east 7.5
savings 7.5
design 7.4
painter 7.4
building 7.4
landmark 7.2
device 7.1
face 7.1

Google
created on 2018-12-18

art 90.3
history 83.9
ancient history 73.5
middle ages 72.1
prophet 52.8
miniature 52.7
painting 52.5
artwork 51.8

Microsoft
created on 2018-12-18

text 96.7
posing 38.5
mural 38.5
church 10.1
museum 5
art 3
mosaic 2.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 12-20
Gender Male, 97.8%
Sad 88.8%
Confused 20.9%
Calm 13.6%
Surprised 10.5%
Fear 9%
Happy 7.2%
Disgusted 2.4%
Angry 1.2%

AWS Rekognition

Age 18-24
Gender Female, 62%
Happy 54.3%
Calm 40.6%
Surprised 6.8%
Fear 6.5%
Sad 2.4%
Confused 0.6%
Disgusted 0.6%
Angry 0.4%

AWS Rekognition

Age 13-21
Gender Female, 83.1%
Calm 86.2%
Surprised 7.5%
Fear 6.8%
Happy 5.4%
Sad 2.6%
Confused 1%
Disgusted 0.8%
Angry 0.7%

AWS Rekognition

Age 16-24
Gender Male, 89.4%
Calm 81.3%
Fear 15.9%
Surprised 6.5%
Sad 2.4%
Happy 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.5%
Male 98.5%
Man 98.5%
Person 98.5%
Bride 97.7%
Female 97.7%
Woman 97.7%

Categories

Imagga

paintings art 99.4%

Captions

Microsoft
created on 2018-12-18

a close up of a book 30.1%

Azure OpenAI

Created on 2024-01-25

This image is an iconographic painting that depicts a scene with a traditional religious narrative. The setting includes architectural elements like buildings with domed roofs and arched doorways, indicating a probable Byzantine or Orthodox Christian influence. In the foreground, there is a character engaged in an activity that might be related to food preparation, as suggested by the presence of a container and a basket.***** The colors are rich and warm, with golds and reds dominating the palette. The clothing and hairstyles suggest a historical period, possibly biblical, and the inscriptions at the top in likely Cyrillic or Greek characters imply a sacred text or context. The entire scene is bordered with a decorative pattern, enhancing the artwork's ancient, religious aesthetic.

Text analysis

Amazon

W
M
almay