Human Generated Data

Title

Sistine Madonna

Date

19th century

People

Artist: Filippo Tosetti, Italian ca. 1780 -

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R15355

Human Generated Data

Title

Sistine Madonna

People

Artist: Filippo Tosetti, Italian ca. 1780 -

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Painting 99.2
Art 99.2
Human 98.9
Person 98.9
Person 98.6
Person 98.5
Person 97.4
Person 97.1
Portrait 61.2
Face 61.2
Photo 61.2
Photography 61.2
Angel 56.6
Archangel 56.6

Clarifai
created on 2019-11-07

people 99.9
art 99.5
adult 99.4
man 99.2
two 99.1
group 98.9
print 98.7
religion 98.7
saint 98.6
god 97.4
nude 97.3
gown (clothing) 97.2
woman 97.2
furniture 97.1
Renaissance 97
kneeling 97
book 96.5
painting 96.5
seat 95.2
one 94.5

Imagga
created on 2019-11-07

sculpture 43.1
statue 35
art 27.2
religion 24.2
ancient 23.4
altar 22.9
history 21.5
old 20.9
historical 19.8
architecture 19.8
culture 18.8
carving 18.8
church 18.5
god 18.2
catholic 17.5
portrait 16.8
structure 16.3
antique 15.9
monument 15
marble 14.7
figure 14.7
historic 14.7
holy 14.5
religious 14.1
decoration 14
famous 14
stone 13.7
column 12.7
saint 12.6
city 12.5
detail 12.1
vintage 11.6
face 11.4
building 11.1
head 10.9
dress 10.8
faith 10.5
style 10.4
cross 10.4
decorative 10
tourism 9.9
travel 9.9
pray 9.7
prayer 9.7
roman 9.6
spiritual 9.6
spirituality 9.6
people 9.5
symbol 9.4
person 9.4
sketch 9.3
cathedral 9
romantic 8.9
man 8.9
model 8.6
memorial 8.5
design 8.2
sexy 8
temple 8
cemetery 7.8
carved 7.8
color 7.8
golden 7.7
luxury 7.7
exterior 7.4
makeup 7.3
mother 7.2
landmark 7.2
museum 7.2
adult 7.1
love 7.1

Google
created on 2019-11-07

Microsoft
created on 2019-11-07

text 100
book 99.4
drawing 96.2
painting 95
sketch 94.2
cartoon 76.9
person 76.5
clothing 73.1
woman 52.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 54.9%
Disgusted 45%
Surprised 45%
Happy 45%
Calm 54.8%
Angry 45%
Confused 45%
Fear 45%
Sad 45.1%

AWS Rekognition

Age 9-19
Gender Female, 54.5%
Calm 46.9%
Angry 45.6%
Happy 45%
Fear 47.1%
Disgusted 45.1%
Confused 45.3%
Surprised 45.3%
Sad 49.6%

AWS Rekognition

Age 7-17
Gender Female, 53.7%
Disgusted 45.1%
Sad 45.1%
Angry 46.8%
Happy 45.1%
Confused 45.1%
Surprised 45.2%
Fear 45.1%
Calm 52.6%

AWS Rekognition

Age 4-12
Gender Female, 54.1%
Calm 54.6%
Disgusted 45%
Angry 45.1%
Happy 45%
Confused 45%
Fear 45%
Surprised 45.1%
Sad 45.1%

AWS Rekognition

Age 19-31
Gender Female, 54.3%
Calm 54.8%
Angry 45%
Fear 45%
Happy 45.1%
Disgusted 45%
Sad 45.1%
Surprised 45%
Confused 45%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.2%
Person 98.9%

Captions

Microsoft

a person holding a book 49.5%
a person standing in front of a mirror posing for the camera 49.4%
a person standing in front of a mirror 49.3%