Human Generated Data

Title

Madonna with the Butterfly
Date

18th-19th century
People

Artist: Jean Thouvenin, French c. 1765 - c. 1828

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1166NA

Human Generated Data

Title

Madonna with the Butterfly

People

Artist: Jean Thouvenin, French c. 1765 - c. 1828

Artist after: Raphael, Italian 1483 - 1520

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1166NA

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Human 98.5
Person 98.5
Person 98.5
Art 96.2
Painting 93.7
Person 91.7

Clarifai
created on 2019-11-09

people 99.4
portrait 98.6
art 98
adult 97.4
baby 96.4
one 96.4
woman 95.9
two 95.5
child 94
illustration 92.6
group 89.8
print 89.8
religion 89.5
furniture 88.6
saint 88.4
sit 88.3
man 85.7
family 84.3
baroque 83.9
god 82.1

Imagga
created on 2019-11-09

sketch 81.9
sculpture 62.6
drawing 59.1
statue 58.8
representation 51.5
carving 37.1
art 37.1
architecture 32.2
column 29.2
ancient 27.7
culture 27.4
religion 26.9
stone 26.3
figure 24.3
old 23
history 22.4
monument 21.5
detail 20.9
marble 20.6
god 20.1
religious 18.8
travel 18.3
antique 17.3
temple 16.2
decoration 16.1
building 15.9
city 15.8
church 15.7
face 15.6
historic 15.6
tourism 14.9
historical 14.1
famous 14
catholic 13.6
holy 13.5
roman 13.1
landmark 12.7
symbol 12.1
head 11.8
carved 11.8
angel 11.7
saint 11.6
spirituality 11.5
spiritual 11.5
faith 11.5
plastic art 11.4
fountain 11
decorative 10.9
heritage 9.7
structure 9.4
exterior 9.2
vintage 9.1
museum 8.9
pray 8.7
worship 8.7
cathedral 8.7
golden 8.6
outdoor 8.4
tourist 8.2
man 8.1
design 8
cemetery 7.9
statues 7.9
prayer 7.7
facade 7.7
bronze 7.7
capital 7.6
east 7.5
relief 7.4
style 7.4
portrait 7.1

Google
created on 2019-11-09

Painting 92.8
Art 85.6
Illustration 75.9
Visual arts 73.9
Stock photography 67.6
Picture frame 65.1
Statue 51.3
Artwork 51.1
Style 51

Microsoft
created on 2019-11-09

text 99.9
book 97.5
painting 92.9
art 92.9
human face 90.4
drawing 89.3
baby 89.1
person 86.9
cartoon 77.7
museum 77.7
sketch 69.6
clothing 60.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 4-14
Gender Female, 53.9%
Surprised 45.3%
Sad 46.1%
Happy 45.1%
Calm 50.8%
Disgusted 45.5%
Fear 46.1%
Confused 45.4%
Angry 45.8%

AWS Rekognition

Age 5-15
Gender Male, 51.7%
Disgusted 45.3%
Calm 54%
Sad 45.1%
Angry 45.1%
Happy 45.2%
Surprised 45.1%
Fear 45%
Confused 45.1%

AWS Rekognition

Age 5-15
Gender Female, 93.2%
Fear 0%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0.3%
Sad 0.2%
Calm 99.4%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 93.7%

Captions

Microsoft
created on 2019-11-09

a cat sitting on top of a book 25.9%
a person sitting on top of a book 25.8%
a person sitting on a book 25.7%

Text analysis

Amazon

ET
LA
JESUS
VIERGE.
le
STE
LA STE VIERGE. 1.' ENEANT JESUS ET TJEAN.
ENEANT
TJEAN.
1965.
(fitn
B 1965. tythein le
Hlctw
haniheg fonid (fitn Hlctw
fonid
haniheg
tythein
1.'
B

Google

A S VIERGE, 1'ENEANT JESUS ET S: JEANY. A de Do APaischa Tyfparid CR de Cite Mot DN
A
S
VIERGE,
1'ENEANT
JESUS
ET
S:
JEANY.
de
Do
APaischa
Tyfparid
CR
Cite
Mot
DN