Human Generated Data

Title

Madonna with the Butterfly
Date

19th century
People

Artist: Ignazio Pavon, Italian died 1858

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3004

Human Generated Data

Title

Madonna with the Butterfly

People

Artist: Ignazio Pavon, Italian died 1858

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3004

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 97.2
Person 97.2
Art 96.9
Painting 94.1
Person 94
Person 72.4
Advertisement 56.6
Poster 56.6

Clarifai
created on 2019-11-07

people 99.6
portrait 98.3
adult 98.1
art 98
woman 96.1
one 95.3
man 95.1
group 92.5
child 92.3
painting 91.6
two 90.3
print 89.3
illustration 88.4
baby 86.7
retro 86.5
music 84.5
religion 83.8
love 82.3
wear 82.3
girl 81.7

Imagga
created on 2019-11-07

sketch 71.7
drawing 55.2
representation 47.4
money 28.1
statue 24.8
cash 24.7
currency 24.2
sculpture 23.2
art 21.5
dollar 21.4
paper 20.4
bank 19.7
ancient 19
banking 18.4
culture 18
wealth 17.1
finance 16.9
business 16.4
financial 16
savings 15.9
dollars 15.5
close 15.4
bill 15.2
closeup 14.8
religion 14.3
memorial 14.2
old 13.9
antique 13.9
product 13.8
stone 13.6
bills 13.6
newspaper 13.4
one 13.4
creation 13
portrait 12.9
symbol 12.8
face 12.8
history 12.5
architecture 12.5
pay 12.5
exchange 12.4
vintage 12.4
religious 12.2
rich 12.1
economy 12.1
marble 11.8
banknotes 11.7
book jacket 11.6
finances 11.6
loan 11.5
capital 11.4
brass 11.4
detail 11.3
monument 11.2
franklin 10.8
banknote 10.7
states 10.6
famous 10.2
church 10.2
historic 10.1
hundred 9.7
us 9.6
decoration 9.6
god 9.6
united 9.5
golden 9.5
historical 9.4
figure 9.3
head 9.2
jacket 9
structure 9
market 8.9
funds 8.8
catholic 8.8
holy 8.7
travel 8.5
carving 8.4
decorative 8.4
treasury 8.3
city 8.3
investment 8.3
roman 7.9
payment 7.7
price 7.7
profit 7.7
design 7.4
note 7.4

Google
created on 2019-11-07

Photograph 94.8
Painting 90.5
Picture frame 86.9
Illustration 85.8
Text 85.2
Art 80.8
Visual arts 73.1
Stock photography 69.2
Photography 62.4
Drawing 55.8
Antique 53
Paper 51

Microsoft
created on 2019-11-07

drawing 96.1
gallery 93.5
sketch 90.8
person 88.2
text 86.4
painting 85.1
room 82.3
clothing 82
museum 80.2
human face 79.1
art 73.4
scene 73
baby 54.8
picture frame 7.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 5-15
Gender Female, 54.9%
Surprised 45%
Happy 45%
Fear 45%
Sad 45%
Angry 45%
Confused 45%
Disgusted 45%
Calm 55%

AWS Rekognition

Age 2-8
Gender Female, 54%
Confused 45.2%
Happy 45.1%
Calm 47.4%
Sad 45.4%
Disgusted 45.2%
Surprised 46.3%
Angry 45.9%
Fear 49.6%

AWS Rekognition

Age 5-15
Gender Female, 53.9%
Calm 54.9%
Sad 45.1%
Fear 45%
Surprised 45%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%
Poster 56.6%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-11-07

a photo of a person 62.1%
a person in a room 56.2%
a person taking a selfie in a room 31.8%

Text analysis

Amazon

STATELLA
ASUA
d
D.ANTONNTO
ASUA FO'C.11. SIG. D.ANTONNTO STATELLA
Cafran
SIG.
ere
Hanhere
uaecaf
Pnapu or Cafran Hanhere d uaecaf ere
Da
Sre
1
Pnapu or
FO'C.11.
he
1 Sre hin
indayow
D
enbhacoe d nn M bdeat Hisey he Maigso indayow
nn
enbhacoe
M
bdeat
hin
Hisey
Maigso
4

Google

A.SUA ECC. 11. SIG. D ANTONIO STATELLA Manho dApaem e nnn
A.SUA
ECC.
11.
SIG.
D
ANTONIO
STATELLA
Manho
dApaem
e
nnn