Human Generated Data

Title

Madonna with Saints Jerome and Dorothy

Date

17th century

People

Artist: Valentin Lefevre, Flemish 1637 - 1677

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Susan Norton, M21256

Human Generated Data

Title

Madonna with Saints Jerome and Dorothy

People

Artist: Valentin Lefevre, Flemish 1637 - 1677

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Art 96
Human 95.1
Person 95.1
Person 94.8
Painting 87.6

Clarifai
created on 2019-10-30

art 99.5
illustration 99.3
people 98.4
painting 96.6
religion 96.4
man 96.2
print 95.2
veil 94.1
adult 93.1
god 92.8
chalk out 92.2
ancient 91.1
engraving 91.1
woman 89.7
retro 89.7
old 89.6
visuals 89.4
vintage 89.1
antique 88.1
Renaissance 85.1

Imagga
created on 2019-10-30

old 32.8
art 29.9
vintage 29.8
ancient 28.5
antique 28.2
sketch 28
drawing 27.3
tray 27.2
container 26.2
retro 22.1
receptacle 22.1
paper 22
design 21.9
grunge 21.3
decoration 20.9
pattern 19.1
texture 18.1
sculpture 17.9
representation 17.9
detail 16.9
carving 15.6
architecture 14.8
currency 14.4
bill 14.3
frame 14.2
money 13.6
history 13.4
style 13.4
cash 12.8
floral 12.8
finance 12.7
aged 12.7
historic 11.9
ornate 11.9
border 11.8
statue 11.4
wall 11.1
banking 11
close 10.8
bank 10.7
decor 10.6
structure 10.6
brown 10.3
culture 10.3
decorative 10
material 9.8
symbol 9.4
leaf 9.3
dollar 9.3
flower 9.2
painting 9
wealth 9
religion 9
backgrounds 8.9
carved 8.8
building 8.7
artistic 8.7
ornament 8.6
old fashioned 8.6
stone 8.4
black 8.4
savings 8.4
classic 8.4
backdrop 8.2
stucco 8.1
graphic 8
business 7.9
textured 7.9
figure 7.8
faded 7.8
travel 7.7
parchment 7.7
wallpaper 7.7
rusty 7.6
temple 7.6
element 7.4
page 7.4
letter 7.3
investment 7.3
artwork 7.3
color 7.2
financial 7.1
plant 7.1

Google
created on 2019-10-30

Painting 88.5
Art 88.4
Illustration 72.5
Printmaking 67.6
Drawing 62
Visual arts 59.3
Artwork 55.2

Microsoft
created on 2019-10-30

text 100
book 99.6
drawing 99.5
sketch 99.2
illustration 93.3
cartoon 88.5
painting 86.6
engraving 82.9
person 71.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-25
Gender Female, 54.2%
Angry 45%
Disgusted 45%
Calm 50.3%
Happy 45%
Fear 45%
Confused 45%
Sad 49.6%
Surprised 45%

AWS Rekognition

Age 4-14
Gender Male, 52.9%
Confused 45%
Surprised 45%
Calm 53.7%
Sad 45%
Happy 46.1%
Disgusted 45%
Angry 45.1%
Fear 45%

AWS Rekognition

Age 41-59
Gender Male, 52.5%
Surprised 45%
Fear 45.5%
Angry 45.3%
Sad 52%
Calm 46.7%
Happy 45.3%
Confused 45.1%
Disgusted 45.1%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.1%
Painting 87.6%

Captions

Microsoft

a close up of a book 49.7%
close up of a book 44.2%
a close up of a book cover 44.1%