Human Generated Data

Title

Madame de Gillier (Marie Jolly)
Date

17th century
People

Artist: Robert Nanteuil, French 1623 - 1678
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1542

Human Generated Data

Title

Madame de Gillier (Marie Jolly)

People

Artist: Robert Nanteuil, French 1623 - 1678

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Person 98.7
Human 98.7
Art 96.5
Painting 78.8
Drawing 58.4

Clarifai
created on 2019-11-09

people 99.5
art 97.8
one 97.8
print 97.1
engraving 95.7
administration 93.8
adult 93.5
portrait 93.2
retro 92.2
woman 91.6
illustration 90.4
leader 87.5
royalty 85.1
antique 84.7
no person 82
monarch 81
music 79.8
vintage 78.5
lithograph 78.4
painting 78.3

Imagga
created on 2019-11-09

art 31.4
dollar 28.8
money 27.2
mosaic 26.6
currency 26
cash 23.8
finance 22
paper 21.2
bill 20.9
religion 19.7
financial 19.6
close 19.4
banking 18.4
banknote 17.5
old 17.4
church 16.6
one 16.4
wealth 16.1
bank 16.1
creation 15.2
business 15.2
architecture 15
face 14.9
dollars 14.5
history 14.3
religious 14.2
ancient 13.8
god 13.4
savings 13
portrait 12.9
sculpture 12.9
detail 12.9
device 12.6
closeup 12.1
holy 11.5
structure 11.5
pay 11.5
design 10.8
window 10.7
bills 10.7
concepts 10.7
us 10.6
exchange 10.5
statue 10.4
culture 10.2
antique 10
stucco 9.9
payment 9.6
spirituality 9.6
faith 9.6
historical 9.4
economy 9.3
investment 9.2
historic 9.2
gong 9.1
pattern 8.9
metal 8.8
symbol 8.7
pray 8.7
artistic 8.7
ideas 8.4
rich 8.4
gold 8.2
success 8
reflection 7.8
value 7.8
hundred 7.7
worship 7.7
spiritual 7.7
cathedral 7.7
loan 7.7
fountain 7.6
capital 7.6
percussion instrument 7.6
vintage 7.4
style 7.4
note 7.3
light 7.3
coil 7.3
temple 7.3
building 7.2
color 7.2

Google
created on 2019-11-09

Lady 90.1
Picture frame 85
Art 70.9
Oval 68.3
Portrait 65.9
Vintage clothing 64.7
Painting 63
Illustration 54.5

Microsoft
created on 2019-11-09

drawing 99.1
sketch 98.9
human face 98
person 96.1
painting 93.1
woman 92.2
clothing 91.1
text 84.5
portrait 67.8
old 65.6
art 59.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Female, 95%
Happy 0.2%
Calm 96.5%
Surprised 0.1%
Angry 0.1%
Sad 2.8%
Fear 0%
Confused 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 78.8%

Captions

Microsoft

an old photo of a person 67.1%
old photo of a person 62.8%
a old photo of a person 62%

Text analysis

Amazon

en
A
ertu
des
Toulut
a
que
plus
Cicut
paretre:
la
Toulut paretre: dansce hieve
dansce
en XFe plus que 1mage,
hieve
A .l repris la raute des Cicut
a ertu gue ouer ce Wsage
gue
1mage,
ouer
9ame
raute
Wsage
repris
XFe
9ame llueis
ce
llueis
.l

Google

Jous ce isage ertu Parcstre dane ces tienx Arepris la route dee Creua len reste plue que lImage
la
lImage
route
dee
reste
dane
tienx
que
ce
isage
Creua
Jous
ertu
Parcstre
ces
Arepris
len
plue