Human Generated Data

Title

Melchior de Gillier

Date

1652

People

Artist: Robert Nanteuil, French 1623 - 1678

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1631

Human Generated Data

Title

Melchior de Gillier

People

Artist: Robert Nanteuil, French 1623 - 1678

Date

1652

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Person 99
Human 99
Art 96.1
Painting 96.1
Home Decor 62.9

Clarifai
created on 2019-11-09

people 99.9
one 99.8
portrait 99.5
art 99.5
print 98.8
adult 98.2
leader 95
man 94.6
engraving 94.3
antique 93.1
painting 93
administration 92.9
Renaissance 92.4
royalty 90.1
saint 89.8
old 87.7
illustration 87.1
wealth 82.4
religion 81.8
ellipse 79.7

Imagga
created on 2019-11-09

mosaic 46.4
money 35.8
dollar 35.3
currency 33.2
art 33.2
cash 30.2
architecture 28.1
finance 27.1
financial 26.8
paper 26.7
religion 26
stucco 25.7
bank 25.2
banking 24.8
ancient 24.2
old 23
sculpture 22
bill 21.9
wealth 21.6
church 21.3
one 20.9
business 20.7
window 20
close 19.4
dollars 19.3
history 18.8
structure 17.9
savings 17.7
temple 17
banknote 16.5
us 16.4
memorial 15.9
historic 15.6
pay 15.4
historical 15.1
religious 15
rich 14.9
hundred 14.5
spirituality 14.4
loan 14.4
god 14.4
exchange 14.3
closeup 14.2
monument 14
transducer 13.9
detail 13.7
culture 13.7
landmark 13.6
stone 12.8
franklin 12.8
face 12.8
bills 12.6
finances 12.5
arch 12.5
holy 12.5
antique 12.5
framework 12.4
statue 12.4
creation 12.3
golden 12
travel 12
payment 11.6
brass 11.5
gold 11.5
commerce 11.2
device 11.2
note 11
investment 11
carving 10.8
building 10.5
electrical device 10.5
supporting structure 10.1
shield 9.9
banknotes 9.8
concepts 9.8
relief 9.7
profit 9.6
faith 9.6
capital 9.5
fountain 9.1
design 9
cathedral 8.9
funds 8.8
bible 8.8
catholic 8.8
paying 8.8
decoration 8.7
spiritual 8.6
museum 8.6
economy 8.4
sale 8.3
tourism 8.3
tile 8.2
pattern 8.2
symbol 8.1
success 8.1
protective covering 8
armor 8
icon 7.9
byzantine 7.9
facade 7.9
president 7.9
carved 7.8
portrait 7.8
states 7.7
debt 7.7
saint 7.7
ideas 7.5
number 7.5
famous 7.4
classic 7.4
covering 7.1

Google
created on 2019-11-09

Microsoft
created on 2019-11-09

text 99.4
human face 98.8
person 95.8
book 94.7
clothing 91
drawing 90.9
sketch 85.3
painting 77
portrait 66
victorian 51.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 98.5%
Sad 5.5%
Confused 0.4%
Happy 4.1%
Disgusted 0.3%
Angry 0.2%
Surprised 0.4%
Fear 0.2%
Calm 88.9%

Microsoft Cognitive Services

Age 51
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 96.1%

Captions

Microsoft

a woman holding a book 48.7%
a woman posing for a photo 48.6%
an old photo of a woman 48.5%

Text analysis

Amazon

OR
DE
A
CON
R
SA
ET
DE SA MAIEST
D
MRT
SE
sho
URRES
DED
R sho SE NI
DHOSTEL
MAIEST
MMACEA
NI
le CON MICOR
Q:: URRES Ble
MICOR
MeO
DJE
Q::
Ardd
Ble
wrawamntmmr
le

Google

DE
A
DE SA MAESTED DLDIE A MESS
DLDIE
SA
MAESTED
MESS