Human Generated Data

Title

Saint James the Great
Date

c. 1589
People

Artist: Hendrick Goltzius, Dutch 1558 - 1617
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert and Barbara Wheaton, 2007.235.4.4

Human Generated Data

Title

Saint James the Great

People

Artist: Hendrick Goltzius, Dutch 1558 - 1617

Date

c. 1589

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Person 99.2
Human 99.2
Person 98.8
Art 98.7
Painting 98.7
Person 97.5
Person 94.7
Person 92.9
Person 80.9
Person 74.3
Drawing 71
Text 62.3
Photo 56
Photography 56
Face 55.4
Portrait 55.4

Clarifai
created on 2019-11-07

people 99.9
medicine 99.5
no person 99
healthcare 98.7
man 98.1
print 97
vertical 96.5
many 96.1
illustration 96
engraving 95.2
group 94.7
adult 93.8
woman 93.6
portrait 93.5
etching 92
one 90.7
isolate 90.4
medical 90
art 87.2
antique 82.9

Imagga
created on 2019-11-07

comic book 87.1
currency 53.8
money 51.9
cash 47.6
dollar 43.6
finance 38
paper 36.9
bank 34.9
print media 34.8
dollars 34.8
wealth 32.3
bill 31.4
banking 31.3
business 27.3
hundred 27.1
exchange 26.7
financial 24.9
book jacket 24.8
bills 24.3
savings 24.2
vintage 22.3
stamp 21
close 20.6
rich 20.5
us 20.2
investment 20.2
mail 20.1
sketch 19.7
one 19.4
jacket 19.3
postmark 18.7
postage 18.7
product 17.8
banknote 17.5
loan 17.3
post 17.2
newspaper 17
franklin 16.7
postal 16.7
banknotes 16.6
note 16.5
letter 15.6
drawing 15.4
pay 15.3
notes 15.3
collection 15.3
economy 14.8
wrapping 14.6
finances 14.5
market 14.2
creation 14.1
daily 13.3
global 12.8
funds 12.7
states 12.6
profit 12.4
united 12.4
capital 12.3
envelope 12.2
closeup 12.1
philately 11.8
old 11.8
printed 11.8
retro 11.5
representation 11.3
greenback 10.9
stamps 10.8
twenty 10.8
president 10.8
wages 10.8
history 10.7
rate 10.7
sign 10.5
symbol 10.1
shows 9.9
covering 9.8
value 9.7
payment 9.6
international 9.6
circa 8.9
foreign 8.9
paying 8.7
treasury 8.6
fine 8.6
culture 8.6
bookmark 8.5
card 8.4
many 8.3
art 8.2
monetary 7.8
legal 7.8
face 7.8
ancient 7.8
delivery 7.8
cutting 7.7
debt 7.7
communications 7.7
unique 7.6
stock 7.5
commerce 7.5
number 7.5
success 7.2
office 7.2
portrait 7.1
concepts 7.1

Google
created on 2019-11-07

Art 80.3
Painting 74.2
Collection 62.9
History 60.4
Illustration 60.2
Drawing 57.6

Microsoft
created on 2019-11-07

scene 99.9
room 99.6
drawing 98.9
gallery 98.6
sketch 98.4
person 96.9
text 92.8
clothing 92.4
woman 77
man 69.4
human face 66.4
cartoon 62.2
illustration 62.1
art 56.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-67
Gender Male, 99.4%
Calm 94.8%
Confused 0.5%
Disgusted 0.5%
Angry 2%
Sad 1.1%
Happy 0.2%
Surprised 0.8%
Fear 0.1%

AWS Rekognition

Age 17-29
Gender Male, 53.9%
Sad 45.4%
Happy 46.3%
Surprised 45.2%
Fear 45%
Calm 52.8%
Disgusted 45%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 30-46
Gender Male, 99.7%
Happy 0%
Sad 96.6%
Fear 0.1%
Disgusted 0%
Confused 0.1%
Angry 1.6%
Surprised 0%
Calm 1.6%

AWS Rekognition

Age 41-59
Gender Male, 81.8%
Surprised 4.7%
Happy 41.1%
Disgusted 0.3%
Calm 38.4%
Angry 4.6%
Confused 0.5%
Sad 6.5%
Fear 3.9%

AWS Rekognition

Age 37-55
Gender Male, 99.6%
Angry 1%
Sad 3.6%
Happy 1.2%
Confused 0.3%
Calm 93.7%
Disgusted 0%
Fear 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a room with art on the wall 61%
a room with pictures on the wall 60.9%
a room with posters on the wall 60.8%

Text analysis

Amazon

CREATOREM
PATREM
DESCENDIT
MARIA
FILIVM
CHRISTVM
ASCENDIT
OM-
EST
CONCEPTVS
TER
DIE
AD
TIA
SEDET
DE
RESVRREXIT A
NATVS
VM
MORTVVS
TERRE.
DEXTERAM
VNICVM.
SVB
SEPVL
EX
CRVCIFIXVS, MORTVVS & SEPVL TIA DIE RESVRREXIT A MOR- ASCENDIT AD DEXTERAM AD COELOS SEDET
SANCTO.
EIVS
ETIN
MOR-
COFLLENTEM TERRE. FILIVM EIVS VNICVM. DOMIN- SPIRITV SANCTO. NATVS EX
NOSTRVMO
DOMIN-
INFERNA.
&
VM NOSTRVMO MARIA VIRGINE.EDSTA
CREATOREM ETIN IESVNI CHRISTVM QVI CONCEPTVS EST DE
CREDo DEVM PATREM OM-
Passvs SVB POnTIO PIlATO. DESCENDIT AD INFERNA. TER
SPIRITV
COELOS
Passvs
CRVCIFIXVS,
COFLLENTEM
DEVM
PIlATO.
CREDo
IESVNI
VIRGINE.EDSTA
QVI
POnTIO
IIL.

Google

SAN
CREDO
CREATOREM
NOSTRVM
PONTIO
INFERNA,
DIE
RES
VRREXIT
PATRIS
ш. QVI CONCEPT VS EST DE SPIRITV SAN CTO, NATVS EX MARIA VIRGINE. CREDO IN DE VM PATREM OM- NIPOTENTEM, CREATOREM CELI & TERRE. ET IN IESVM CHRISTVM FILIVM EIVS VNICVM, DOMIN- VM NOSTRVM seo т PASSVS SVB PONTIO PILATO, CRVCIFIXVS, MORTVVS & SEPVL TVS DESCENDIT AD INFERNA, TER- TIA DIE RES VRREXIT A MOR- TVIS.C ASCENDIT AD CCELOS, SEDET AD DEXTERAM DEI PATRIS OM- NIPOTENTIS.Ce222eaeem
QVI
VS
DE
VM
NIPOTENTEM,
CELI
FILIVM
EIVS
seo
т
SEPVL
AD
CCELOS,
NIPOTENTIS.Ce222eaeem
CONCEPT
EST
SPIRITV
ET
IN
IESVM
DOMIN-
PASSVS
DESCENDIT
TIA
A
MOR-
CTO,
EX
OM-
CHRISTVM
PILATO,
CRVCIFIXVS,
TVS
ASCENDIT
DEI
ш.
NATVS
MARIA
VIRGINE.
PATREM
&
TERRE.
VNICVM,
SVB
MORTVVS
TER-
TVIS.C
SEDET
DEXTERAM