Human Generated Data

Title

Holy Family
Date

17th century
People

Artist: Jacques Callot, French 1592 - 1635

Artist after: Andrea del Sarto, Italian 1486 - 1530
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.52.2

Human Generated Data

Title

Holy Family

People

Artist: Jacques Callot, French 1592 - 1635

Artist after: Andrea del Sarto, Italian 1486 - 1530

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.52.2

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Human 99.1
Person 99.1
Person 98.1
Art 82.2
Painting 77.1

Clarifai
created on 2018-04-18

art 99.8
people 99.5
illustration 99.3
saint 98.2
baby 98.2
book 98.2
religion 97.4
man 96.1
visuals 94.6
god 93.2
Renaissance 93.2
painting 93.1
holy 92.5
virgin 92.5
print 90.7
engraving 90.6
aura 89.8
church 89.7
portrait 87.8
Mary 87.1

Imagga
created on 2018-04-18

money 34.9
currency 33.2
art 31.1
finance 29.6
cash 29.3
paper 28.3
dollar 27.9
financial 26.8
arabesque 25.5
bank 23.6
wealth 22.5
banking 22.1
mosaic 21.4
business 21.3
old 20.9
pattern 19.2
map 18.9
close 18.9
grunge 18.8
texture 18.1
retro 18
design 17.5
exchange 17.2
one 17.2
bill 17.1
representation 16.2
tile 16.1
vintage 14.9
ancient 14.7
dollars 14.5
coin 14.3
rich 14
us 13.5
pay 13.4
antique 13.2
symbol 12.8
banknote 11.7
history 11.6
wallpaper 11.5
closeup 11.5
drawing 11.4
commerce 11.2
savings 11.2
economy 11.1
color 11.1
graphic 11
concepts 10.7
hundred 10.7
payment 10.6
note 10.1
sketch 9.8
coins 9.7
textured 9.7
change 9.6
shiny 9.5
fabric 9.4
investment 9.2
gold 9.1
manhole cover 9
shape 8.9
funds 8.8
bills 8.8
artistic 8.7
stucco 8.6
capital 8.6
number 8.4
card 8.3
frame 8.3
sign 8.3
ornate 8.2
style 8.2
ingot 8.2
futuristic 8.1
paisley 8.1
success 8.1
metal 8.1
decoration 8
silver 8
franklin 7.9
value 7.8
circle 7.7
finances 7.7
loan 7.7
floral 7.7
top 7.6
horizontal 7.5
decorative 7.5
sale 7.4
covering 7.4
digital 7.3
block 7.3
dirty 7.2
black 7.2
lines 7.2
religion 7.2
relief 7.1
market 7.1

Google
created on 2018-04-18

black and white 77.5
art 73.8
mythology 70.9
history 65.9
artwork 65.8
mythical creature 57.3
fictional character 55.5
visual arts 54.9
monochrome 53.6
stock photography 53.2
illustration 53

Microsoft
created on 2018-04-18

text 100
book 97.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 61.5%
Confused 3.5%
Calm 29.1%
Disgusted 0.5%
Surprised 2.5%
Sad 34%
Angry 3.4%
Happy 27.1%

AWS Rekognition

Age 26-43
Gender Male, 93.4%
Confused 14.3%
Sad 17.4%
Surprised 4.8%
Happy 1.8%
Disgusted 1.5%
Angry 8.8%
Calm 51.3%

AWS Rekognition

Age 20-38
Gender Female, 69.6%
Calm 4.8%
Surprised 2.9%
Confused 7.9%
Angry 2.2%
Happy 2.9%
Sad 77.6%
Disgusted 1.7%

AWS Rekognition

Age 35-52
Gender Male, 59.4%
Angry 11.6%
Disgusted 5%
Happy 3.2%
Sad 36.3%
Surprised 7.8%
Confused 11.5%
Calm 24.5%

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 77.1%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2018-04-18

a close up of a book 73.4%
close up of a book 68.9%
a close up of text on a book 61.6%

Text analysis

Amazon

AGNOSCIT
NATVS
IOANNES
VIRGINIS
EVMDEM
ALME
NON
Viro
Bernardo
Per
Huysse,
Illustri
VanNieuWeruen
SENSIT
VISCERIBVS AVSVM,QVEM SENSIT VIRGINIS ALME IOANNES AGNOSCIT ADIT CVM MATRE TONANTEM
MATRE
Imapinem
AVSVM,QVEM
Warighem
Domino
Clarisstmis
VISCERIBVS
Proceribus,
TONANTEM
cultam
Deiparam
CRISTVM,
PREDICA
CAND,
CVM
OSTENDIT.
Domino ob Deiparam noularem cultam Imapinem hane
Antuerpic
ex
noularem
ob
ExVLTaNS CRISTVM, NON NATVS NATVS EVMDEM PREDICA AT. OSTENDIT. DIGITO. BAPTIZAT ADorAT.
Per Illustri ac Pio Viro D. Bernardo VanNieuWeruen ex Clarisstmis Antuerpic Proceribus, Huysse, ac Warighem
ADIT
DIGITO.
Pio
D.
hane
CAND, SApstim
AT.
BAPTIZAT
SApstim
ExVLTaNS
ADorAT.
Callet
ac
ud
P-riele ud Callet
P-riele

Google

AINLE
CRIS
NON
NATVS
ac
D.Bernardo
Domine
ob
prius
in
Deiparam
Virginem
singularem
Fy
Maria
,
)
rum
Clarissmr
Procevibu,
orati
animi
ero
dicat
aet
IOANNES AGNOSCIT ADFT CVM MATRE TONANTE REDICAT OSTENDIT, DIGITO, BAPT IZAT.ADORAT VISCERĪBVSCLAVSVMQVEM SENSIT VIRGINIS AINLE EXVLTANS CRIS TVM, NON NATVS NATVS EVMDEX Per Iilustri, ac Pio Viro D.Bernardo VanNiuleruen Domine ob prius in Deiparam Virginem singularem cultam Fy loa Maria Burella, Flors%rdins)Serta rum ex Clarissmr Anturrpia Procevibu, Huyse,a Warighem ernardo VanNteuWeruen 凸☆ ea Sarto ineatam V: q ul eam . tretdi curauit orati animi ero dicat aet
IOANNES
AGNOSCIT
ADFT
CVM
MATRE
TONANTE
REDICAT
OSTENDIT,
DIGITO,
BAPT
IZAT.ADORAT
VISCERĪBVSCLAVSVMQVEM
SENSIT
VIRGINIS
EXVLTANS
TVM,
EVMDEX
Per
Iilustri,
Pio
Viro
VanNiuleruen
cultam
loa
Burella
Flors
%
rdins
Serta
ex
Anturrpia
Huyse,a
Warighem
ernardo
VanNteuWeruen
凸
☆
ea
Sarto
ineatam
V
:
q
ul
eam
.
tretdi
curauit