Human Generated Data

Title

Pietà
Date

17th century
People

Artist: Lucas Vorsterman, I, Flemish 1595 - 1675

Artist after: Anthony van Dyck, Flemish 1599 - 1641
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G4005

Human Generated Data

Title

Pietà

People

Artist: Lucas Vorsterman, I, Flemish 1595 - 1675

Artist after: Anthony van Dyck, Flemish 1599 - 1641

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Painting 99.5
Art 99.5
Human 97.2
Person 97.2
Person 82.8
Person 69.1
Person 67.6
Photo 65.2
Portrait 65.2
Face 65.2
Photography 65.2
Person 63.8

Clarifai
created on 2019-11-16

people 100
art 99.9
print 99.8
group 99.8
illustration 99.7
painting 99.7
adult 99.2
kneeling 98.6
engraving 98.5
man 98.3
pain 98.2
Renaissance 97.8
woman 97.5
baroque 97.3
furniture 96.9
book series 96.4
facial hair 96.3
baby 95.7
book 95.5
reclining 94

Imagga
created on 2019-11-16

sculpture 50.7
statue 50
cadaver 40.7
sketch 35.9
art 32
drawing 25.9
representation 24.3
architecture 22.7
ancient 20.8
religion 20.6
religious 19.7
carving 18.9
culture 18.8
stone 17.8
detail 17.7
god 17.2
history 17
old 16.7
church 16.7
figure 16.1
monument 15.9
famous 15.8
travel 14.8
catholic 14.6
holy 14.5
building 14.3
city 14.2
historic 13.8
tourism 13.2
marble 12.9
landmark 12.7
decoration 12.5
antique 12.3
saint 11.6
cathedral 11.5
symbol 10.8
angel 10.8
one 10.5
historical 10.4
money 10.2
man 10.1
face 10
design 9.9
pray 9.7
spiritual 9.6
faith 9.6
fountain 9.3
head 9.2
franklin 8.9
newspaper 8.8
hundred 8.7
spirituality 8.7
close 8.6
capital 8.5
roman 8.5
creation 8.3
vintage 8.3
artwork 8.3
temple 8.2
plastic art 8.2
tourist 8.2
closeup 8.1
sand 7.9
product 7.9
museum 7.8
column 7.8
worship 7.7
decorative 7.5
bank 7.2
paper 7.1
soil 7

Google
created on 2019-11-16

Painting 92.5
Art 88.6
Mythology 83.4
Stock photography 73.7
Visual arts 72.2
Illustration 66.9
Printmaking 58.5
Prophet 52.1

Microsoft
created on 2019-11-16

text 100
book 99.9
painting 99.3
drawing 99.2
sketch 97.9
person 91.5
human face 82.1
art 66.9
man 63.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Male, 54.3%
Surprised 50%
Fear 45.9%
Angry 45.2%
Disgusted 45.2%
Sad 45.4%
Calm 47.6%
Happy 45.1%
Confused 45.8%

AWS Rekognition

Age 23-35
Gender Male, 53.5%
Confused 45.2%
Happy 45%
Fear 48.2%
Sad 45.3%
Surprised 47.5%
Angry 46.7%
Disgusted 45.4%
Calm 46.7%

AWS Rekognition

Age 26-40
Gender Female, 53.3%
Calm 45.7%
Surprised 45%
Sad 45.2%
Happy 45.3%
Fear 45.5%
Disgusted 45.1%
Angry 53.1%
Confused 45%

AWS Rekognition

Age 42-60
Gender Female, 55.7%
Confused 0.6%
Angry 2.2%
Surprised 1.9%
Calm 74.9%
Disgusted 0.7%
Fear 3.1%
Sad 15.7%
Happy 0.9%

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.5%
Person 97.2%

Captions

Microsoft

a group of people sitting on a book 25.2%
a group of people looking at a book 25.1%
a group of people posing for a photo 25%

Text analysis

Amazon

Calicola
Domino
Ille
GAGI
Nato
Perillullri
Anglos
triftis
date
quondam
D
apud
Lacertis,
podias
Vrbe
Patri:
Exotnimis
circum
confuetudinis
Perillullri apud Anglos Domino D GEoRGTO GAGI mutua confuetudinis Vrbe eiufdlem Ant. Dyck.
Dyck.
arthene
mutua
gremio
meis
Ant.
Lachymis
onas
domes
officigfa
dudlce
cirum
Ille meis quondam podias 1t daelee Lacertis, lanaite Calicola vos turhe domes Tica, mecum quondam Nato circum arthene dudlce Songfhis,
Exotnimis gremio trifhe meoumhit onas uFa date Lachymis officigfa Patri: Excfun fFa cirum Vania triftis cat
Vania
vos
eiufdlem
mecum
meoumhit
daelee
GEoRGTO
lanaite
trifhe
Songfhis,
uFa
turhe
cat
Tica,
Excfun fFa
I6.4mn
1t
as I6.4mn
as

Google

pondus
Qui
circum
daulce
to
triftis
Fus
Ta
oficiga
Patri
Domino
confuet
olim
amoris
meis
lacertis
Excanimis
onus
quondan
Extint
;
GAGI
perpetiuum
argumentum
Ant.
le
gremio
Nato
fonaftis.
Nania
date
apud
D.GEORGIO
udinis
Vrbe
eiufdem
van
Dyck.
le meis quondan pondus gui dulce lacertis Excanimis gremio trifle recumbit onus Qui quondan Nato circum athens daulce fonaftis. Extint to circum Nania triftis ra Fus Ta date lachrymis oficiga Patri ; Perillutri apud Anglos Domino D.GEORGIO GAGI mutue confuet udinis olim in Vrbe contracte, nune perpetiuum eiufdem amoris argumentum L.M.D.C.Q Ant. van Dyck.
gui
trifle
recumbit
athens
ra
lachrymis
Anglos
in
nune
L.M.D.C.Q
dulce
Perillutri
mutue
contracte,