Human Generated Data

Title

Holy Family

Date

17th century

People

Artist: Jan Witdoeck, Flemish 1615? - after 1641

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2143

Human Generated Data

Title

Holy Family

People

Artist: Jan Witdoeck, Flemish 1615? - after 1641

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2143

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Painting 99.3
Art 99.3
Human 98.6
Person 98.6
Person 88.2
Person 84.6
Person 80.7
Person 69.7
Pet 61.4
Canine 61.4
Animal 61.4
Mammal 61.4
Dog 61.4

Clarifai
created on 2019-10-30

people 99.9
art 99.8
child 99.5
baby 99.3
group 98.4
print 98.2
painting 98
illustration 97.8
son 97.4
affection 96.8
adult 96
two 95.9
portrait 95.9
wear 95.9
book 94.6
woman 93.6
engraving 93.1
saint 93
antique 92.9
three 90.2

Imagga
created on 2019-10-30

sculpture 85.9
statue 58.3
carving 55.1
art 42.6
architecture 33.9
column 29
monument 28.1
ancient 27.7
history 26.9
religion 26
old 25.1
landmark 24.4
plastic art 23.6
figure 23.5
stone 22.5
city 22.5
culture 21.4
famous 19.6
building 19.1
travel 19
temple 18.7
historical 17.9
historic 17.4
tourism 17.4
god 17.2
fountain 17.2
sketch 16.9
holy 16.4
marble 16
decoration 15.8
detail 15.3
religious 15
church 13.9
heritage 13.5
spirituality 12.5
spiritual 12.5
antique 12.3
drawing 12.2
comic book 12.1
representation 11.8
catholic 11.7
palace 11.6
structure 11.2
tourist 10.9
statues 10.9
symbol 10.8
king 10.7
saint 10.6
faith 10.5
design 10.3
roman 10
bronze 9.8
facade 9.6
cathedral 9.4
cadaver 9
book jacket 9
carved 8.8
angel 8.8
pray 8.7
golden 8.6
capital 8.6
east 8.4
traditional 8.3
exterior 8.3
cemetery 7.9
holiday 7.9
figurine 7.9
worship 7.7
museum 7.7
attraction 7.7
head 7.6
details 7.6
cross 7.5
decorative 7.5
vintage 7.5
gold 7.4
relief 7.2

Google
created on 2019-10-30

Microsoft
created on 2019-10-30

text 100
book 99.2
drawing 94.7
person 94.3
painting 92.8
old 90.7
sketch 89.8
clothing 86.7
posing 84.4
human face 81.7
vintage 62.3
group 62
woman 54
cartoon 51.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Male, 95.7%
Calm 99.4%
Confused 0%
Surprised 0%
Happy 0.4%
Angry 0%
Disgusted 0%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Female, 97%
Angry 0.2%
Confused 0.3%
Happy 0%
Disgusted 0.1%
Sad 0.1%
Fear 32.6%
Surprised 66.5%
Calm 0.2%

AWS Rekognition

Age 27-43
Gender Male, 97.8%
Angry 0%
Disgusted 0%
Happy 0.1%
Fear 0%
Calm 99.8%
Confused 0%
Surprised 0%
Sad 0.1%

AWS Rekognition

Age 37-55
Gender Male, 50.6%
Happy 45%
Calm 50%
Sad 49.5%
Angry 45.2%
Surprised 45%
Fear 45%
Confused 45%
Disgusted 45.2%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.3%
Person 98.6%
Dog 61.4%

Categories

Text analysis

Amazon

INVENIAM
DET
DEOSCVLER
FRATREM
NEMO
VBERA
TE
MEVM
IAM
ME
ET
DESPICIAT
MIHL DET TE FRATREM MEVM SVGENTEM VBERA MATRIS.VT INVENIAM TE
QVIS
SVGENTEM
MATRIS.VT
TE.ET
FORIS, ET DEOSCVLER TE.ET IAM ME NEMO DESPICIAT Cant, viti priulegi Reois 37.
Cant,
FORIS,
MIHL
Reois
priulegi
Antwerpur
PPRubE
viti
wildlerk
Maermans
Maermans cxeudit Antwerpur
Prxit
cxeudit
PPRubE 1s wildlerk SeuJriet
SeuJriet
37.
1s

Google

Joa widerk Seulpler TPRube pincit QVIS MIHI DET TE FRATREM MEVM SVGENTEM VBERA MATRIS, VT INVENIAM TE ME NEMO DESPICIAT Cant pralgi Regir e Rrt FORIS, ET DEOSCVLER TE, ET IAM Tac. Marmans ccudit Antwarpie
Joa
widerk
Seulpler
TPRube
pincit
QVIS
MIHI
DET
TE
FRATREM
MEVM
SVGENTEM
VBERA
MATRIS,
VT
INVENIAM
ME
NEMO
DESPICIAT
Cant
pralgi
Regir
e
Rrt
FORIS,
ET
DEOSCVLER
TE,
IAM
Tac.
Marmans
ccudit
Antwarpie