Human Generated Data

Title

The Holy Family with the Infant John the Baptist
Date

1593
People

Artist: Hendrick Goltzius, Dutch 1558 - 1617
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2018

Human Generated Data

Title

The Holy Family with the Infant John the Baptist

People

Artist: Hendrick Goltzius, Dutch 1558 - 1617

Date

1593

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2018

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Art 99
Person 98.2
Human 98.2
Painting 96.6
Person 90.2
Person 56.3

Clarifai
created on 2019-10-30

people 99.8
art 99.6
print 99.1
illustration 98.4
baby 98.3
painting 98.2
group 97.2
adult 97
Renaissance 95.6
two 95.5
man 94.4
religion 94.4
engraving 94
child 91.8
woman 90.7
son 90.3
saint 88.7
old 88.3
antique 88.2
baroque 88.1

Imagga
created on 2019-10-30

sculpture 44.9
religion 41.3
sketch 40.3
statue 38.6
art 37.4
column 33.1
architecture 32
ancient 30.3
drawing 29.1
temple 27.2
history 26
representation 25.3
stone 25.1
god 24.9
culture 24.8
carving 24.3
religious 22.5
monument 22.4
old 21.6
travel 20.4
church 20.4
holy 18.3
spirituality 18.3
figure 16.7
tourism 16.5
spiritual 15.4
building 15.4
decoration 14.9
historic 14.7
antique 14.4
city 14.1
historical 14.1
mosaic 14.1
museum 13.9
golden 13.8
famous 13
detail 12.9
traditional 12.5
design 11.8
heritage 11.6
face 11.4
tourist 10.9
carved 10.8
palace 10.8
worship 10.6
ruler 10.4
landmark 9.9
marble 9.8
pray 9.7
book jacket 9.6
east 9.3
bible 8.8
prayer 8.7
faith 8.6
money 8.5
exterior 8.3
vintage 8.3
currency 8.1
sacred 7.8
catholic 7.8
king 7.8
relief 7.7
structure 7.6
capital 7.6
jacket 7.5
symbol 7.4
gold 7.4
tradition 7.4
banking 7.4
cash 7.3
sand 7.2
icon 7.1
cathedral 7.1
roman 7

Google
created on 2019-10-30

Painting 94.2
Art 85.5
Illustration 73.2
Visual arts 73.1
Stock photography 68.5
Drawing 57.6
Antique 54.2

Microsoft
created on 2019-10-30

text 99.9
book 97.1
person 93.9
drawing 93.4
clothing 91.9
human face 90.6
painting 89.3
sketch 86.1
baby 85.2
old 70.2
posing 50.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 3-9
Gender Female, 85.2%
Calm 85.6%
Sad 0.1%
Angry 0%
Fear 0%
Happy 14.2%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 51-69
Gender Male, 87.3%
Calm 2.5%
Disgusted 0.5%
Angry 15.1%
Surprised 0.5%
Fear 31.6%
Happy 0.9%
Sad 48%
Confused 0.9%

AWS Rekognition

Age 5-15
Gender Female, 91.3%
Angry 0.5%
Fear 0.4%
Happy 2.7%
Disgusted 0.3%
Calm 86.8%
Confused 0.4%
Sad 1.9%
Surprised 7.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Painting 96.6%

Categories

Imagga

paintings art 89.7%
streetview architecture 10.1%

Captions

Microsoft
created on 2019-10-30

an old photo of a man 87.1%
an old photo of a man holding a book 54.3%
an old photo of a boy 54.2%

Text analysis

Amazon

BLANDITVR
SALIENS
DIGITO
VTERO
VBERE
INDICE
COLLVDIT
QVEM
MONSTRAV
ET
ANNIS
LACTANTIS AB
AMECE,
PRACVRSOR
CRES
BLANDITVR PVERE PVER ET COLLVDIT AMECE, INDICE MONSTRAV DIGITO CRES CENTIBVS ANNIS
MATRIS
ABDITVS.
PRACVRSOR DOMInr. LACTANTIS AB VBERE MATRIS QVEM BRACO CINOVIT SALIENS VTERO ABDITVS. HVNC
BRACO
CINOVIT
1503.
CENTIBVS
PVERE
HVNC
PVER
DOMInr.
HEF

Google

QVEM
BRA.CO
GNOVIT
HVN
CT
INDICE
CRES
ANNIS
PRA.CVRSOR
DOMINI,
LACTANTIS
MATRIS
BLANDITVR
PVER
PVER,
ET
COLLVDIT
IS05. QVEM BRA.CO GNOVIT SALIENS VTERO ABDITVS, HVN CT INDICE MONSTRAVIT DIGITO CRES CENTIBVS ANNIS PRA.CVRSOR DOMINI, LACTANTIS AB VBERE MATRIS BLANDITVR PVER PVER, ET COLLVDIT AMICE
IS05.
SALIENS
VTERO
ABDITVS,
MONSTRAVIT
DIGITO
CENTIBVS
AB
VBERE
AMICE