Human Generated Data

Title

Holy Family
Date

17th century
People

Artist: Lucas Vorsterman, I, Flemish 1595 - 1675

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G4003

Human Generated Data

Title

Holy Family

People

Artist: Lucas Vorsterman, I, Flemish 1595 - 1675

Artist after: Raphael, Italian 1483 - 1520

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G4003

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Painting 99.3
Art 99.3
Person 99.2
Human 99.2
Person 98
Person 96.6
Person 94.5

Clarifai
created on 2019-08-06

people 99.9
art 99.4
baby 99.1
two 98.6
adult 98.4
affection 97.9
portrait 97.6
woman 97.2
son 96.9
three 96.3
group 95.8
child 94.8
furniture 94.7
man 94.6
family 94.3
seat 93
sit 90.9
interaction 90.6
Renaissance 89.7
offspring 89.1

Imagga
created on 2019-08-06

tattoo 57.3
decoration 35.4
statue 34.9
sculpture 33.7
design 31.1
art 25.4
ancient 23.4
religion 21.5
culture 19.7
antique 18.9
god 18.2
portrait 17.5
face 17.1
history 17
old 16.7
man 16
religious 15.9
architecture 14.9
carving 14.4
kin 14.1
person 13.6
stone 13.5
holy 13.5
figure 13.4
model 13.2
lady 13
vintage 12.4
people 12.3
church 12
one 12
historic 11.9
pray 11.6
male 11.4
sketch 11.3
historical 11.3
detail 11.3
attractive 11.2
head 10.9
temple 10.7
spiritual 10.6
sexy 10.4
symbol 10.1
fashion 9.8
catholic 9.7
worship 9.7
style 9.7
faith 9.6
hair 9.5
makeup 9.2
adult 9.1
human 9
carved 8.8
body 8.8
closeup 8.8
saint 8.7
representation 8.6
famous 8.4
decorative 8.4
drawing 8.2
bust 8.2
close 8
black 7.9
love 7.9
marble 7.9
travel 7.8
pretty 7.7
spirituality 7.7
money 7.7
roman 7.5
feminine 7.5
monument 7.5
dollar 7.4
currency 7.2
china 7.1

Google
created on 2019-08-06

Painting 84.8
Art 83.4
Drawing 70.9
Visual arts 69.9
Stock photography 67.6
Illustration 62.3
Artwork 53.4
Vintage clothing 52.1

Microsoft
created on 2019-08-06

text 100
book 98.9
person 96.2
baby 96
painting 94.3
drawing 90.7
art 90.1
human face 88.6
sketch 85.8
museum 52.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Female, 77.4%
Sad 7.1%
Calm 43.2%
Confused 17.8%
Angry 5.9%
Surprised 2.9%
Happy 18%
Disgusted 5.1%

AWS Rekognition

Age 10-15
Gender Male, 63.7%
Calm 41.1%
Happy 23.5%
Disgusted 2.4%
Angry 5.6%
Confused 5.9%
Surprised 11.6%
Sad 9.9%

AWS Rekognition

Age 35-52
Gender Female, 59.7%
Angry 4.7%
Sad 31.1%
Surprised 5.8%
Confused 6.3%
Calm 44.3%
Happy 4.2%
Disgusted 3.6%

AWS Rekognition

Age 48-68
Gender Male, 97.1%
Calm 94.3%
Sad 2.9%
Disgusted 0.2%
Surprised 0.3%
Confused 1.2%
Angry 1.1%
Happy 0.1%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.3%
Person 99.2%

Categories

Imagga

events parties 72.8%
people portraits 19.5%
paintings art 7%

Captions

Microsoft
created on 2019-08-06

a group of people sitting on a book 43.7%

Text analysis

Amazon

REVERENDO
COELEBERRIMI
PATRI
ARTIVM
DOMINO
DNO
COENOBY
commcilat
ADMODVM
CHRIST
REVERENDO ADMODVM IN CHRIST AC DOMINO DNO BERNARDO AMPMANS COENOBY
BERNARDO
AC
AMPMANS
fructum
MOECENATI
borum
IN
meus
IBERALIVM
CA
Et
B.MARLE DE NIS TO PATRI &c CA COELEBERRIMI
pomorum
DV PR ESVLI IBERALIVM ARTIVM MOECENATI MAXIMO DD.LVORSTERMANS.
NIS
Veniat
Suorun
MAXIMO
DD.LVORSTERMANS.
DV
B.MARLE DE
PR
Veniat Dileetus meus In borum Suum. Et commcilat fructum pomorum Suorun
ESVLI
Dileetus
&c
TO
Suum.
In

Google

Veniat Dilectus meus m hortum Snum. Et commcdat fructum pomorum Suorum REVERENDO ADMODVM IN CHRISTO PATRI AC DOMINO DNO BERNARDO CAMPMANS COELEBERRIMI COENOBY B.MARIE DE DV NIS PRESVLI PRESTANTISSIMO &C LIBERALIVM ARTIVM MOECENATI MAXIMO D.D. LVvORSTERMANS. Rfael rhinar pixit
Veniat
Dilectus
meus
m
hortum
Snum.
Et
commcdat
fructum
pomorum
Suorum
REVERENDO
ADMODVM
IN
CHRISTO
PATRI
AC
DOMINO
DNO
BERNARDO
CAMPMANS
COELEBERRIMI
COENOBY
B.MARIE
DE
DV
NIS
PRESVLI
PRESTANTISSIMO
&C
LIBERALIVM
ARTIVM
MOECENATI
MAXIMO
D.D.
LVvORSTERMANS.
Rfael
rhinar
pixit