Human Generated Data

Title

Madonna and Child
Date

17th century
People

Artist: Frans van der Steen, Dutch 1626 - 1679

Artist after: Albrecht Dürer, German 1471 - 1528
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2151

Human Generated Data

Title

Madonna and Child

People

Artist: Frans van der Steen, Dutch 1626 - 1679

Artist after: Albrecht Dürer, German 1471 - 1528

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2151

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Person 98.5
Human 98.5
Person 96.2
Art 95.6
Baby 80.7
Newborn 72.4
Painting 70.1
Photo 66.6
Photography 66.6
Face 65.1
Portrait 65.1
Drawing 56.2

Clarifai
created on 2019-10-30

people 99.9
baby 99.6
portrait 99.6
art 99.1
child 99
two 97.7
one 96.8
print 95.8
adult 95.7
painting 95.3
son 95.2
old 93.1
man 91.7
group 91.5
antique 91.4
retro 91.2
illustration 90
vintage 89.6
woman 87.6
girl 87.3

Imagga
created on 2019-10-30

child 80.2
baby 50
mother 37
cradle 36
family 34.7
baby bed 31.4
parent 30.9
cute 29.4
love 29.2
kid 27.5
childhood 26
infant 25.1
face 24.9
furniture 24.7
newborn 22.4
people 21.8
male 21.2
happiness 21.2
portrait 20.1
boy 20
daughter 19.5
father 19.4
little 19.4
happy 18.8
home 17.6
adorable 17.5
innocence 17.3
life 17.2
adult 16.8
joy 16.7
care 16.5
person 16.4
bed 16.1
neonate 15.8
human 15.8
furnishing 15.7
fun 15
smiling 14.5
skin 14.4
smile 14.3
man 14.1
together 14
son 13.9
black 13.8
cheerful 13.8
attractive 13.3
hand 12.9
children 12.8
hair 12.7
sleep 12.7
affectionate 11.6
lifestyle 11.6
pretty 11.2
body 11.2
eyes 11.2
brother 11.1
innocent 10.9
dad 10.8
husband 10.5
loving 10.5
one 10.5
couple 10.5
health 10.4
two 10.2
head 10.1
sibling 10.1
girls 10
lady 9.7
indoors 9.7
youth 9.4
model 9.3
casual 9.3
studio 9.1
holding 9.1
diaper 9.1
sleeping 8.8
doll 8.8
women 8.7
sweet 8.7
kids 8.5
lying 8.5
hospital 8.1
sexy 8
lovely 8
grandma 7.9
antique 7.8
play 7.8
mom 7.8
old 7.7
toddler 7.6
kin 7.6
wife 7.6
laughing 7.6
room 7.5
clothing 7.4
relaxing 7.3
looking 7.2
interior 7.1

Google
created on 2019-10-30

Photograph 95.6
Art 79.6
Picture frame 76.9
Painting 73.7
Illustration 72.5
Mother 70
Child 69.3
Portrait 65.9
Visual arts 62.5
Photography 62.4
Drawing 62

Microsoft
created on 2019-10-30

text 99.9
human face 95.6
sketch 93.9
person 93.5
drawing 93
toddler 92.9
indoor 90.9
clothing 80.2
baby 71.7
child 61.7
picture frame 9.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 97.9%
Disgusted 0%
Fear 0%
Sad 0.7%
Happy 0%
Angry 0%
Calm 99.3%
Confused 0%
Surprised 0%

AWS Rekognition

Age 0-3
Gender Female, 65.3%
Calm 6.8%
Sad 0.8%
Disgusted 2.8%
Confused 0.7%
Surprised 0.8%
Angry 87.2%
Fear 0.7%
Happy 0.2%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 70.1%

Categories

Imagga

paintings art 99.5%

Captions

Text analysis

Amazon

EGO
CONVERSIO
ME
ETAD
DILEC
Natum
ocellis
cernit
quam
Mater
EGO DILEC TO MEO. ETAD ME CONVERSIO EIVS.
amore
PATRONAM
EIVS.
MEO.
IMPERATOR
Mater amans. Natus
teneris
Natus
FERDINANDVS
Hase
amans.
Languct
TO
Aspice
Languct amore pars.
D
DEIPARAM
Moet Oner Aspice quam teneris Natum pia cernit ocellis
pia
Sam
Jaaginim
pars.
s.c.M.
F-tan same L Hase Jaaginim tentenime faa DEIPARAM PATRONAM Sam affut.
foe s.c.M. FERDINANDVS IIT IMPERATOR
affut.
Moet
1s12
Oner
tentenime
faa
F-tan same
IIT
foe
L

Google

EGO DILEC TO MEO. ETAD ME CONVERS IO EIVS.t.c.7 Aspice quam teneris Natum pia cernit ocellis Mater amans, Natus Languet amore pari. Suam offute Hast aginen.ex tmerrine rga DEIPARAM VIRGINEM PATRONAM fal. S.CM FERDINANDVS 1I1 IMPERATOR 7 as incidi Tufrt d
EGO
DILEC
TO
MEO.
ETAD
ME
CONVERS
IO
EIVS.t.c.7
Aspice
quam
teneris
Natum
pia
cernit
ocellis
Mater
amans,
Natus
Languet
amore
pari.
Suam
offute
Hast
aginen.ex
tmerrine
rga
DEIPARAM
VIRGINEM
PATRONAM
fal.
S.CM
FERDINANDVS
1I1
IMPERATOR
7
as
incidi
Tufrt
d