Human Generated Data

Title

Holy Family with Saint Elizabeth and Saint John
Date

18th century
People

Artist: Giovanni Folo, Italian 1764 - 1836

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12044

Human Generated Data

Title

Holy Family with Saint Elizabeth and Saint John

People

Artist: Giovanni Folo, Italian 1764 - 1836

Artist after: Raphael, Italian 1483 - 1520

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12044

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 98.8
Person 98.8
Person 98.3
Person 97.9
Person 95.4
Art 94.3
Painting 94.3
Person 92.3
Portrait 56.2
Photo 56.2
Face 56.2
Photography 56.2

Clarifai
created on 2019-10-29

people 99.9
portrait 99.2
adult 98.9
art 98.4
woman 97.9
man 97.6
two 97.5
one 97.1
child 96.3
painting 95.7
family 95.5
baby 95.3
furniture 94.9
group 94.4
print 93
sit 92.2
music 88.9
indoors 88.9
son 85.3
reclining 83.3

Imagga
created on 2019-10-29

mother 70.2
parent 57.1
kin 51.4
child 39.9
family 35.6
happy 31.4
love 30.8
man 29.6
portrait 29.1
people 29
couple 27.9
home 24.7
adult 24.6
male 24.5
together 22.8
smiling 21.7
attractive 21
daughter 20.3
happiness 19.6
husband 19.2
face 19.2
father 18.2
loving 18.1
couch 17.4
lifestyle 17.4
smile 17.1
relationship 16.9
cute 16.5
world 16.2
boy 15.7
sofa 15.6
sitting 15.5
hug 14.5
affectionate 14.5
lady 13.8
relaxing 13.7
person 13.6
joy 13.4
wife 13.3
sexy 12.9
fashion 12.8
affection 12.6
kid 12.4
relaxed 12.2
looking 12
fun 12
women 11.9
dad 11.7
grandma 11.5
son 11.4
togetherness 11.3
two 11
30s 10.6
cheerful 10.6
room 10.4
senior 10.3
hair 10.3
youth 10.2
casual 10.2
model 10.1
house 10
children 10
pretty 9.8
indoors 9.7
boyfriend 9.7
life 9.6
girlfriend 9.6
body 9.6
brunette 9.6
laughing 9.5
adorable 9.2
baby 9.2
indoor 9.1
black 9
childhood 9
romance 8.9
interior 8.9
hugging 8.8
living 8.5
skin 8.5
passion 8.5
old 8.4
camera 8.3
human 8.3
20s 8.3
one 8.2
playing 8.2
mum 7.8
sex 7.8
play 7.8
elderly 7.7
jeans 7.6
hand 7.6
bed 7.6
adults 7.6
kids 7.5
leisure 7.5
mature 7.4
close 7.4
handsome 7.1
romantic 7.1
day 7.1

Google
created on 2019-10-29

Painting 85.3
Art 83.7
Picture frame 77.3
Illustration 68.1
Room 65.7
Visual arts 64.9
Photography 62.4
Stock photography 62.1
Modern art 51.9
Artwork 51.1
Style 51

Microsoft
created on 2019-10-29

wall 97.7
text 97.3
human face 94.5
person 93.9
gallery 92.9
baby 90
clothing 88.5
room 86.5
art 83.2
picture frame 80.5
painting 76.3
drawing 63.4
woman 56.1
old 51.9
posing 46

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Female, 95.7%
Fear 0.1%
Happy 0.1%
Calm 91.5%
Disgusted 0.2%
Angry 0.1%
Sad 6.9%
Surprised 0.3%
Confused 0.9%

AWS Rekognition

Age 10-20
Gender Female, 97.3%
Fear 0%
Sad 0.3%
Disgusted 0.1%
Happy 0.1%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Calm 99.1%

AWS Rekognition

Age 16-28
Gender Female, 50.5%
Angry 49.1%
Disgusted 45.5%
Calm 47.6%
Happy 45%
Fear 45.1%
Confused 46.8%
Sad 45.8%
Surprised 45.1%

AWS Rekognition

Age 7-17
Gender Female, 54.1%
Calm 54.8%
Fear 45%
Angry 45%
Happy 45%
Confused 45%
Disgusted 45%
Sad 45.2%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Female, 52.1%
Calm 54.6%
Happy 45.1%
Confused 45%
Fear 45%
Disgusted 45%
Surprised 45%
Sad 45.2%
Angry 45%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 94.3%

Text analysis

Amazon

ta
in
duda
sucatie
tiene
Matnst.
/u
dte
del
Rapuct
wty
hmmilia.
de
que ta in dte .' tiene y oral /u
quadn
alaun
alto
aunpue
in2
que
'acut
oral
he aanidas hmmilia. dReaalPalace Matnst. del Rapuct de tne
nprthe
sIn duda sucatie QW st.. Trine de alto quate pie
dReaalPalace
aanidas
tne
quate
.smchante:
atne
.'
Trine
aunpue 'acut alaun atne quadn al Ao .smchante: si S in2 dt mAM wty tanter.othin que nprthe alanud' dte .aspentinu: pudl
dt
y
.aspentinu:
sIn
Ao
tanter.othin
pudl
al
pie
alanud'
st..
he
QW
924
mAM
si
S

Google

arad r mer Esta Sugrada Familia.que ta n dRaal Palae de Madnd.e tine pr ermal del ader afd deChnu aunque se ncuentra algun tro quadro a tslo somgant gue se n dd mumo autor, tader ahn que rte alunas de sus pntunaslo qual sn duda suaadie con cita hne de alto quatre pics de ry v tres pulaadas v de anche tr pes ycma puladas
arad
r
mer
Esta
Sugrada
Familia.que
ta
n
dRaal
Palae
de
Madnd.e
tine
pr
ermal
del
ader
afd
deChnu
aunque
se
ncuentra
algun
tro
quadro
a
tslo
somgant
gue
dd
mumo
autor,
tader
ahn
que
rte
alunas
sus
pntunaslo
qual
sn
duda
suaadie
con
cita
hne
alto
quatre
pics
ry
v
tres
pulaadas
anche
tr
pes
ycma
puladas