Human Generated Data

Title

Holy Family with Saint Elizabeth and Saint John
Date

18th-19th century
People

Artist: Giovanni Folo, Italian 1764 - 1836

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1529

Human Generated Data

Title

Holy Family with Saint Elizabeth and Saint John

People

Artist: Giovanni Folo, Italian 1764 - 1836

Artist after: Raphael, Italian 1483 - 1520

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1529

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99
Person 99
Person 98.4
Person 98.3
Art 95.3
Person 95.1
Person 94.8
Painting 93.4
Person 75.8

Clarifai
created on 2019-11-07

people 99.9
portrait 99.5
art 99
adult 98.5
two 97.6
print 97.2
woman 96.9
child 96.6
man 96.1
one 96
group 95.5
furniture 93.5
family 91.6
illustration 91.2
baby 91
monochrome 90.4
painting 89.9
engraving 88.6
music 87
retro 84.9

Imagga
created on 2019-11-07

kin 71.7
mother 65.7
parent 52.9
family 35.6
love 35.5
child 32.3
couple 32.3
people 31.3
happy 30.7
portrait 29.8
man 28.2
attractive 26.6
adult 25.9
home 25.5
daughter 25.1
male 24.6
together 23.7
smiling 22.4
happiness 22
husband 20.3
lady 19.5
face 19.2
father 19
hug 18.4
relationship 17.8
sexy 17.7
cute 17.2
loving 17.2
women 16.6
fashion 16.6
affectionate 16.5
couch 16.4
sofa 16.4
pretty 16.1
lifestyle 15.9
smile 15.7
wife 15.2
boy 14.8
model 14.8
girlfriend 14.4
sitting 13.8
looking 13.6
affection 13.5
boyfriend 13.5
hair 13.5
romance 13.4
person 13.1
cheerful 13
two 12.7
joy 12.5
brunette 12.2
fun 12
girls 11.9
dad 11.7
interior 11.5
togetherness 11.3
passion 11.3
human 11.3
body 11.2
son 10.7
kid 10.6
casual 10.2
skin 10.2
room 10
relaxing 10
embracing 9.8
hugging 9.8
baby 9.6
black 9.6
life 9.6
laughing 9.5
men 9.5
elegance 9.2
adorable 9.2
20s 9.2
children 9.1
sensuality 9.1
gorgeous 9.1
romantic 8.9
world 8.9
indoors 8.8
sex 8.8
30s 8.7
marriage 8.6
bed 8.5
expression 8.5
adults 8.5
youth 8.5
erotic 8.5
kids 8.5
relaxed 8.5
house 8.4
one 8.2
blond 7.6
living 7.6
lifestyles 7.6
females 7.6
brother 7.5
lying 7.5
enjoyment 7.5
grandma 7.5
friendship 7.5
leisure 7.5
holding 7.4
close 7.4
indoor 7.3
childhood 7.2
handsome 7.1
lovely 7.1
day 7.1

Google
created on 2019-11-07

Painting 86.9
Art 81.6
Picture frame 79
Stock photography 71.4
Photography 67.8
Illustration 66.9
Room 65.7
Visual arts 62.5
Artwork 51.1

Microsoft
created on 2019-11-07

text 96.2
person 93
human face 92.1
art 88.2
clothing 87.3
baby 84.6
painting 80.4
drawing 73.1
woman 71.6
gallery 62.4
room 54.7
picture frame 28.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 97.5%
Disgusted 0.1%
Sad 0.5%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%
Calm 98.9%

AWS Rekognition

Age 23-37
Gender Female, 89%
Fear 0.1%
Happy 0.1%
Sad 3.7%
Calm 94.3%
Angry 0.2%
Surprised 0.4%
Disgusted 0.1%
Confused 1%

AWS Rekognition

Age 23-35
Gender Female, 53.9%
Disgusted 45%
Surprised 45%
Happy 45%
Calm 54.8%
Angry 45%
Confused 45%
Fear 45%
Sad 45.2%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Happy 45.1%
Angry 47.2%
Calm 48.1%
Surprised 45.1%
Fear 45.1%
Confused 47.3%
Sad 46.7%
Disgusted 45.5%

AWS Rekognition

Age 22-34
Gender Male, 51%
Sad 46.1%
Angry 45%
Surprised 45%
Happy 45.1%
Fear 45%
Calm 53.7%
Confused 45%
Disgusted 45%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 93.4%

Categories

Imagga

people portraits 59.8%
paintings art 35.7%
pets animals 1.9%
streetview architecture 1.7%

Captions

Microsoft
created on 2019-11-07

an old photo of a person 70%
an old photo of a person 68.6%
old photo of a person 66.3%

Text analysis

Amazon

alte
npte
de
duta
que
.
Hadnit.
huilia.
det
qual
quatr
tler
in
alaun
alpunde
orwunat
ste
cdln'.
aicatie aw
dtd
Rafrd
RaalPalaio
pinttunz
auntnz
stine
E'tie Saanida s RaalPalaio ste Hadnit. orwunat dtd cdln'. Rafrd det stine mi
wwty
gue
ol
awewin . auntnz alaun ol tu eanow w (7102 dtd MLIN wwty tler othin gue npte alpunde .acr pinttunz k qual
Saanida s
k
in duta aicatie aw IC Hae de alte quatr CK dt
huilia. que at in .s ioe N
ioe
IC
tu
MLIN
othin
at
awewin
.s
eanow
mi
dt
w
(7102
.acr
E'tie
N
Hae
CK

Google

por
iginal
det
lr
afud
detn
aunuese
tle
somantwe
e
auttde
sn
que
rprte
alunas
dpintunslo
n
de
quatro
ey
y
v
anho
ps
puladas
adpr Esta Sagrada Familia que asta on dRaal Palace de Madnd.se tene por iginal det lr afud detn aunuese nunta alun to quado on tle somantwe e dd mismo auttde sn que rprte alunas dpintunslo qual n duda suatie aw cita hne de alte quatro pics de ey y taspulaadas v de anho tres ps ycma puladas
adpr
Esta
Sagrada
Familia
asta
on
dRaal
Palace
Madnd.se
tene
nunta
alun
to
quado
dd
mismo
qual
duda
suatie
aw
cita
hne
alte
pics
taspulaadas
tres
ycma