Human Generated Data

Title

Madonna

Date

19th century

People

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1294

Human Generated Data

Title

Madonna

People

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1294

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Human 98.7
Person 98.7
Person 98.2
Person 97.8
Art 93.9
Person 92.3
Painting 80.7
Photo 61.4
Photography 61.4
Portrait 61.4
Face 61.4

Clarifai
created on 2019-10-30

people 98.3
child 97.6
woman 97.6
love 94.7
family 94.2
adult 92.5
baby 92.2
portrait 92.1
two 91
group 90.2
man 88.3
girl 88.2
son 87.9
sit 85.9
indoors 85.5
three 85.1
young 84.3
affection 82.9
art 80.4
retro 80.3

Imagga
created on 2019-10-30

kin 47.4
sexy 37.8
attractive 30.1
love 30
body 29.6
child 28.5
people 26.8
adult 26.5
couple 26.2
man 25.7
model 24.9
sensual 23.7
fashion 23.4
pretty 22.4
portrait 20.7
erotic 20.6
skin 20.4
male 20.4
sibling 20
hair 19.8
person 19.4
passion 18.8
lady 18.7
sex 17.5
sensuality 17.3
bed 17.1
face 16.4
black 16.2
lingerie 16.1
lifestyle 15.9
romance 15.2
two 14.4
seductive 14.4
romantic 14.3
relationship 14.1
happy 13.8
boyfriend 13.5
human 13.5
girlfriend 13.5
blond 13.1
women 12.7
naked 12.6
sexual 12.5
desire 12.5
one 12
style 11.9
underwear 11.6
parent 11.5
together 11.4
hands 11.3
lying 11.3
home 11.2
mother 11
gorgeous 10.9
intimate 10.8
kiss 10.8
nude 10.7
togetherness 10.4
emotion 10.2
cute 10.1
husband 9.9
life 9.8
fun 9.7
hug 9.7
lovers 9.7
bedroom 9.7
looking 9.6
brunette 9.6
muscular 9.6
baby 9.3
smile 9.3
tattoo 9.2
make 9.1
interior 8.9
embracing 8.8
lover 8.8
boy 8.7
happiness 8.6
relaxation 8.4
hot 8.4
lips 8.3
girls 8.2
valentine 8.2
daughter 8.1
father 8
handsome 8
family 8
indoors 7.9
heterosexual 7.9
kissing 7.9
bra 7.8
provocative 7.8
hugging 7.8
eyes 7.8
tan 7.7
married 7.7
glamor 7.7
loving 7.6
studio 7.6
hand 7.6
elegance 7.6
healthy 7.6
feminine 7.5
care 7.4
pumpkin 7.4
cheerful 7.3
dad 7.3
relaxing 7.3
posing 7.1

Google
created on 2019-10-30

Microsoft
created on 2019-10-30

baby 96.7
human face 94.2
text 92.4
person 88.1
art 83.4
clothing 76.9
painting 76.5
toddler 62.3
posing 45

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 98.1%
Fear 0.3%
Confused 0.5%
Angry 0.4%
Happy 2.4%
Sad 1.1%
Calm 94%
Surprised 1%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Female, 92.8%
Fear 0%
Confused 0.1%
Angry 0.2%
Happy 0.5%
Sad 0.2%
Calm 98.2%
Surprised 0.3%
Disgusted 0.5%

AWS Rekognition

Age 1-7
Gender Female, 94.8%
Happy 9.8%
Fear 1.3%
Disgusted 2.2%
Angry 42.8%
Sad 2.2%
Surprised 5.5%
Confused 3.9%
Calm 32.2%

AWS Rekognition

Age 32-48
Gender Male, 70.6%
Happy 3.8%
Angry 0.4%
Disgusted 0.1%
Calm 62.8%
Sad 32.7%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 5-15
Gender Female, 99.3%
Angry 0.5%
Sad 10.2%
Disgusted 0.5%
Fear 0.3%
Calm 86.5%
Happy 0.2%
Confused 1.5%
Surprised 0.3%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 80.7%

Categories

Imagga

pets animals 93.1%
people portraits 6.3%

Text analysis

Amazon

STUART
DON
SUA
ECCELLENZA
MICHELE
A SUA ECCELLENZA DON CARLO MICHELE STUART
A
CARLO
anonma
prima
Conte
mpanmt
dh
de
Blase
Grande
261.
da
mantassimo
Nodeea
anonma tm :. mpanmt
.3049 261.
Belel
Duea dh Berwrckhe d Wla Conte dh Nodeea Grande de Goagma dh prima Blase da ae
mantassimo Ppetettlere dll Belel otis
Ppetettlere
otis
Bmamed
dll
Berwrckhe
:.
.3049
tm
Goagma
1.
d
g
9
cheeh Bmamed SSi 1. g 9
Duea
Wla
cheeh
Sing
Sing mprove
mprove
ae
SSi

Google

Mdonna dte dell Impannata A SUA ECCELLENZA DON CARLo MICHELE STUART Duau de Breowick edeMa Conte de odhen Grande de ge de feoma Clase Na deae eAmantisine Retettore dell Bell h Emered Copuial de Si Lg Barde npe DD.D
Mdonna
dte
dell
Impannata
A
SUA
ECCELLENZA
DON
CARLo
MICHELE
STUART
Duau
de
Breowick
edeMa
Conte
odhen
Grande
ge
feoma
Clase
Na
deae
eAmantisine
Retettore
Bell
h
Emered
Copuial
Si
Lg
Barde
npe
DD.D