Human Generated Data

Title

Bust of the Virgin
Date

16th century
People

Artist: Pontormo (Jacopo Carrucci da Pontormo), Italian 1494 - 1557
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Isabelle and Alfred Bader in honor of Sydney J. Freedberg, 1989.1

Human Generated Data

Title

Bust of the Virgin

People

Artist: Pontormo (Jacopo Carrucci da Pontormo), Italian 1494 - 1557

Date

16th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Clothing 97.5
Apparel 97.5
Painting 94.2
Art 94.2
Face 88.1
Human 88.1
Bonnet 82
Hat 82
Photo 67.1
Photography 67.1
Portrait 67.1
Person 65

Clarifai
created on 2020-04-24

portrait 99.8
people 99.7
one 99.2
art 98.3
adult 96.9
woman 95.6
wear 95.4
veil 95.4
painting 84.1
facial expression 78.6
girl 77.5
monochrome 77.5
lid 76.9
profile 73.6
print 73.4
face 73.3
model 72.6
old 70.8
child 70.7
vintage 69.9

Imagga
created on 2020-04-24

child 49.1
bath towel 43.1
towel 36.1
portrait 35
bath linen 34.4
person 32.5
adult 29.8
eyes 28.4
hair 27
model 26.5
attractive 25.9
smile 25.7
linen 25.6
pretty 24.5
face 24.2
happy 23.2
hat 22.9
cute 21.5
people 21.2
expression 20.5
fashion 19.6
smiling 19.6
sexy 19.3
clothing 18.7
bride 18.2
bonnet 18
youth 17.9
lady 16.2
looking 15.2
brunette 14.8
wedding 14.7
headdress 14.7
gorgeous 14.5
studio 14.5
love 14.2
happiness 13.3
kid 13.3
skin 12.7
childhood 12.6
posing 12.5
blond 12.4
lips 12
human 12
close 12
one 12
women 11.9
girls 11.9
teenager 11.9
sensuality 11.8
dress 11.8
gown 11.7
life 11.1
lovely 10.7
look 10.5
boy 10.4
lifestyle 10.1
children 10
sensual 10
bridal 9.7
facial 9.6
feminine 9.4
head 9.2
cheerful 8.9
innocent 8.9
erotic 8.7
married 8.6
mother 8.6
juvenile 8.5
mouth 8.5
black 8.5
elegance 8.4
joy 8.4
emotion 8.3
teen 8.3
male 8.2
family 8
wed 7.9
smasher 7.9
veil 7.8
hairstyle 7.6
healthy 7.6
fun 7.5
outdoors 7.5
pure 7.4
joyful 7.4
long 7.4
makeup 7.3
covering 7.3
pose 7.3
baby 7.2
little 7.1

Google
created on 2020-04-24

Photograph 95.9
Face 95.4
Portrait 94.5
Forehead 78.2
Self-portrait 69.7
Art 69.5
Photography 67.8
Stock photography 64
Vintage clothing 61.7
Black-and-white 56.4
Drawing 55.8
Visual arts 55

Microsoft
created on 2020-04-24

sketch 97.9
human face 97
drawing 96.3
person 95.8
painting 91.6
portrait 90.1
indoor 90
text 87.9
face 76.6
posing 68.6
black and white 63.7
girl 52.9
hair 42.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 98.5%
Surprised 76.7%
Sad 0.8%
Disgusted 2.5%
Confused 12.5%
Calm 3.8%
Angry 0.5%
Fear 2.1%
Happy 1.1%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 94.2%
Person 65%

Captions

Microsoft

a woman posing for a photo 91%
a person posing for the camera 90.9%
a girl posing for a photo 78.3%