Human Generated Data

Title

Mary and Christ

Date

17th century

People

Previous attribution: Wenceslaus Hollar, Bohemian 1607 - 1677

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gray Collection of Engravings Fund, G4727

Human Generated Data

Title

Mary and Christ

People

Previous attribution: Wenceslaus Hollar, Bohemian 1607 - 1677

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Art 98.6
Painting 98.6
Human 97.7
Person 97.7
Person 96

Clarifai
created on 2019-08-08

people 100
child 99.8
baby 99.7
two 99.5
affection 98.9
son 98.8
portrait 98.7
art 97.8
adult 97.6
offspring 96.9
family 96.1
sit 95.1
interaction 92.8
wear 92.3
woman 92.1
one 91.9
seat 91.3
furniture 91.1
engraving 90.6
sibling 90.5

Imagga
created on 2019-08-08

world 33
kin 26
person 25.6
portrait 24.6
people 24
adult 22
child 21.5
mother 21.2
face 19.2
hair 18.2
love 18.2
man 18.2
fashion 18.1
model 17.9
attractive 17.5
lady 16.2
statue 15.9
happy 15.7
sexy 15.3
sketch 15
male 14.8
pretty 14.7
couple 13.9
parent 13.5
family 13.4
cute 12.9
human 12.8
old 12.5
youth 11.9
black 11.7
religion 11.7
adolescent 11.5
one 11.2
home 11.2
skin 11
happiness 11
elegance 10.9
smiling 10.9
dress 10.8
drawing 10.8
couch 10.6
sofa 10.6
antique 10.4
ancient 10.4
juvenile 10.3
religious 10.3
lifestyle 10.1
head 10.1
smile 10
vintage 9.9
sadness 9.7
fun 9.7
sepia 9.7
clothing 9.7
together 9.6
body 9.6
representation 9.6
boy 9.6
sculpture 9.6
eyes 9.5
sitting 9.5
alone 9.1
girls 9.1
art 9.1
sensuality 9.1
husband 9.1
brother 9
looking 8.8
wife 8.5
relationship 8.4
emotion 8.3
romance 8
posing 8
interior 8
women 7.9
catholic 7.8
health 7.6
hand 7.6
relaxation 7.5
style 7.4
life 7.4
historic 7.3
makeup 7.3
groom 7.2
kid 7.1
architecture 7
look 7

Google
created on 2019-08-08

Painting 86.8
Child 84.4
Art 79.6
Visual arts 69.9
Drawing 66.1
Portrait 62.5
Photography 62.4
Mother 61.9
Picture frame 59.5
Artwork 58.6

Microsoft
created on 2019-08-08

person 98.4
baby 95.8
human face 93
text 88.9
toddler 88.7
clothing 87.2
sketch 82.2
drawing 77.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 98.7%
Confused 5.8%
Happy 7.8%
Surprised 7.3%
Sad 22.3%
Calm 42.9%
Angry 5.5%
Disgusted 8.4%

AWS Rekognition

Age 12-22
Gender Female, 96.1%
Disgusted 1.5%
Angry 4.8%
Happy 1.7%
Surprised 3%
Calm 49.4%
Sad 35.6%
Confused 4.1%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.6%
Person 97.7%

Captions

Microsoft

a little girl posing for a photo 88.7%
a black and white photo of a baby 80.8%
a little girl posing for a picture 80.7%

Text analysis

Amazon

we