Human Generated Data

Title

Virgin and Child with the Infant Saint John
Date

15th century
People

Artist: Francesco di Simone Ferrucci, Italian 1437 - 1493

Previous attribution: Francesco Rizzi da Santacroce, active late 15th century - early 16th century

Previous attribution: Marco Bello, active early 16th century - d. 1523
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1900.5

Human Generated Data

Title

Virgin and Child with the Infant Saint John

People

Artist: Francesco di Simone Ferrucci, Italian 1437 - 1493

Previous attribution: Francesco Rizzi da Santacroce, active late 15th century - early 16th century

Previous attribution: Marco Bello, active early 16th century - d. 1523

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1900.5

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.8
Person 97.8
Person 97.5
Person 97.3
Art 92.8
Painting 91.8
People 73.3
Drawing 73
Female 71.6
Portrait 63.2
Photography 63.2
Face 63.2
Photo 63.2
Sketch 57.9
Baby 56
Girl 55.8

Clarifai
created on 2020-04-24

people 100
two 99.3
adult 99.1
group 99
three 98.8
portrait 98.5
baby 98.2
child 97
woman 96.3
offspring 96.1
man 94.4
affection 94.1
family 93.6
four 93.3
art 93.2
wear 92.1
print 88.2
religion 87.7
administration 87.1
son 87

Imagga
created on 2020-04-24

mother 54.4
kin 43.5
parent 42.6
child 26.6
portrait 26.5
people 25.7
man 23.5
male 22.5
love 22.1
happy 20.7
couple 19.2
family 18.7
face 18.5
adult 18.1
attractive 17.5
hair 17.4
grandma 17.3
sibling 16.2
black 15.6
smile 15
daughter 14.8
smiling 14.5
together 14
sexy 13.7
person 13.4
lady 13
skin 12.7
happiness 12.5
model 12.4
lifestyle 12.3
father 12.1
body 12
pretty 11.9
old 11.8
human 11.3
senior 11.2
youth 11.1
husband 10.7
fashion 10.6
one 10.5
boy 10.4
home 10.4
dad 10.3
cute 10
antique 9.5
eyes 9.5
sitting 9.5
world 8.9
kid 8.9
hug 8.7
women 8.7
affection 8.7
married 8.6
close 8.6
togetherness 8.5
relationship 8.4
vintage 8.3
romantic 8
baby 8
men 7.7
girlfriend 7.7
brother 7.7
outdoor 7.6
two 7.6
bed 7.6
beach 7.6
erotic 7.6
head 7.6
house 7.5
lying 7.5
relaxed 7.5
outdoors 7.5
relaxing 7.3
looking 7.2
grandfather 7.2
holiday 7.2
childhood 7.2
romance 7.1
posing 7.1
summer 7.1

Google
created on 2020-04-24

Photograph 95.4
Snapshot 82
Stock photography 78.5
Photography 74.8
Picture frame 74
Child 64.5
Art 58.1
Black-and-white 56.4
Painting 51.9

Microsoft
created on 2020-04-24

person 97.8
drawing 97.3
sketch 96.7
human face 96.6
text 95.8
window 93.4
baby 92.2
painting 88.5
clothing 72.9
child 71.6
black and white 67.4
toddler 58.4
old 40.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Female, 78.3%
Disgusted 0.1%
Sad 0.2%
Angry 0%
Confused 0%
Calm 98.9%
Happy 0%
Surprised 0.8%
Fear 0%

AWS Rekognition

Age 8-18
Gender Male, 78.2%
Happy 0.1%
Disgusted 0%
Calm 99.6%
Angry 0%
Fear 0%
Surprised 0%
Sad 0.2%
Confused 0%

AWS Rekognition

Age 10-20
Gender Female, 68.7%
Sad 11.3%
Angry 10.2%
Happy 0.8%
Fear 2.3%
Disgusted 1.1%
Calm 71%
Confused 1.3%
Surprised 2%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Painting 91.8%

Categories

Imagga

paintings art 64.6%
people portraits 33.2%
pets animals 2%

Captions

Microsoft
created on 2020-04-24

a vintage photo of a baby 72.6%
a vintage photo of a girl 72.5%
a vintage photo of a boy 72.4%