Human Generated Data

Title

Madonna and Child with Saint John

Date

17th century

People

Artist: Cornelis Bloemaert, Dutch 1603 - 1684

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G379

Human Generated Data

Title

Madonna and Child with Saint John

People

Artist: Cornelis Bloemaert, Dutch 1603 - 1684

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G379

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Human 98.8
Person 98.8
Person 97.1
Person 94.4
Art 93.7
Painting 93.5
Person 70

Clarifai
created on 2019-08-06

people 100
art 99.1
print 98.5
portrait 98.4
adult 98.4
illustration 98.4
engraving 97.8
baby 97.2
group 96.2
two 95.2
affection 94.7
man 93.5
woman 93.4
one 89.7
antique 89.1
leader 88.4
veil 88.4
vintage 87.2
child 86.1
old 84.1

Imagga
created on 2019-08-06

portrait 33.7
attractive 32.2
sketch 32.2
sexy 31.4
fashion 30.2
model 28.8
adult 28.5
hair 27.8
pretty 25.9
face 24.9
people 24.6
drawing 23.2
love 22.1
person 21.8
representation 21.8
skin 19.6
sensuality 19.1
lady 18.7
body 18.4
makeup 18.3
couple 18.3
man 17.4
sensual 17.3
cute 17.2
erotic 16.4
style 16.3
passion 16
black 16
studio 15.2
elegance 15.1
human 14.3
male 14.2
brunette 13.1
youth 12.8
make 12.7
gorgeous 12.7
glamor 12.5
two 11.9
lifestyle 11.6
posing 11.6
desire 11.5
lips 11.1
dress 10.9
romance 10.7
sexual 10.6
women 10.3
mother 10.1
long 10.1
head 10.1
romantic 9.8
lovely 9.8
close 9.7
art 9.7
clothing 9.5
elegant 9.4
happy 9.4
expression 9.4
feminine 9.4
looking 8.8
jacket 8.8
sex 8.8
book jacket 8.7
kin 8.6
cosmetics 8.4
dark 8.4
tattoo 8.3
decoration 8.3
figure 8.3
emotion 8.3
one 8.2
home 8
blond 7.8
eyes 7.8
underwear 7.7
naked 7.7
luxury 7.7
culture 7.7
relationship 7.5
vintage 7.5
antique 7.5
valentine 7.3
handsome 7.1
sofa 7

Google
created on 2019-08-06

Microsoft
created on 2019-08-06

text 100
book 99.6
baby 96.4
human face 94.7
person 90.1
drawing 85.1
clothing 83.7
sketch 81.8
toddler 73.8
posing 55.2
art 53

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 99.7%
Sad 75.6%
Angry 2.8%
Confused 1.3%
Disgusted 0.6%
Surprised 0.8%
Calm 18.4%
Happy 0.5%

AWS Rekognition

Age 26-44
Gender Female, 75.5%
Calm 54.2%
Happy 0.5%
Disgusted 0.7%
Angry 7.8%
Confused 11.9%
Surprised 6%
Sad 18.8%

AWS Rekognition

Age 4-9
Gender Female, 95.3%
Happy 0.5%
Confused 0.7%
Sad 13.9%
Disgusted 0.3%
Surprised 1.2%
Angry 0.7%
Calm 82.8%

AWS Rekognition

Age 48-68
Gender Male, 94.6%
Confused 14.8%
Disgusted 24.3%
Happy 2.8%
Calm 27%
Sad 13.2%
Surprised 6.4%
Angry 11.5%

AWS Rekognition

Age 38-59
Gender Male, 96.3%
Surprised 2.2%
Angry 2.5%
Confused 5.5%
Happy 3.8%
Sad 4.7%
Disgusted 5.1%
Calm 76.1%

AWS Rekognition

Age 4-9
Gender Male, 60.5%
Angry 4.2%
Surprised 5.4%
Calm 49.6%
Sad 28.8%
Happy 3.1%
Disgusted 3.7%
Confused 5.1%

AWS Rekognition

Age 48-68
Gender Male, 98.8%
Angry 8.4%
Happy 3.1%
Sad 19.3%
Disgusted 6.9%
Surprised 3.6%
Calm 52.7%
Confused 6%

AWS Rekognition

Age 4-7
Gender Male, 97.6%
Surprised 5.6%
Sad 11.3%
Angry 7.7%
Calm 11.8%
Disgusted 39.7%
Happy 2%
Confused 21.9%

AWS Rekognition

Age 49-69
Gender Male, 95.9%
Happy 3.8%
Disgusted 27.1%
Sad 21.9%
Confused 14.6%
Angry 20.6%
Surprised 3.5%
Calm 8.4%

AWS Rekognition

Age 10-15
Gender Male, 99.2%
Happy 3.8%
Calm 45.7%
Disgusted 21.2%
Surprised 2.2%
Sad 6%
Confused 13%
Angry 8.2%

AWS Rekognition

Age 4-7
Gender Male, 92.8%
Disgusted 70.2%
Calm 12.5%
Sad 3.5%
Angry 5.8%
Surprised 2.2%
Confused 3%
Happy 2.9%

AWS Rekognition

Age 26-43
Gender Male, 81.4%
Confused 8.6%
Sad 45.8%
Happy 3.3%
Calm 12.1%
Disgusted 19.3%
Angry 7.8%
Surprised 3%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 93.5%

Categories

Imagga

pets animals 97.5%
paintings art 2.4%

Captions

Text analysis

Amazon

VINCENTIO
MARCH."
IVSTINIANO
DNO
AGNVS
ILL. DNO MARCH." VINCENTIO IVSTINIANO
Blbemacrt
ILL.
pinxit
Cornelius
Titianus
Titianus pinxit Syperiora hiuentis
Cornelius Blbemacrt DD. Romi
Syperiora
DD.
hiuentis
Romi
afaulonit
Chontmi.
Riy Chontmi.
Riy

Google

ILL DNO MARCH Cornefut Blbemacet VINCENTIO IVSTINIANO DD Rome Superiera lntie Titianus pinxit Cam pri S.C. Ma Reg Chrutmi cCAGN
ILL
DNO
MARCH
Cornefut
Blbemacet
VINCENTIO
IVSTINIANO
DD
Rome
Superiera
lntie
Titianus
pinxit
Cam
pri
S.C.
Ma
Reg
Chrutmi
cCAGN