Human Generated Data

Title

Madonna of Saint Claire
Date

19th century
People

Artist: Ferdinand Leenhoff, French 1841 - 1914

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. Benjamin Allen Rowland, M10167

Human Generated Data

Title

Madonna of Saint Claire

People

Artist: Ferdinand Leenhoff, French 1841 - 1914

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. Benjamin Allen Rowland, M10167

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Human 99.4
Person 99.4
Art 97.3
Drawing 94.6
Sketch 84.5
Painting 77.9
Photography 70
Face 70
Portrait 70
Photo 70
Person 66
Baby 65.1

Clarifai
created on 2019-03-22

people 99.9
portrait 99.7
art 99.3
print 98.1
two 98.1
adult 97.5
woman 97.2
retro 96
child 95.9
baby 95.3
engraving 95
affection 94.6
illustration 93.4
son 92.7
man 91.5
one 90.4
vintage 89.9
wear 86.8
antique 86
love 85.7

Imagga
created on 2019-03-22

sketch 43.1
drawing 31.1
representation 29.8
baby 26.3
money 25.5
currency 25.1
statue 22.3
mother 21.2
cash 21
fetus 19.6
dollar 19.5
sculpture 18
bank 16.1
finance 16.1
people 15.6
ancient 15.6
bill 15.2
paper 15
man 14.8
banking 14.7
vertebrate 14.6
business 14.6
male 14.5
parent 14.5
wealth 13.5
religion 13.4
old 13.2
portrait 12.9
human 12.7
art 12.6
hundred 12.6
antique 12.1
face 12.1
close 12
culture 12
history 11.6
dollars 11.6
economy 11.1
historic 11
stone 11
black 10.9
banknotes 10.8
financial 10.7
marble 10.7
kin 10.6
one 10.5
body 10.4
savings 10.3
rich 10.2
franklin 9.8
chordate 9.8
adult 9.7
decoration 9.7
us 9.6
finances 9.6
payment 9.6
pay 9.6
god 9.6
closeup 9.4
religious 9.4
person 9.1
vintage 9.1
child 8.9
banknote 8.7
architecture 8.6
exchange 8.6
united 8.6
historical 8.5
brother 7.9
creation 7.8
newspaper 7.7
states 7.7
loan 7.7
notes 7.7
monument 7.5
figure 7.4
church 7.4
peace 7.3
hair 7.1

Google
created on 2019-03-22

Painting 88.7
Picture frame 85.4
Art 85.2
Illustration 71.8
Visual arts 64.9
Portrait 61.5
Mother 60.9
Drawing 60.7
Style 52.5
Artwork 52.3
Modern art 50.6

Microsoft
created on 2019-03-22

wall 99.2
text 93.1
art 93.1
museum 72.4
monochrome 45.7
portrait 43.7
drawing 20.3
child 20.1
boy 18.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Sad 29.6%
Happy 3.1%
Calm 53.9%
Angry 4.3%
Disgusted 1.6%
Confused 5.5%
Surprised 2%

AWS Rekognition

Age 4-7
Gender Female, 94.5%
Confused 13.3%
Angry 13.6%
Surprised 14%
Sad 21.8%
Happy 1.9%
Disgusted 3.7%
Calm 31.7%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 77.9%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-03-22

a person holding a book 51%
a person holding a book 50.9%
a bear that is posing for a photo 50.8%