Human Generated Data

Title

Madonna and Child
Date

16th-17th century
People

Artist: Jacob Matham, Dutch 1571 - 1631

Artist after: Mathieu Dubus, Flemish c. 1590-1665 or 1666
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1946

Human Generated Data

Title

Madonna and Child

People

Artist: Jacob Matham, Dutch 1571 - 1631

Artist after: Mathieu Dubus, Flemish c. 1590-1665 or 1666

Date

16th-17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1946

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.4
Person 99.4
Art 97.6
Painting 97.6
Person 97.6
Archaeology 60.4
Person 50.9

Clarifai
created on 2019-11-16

people 100
art 99.7
adult 99.5
illustration 99
group 98.6
two 98.5
man 98.1
woman 97.8
print 97.6
engraving 97.5
Renaissance 97.2
painting 96.2
baby 95.4
furniture 94.7
kneeling 94.7
sit 93.7
saint 93.1
one 92.3
portrait 91.8
three 91.4

Imagga
created on 2019-11-16

sketch 67.7
drawing 49.2
representation 42.3
art 29.5
book jacket 29.2
religion 27.8
sculpture 25.5
money 23.8
cash 22.9
jacket 22.7
currency 22.4
statue 22.2
dollar 20.4
god 20.1
comic book 19.7
religious 18.7
church 18.5
finance 17.7
banking 17.5
wrapping 17.3
wealth 17.1
astronaut 16.9
spirituality 16.3
culture 16.2
bank 16.1
financial 16
paper 15.7
ancient 15.6
business 15.2
old 14.6
dollars 14.5
bill 14.3
architecture 14.1
savings 14
close 13.7
temple 13.6
holy 13.5
one 13.4
faith 13.4
economy 13
bible 12.7
history 12.5
loan 12.5
capital 12.3
figure 12.1
symbol 12.1
rich 12.1
covering 11.8
us 11.6
spiritual 11.5
pay 11.5
exchange 11.5
carving 11.2
catholic 10.7
antique 10.6
prayer 10.6
detail 10.5
golden 10.3
decoration 10.3
stone 10.1
closeup 10.1
investment 10.1
franklin 9.8
banknotes 9.8
bills 9.7
pray 9.7
hundred 9.7
saint 9.6
profit 9.6
famous 9.3
historic 9.2
design 9.2
vintage 9.1
funds 8.8
banknote 8.7
icon 8.7
payment 8.7
cathedral 8.6
face 8.5
portrait 8.4
monument 8.4
artwork 8.2
masterpiece 7.9
print media 7.9
museum 7.8
travel 7.7
finances 7.7
decorative 7.5
city 7.5
man 7.4
daily 7.2
market 7.1

Google
created on 2019-11-16

Painting 88.3
Art 81.8
Illustration 76.4
Drawing 72
Stock photography 64
Visual arts 62.5
Artwork 53.4

Microsoft
created on 2019-11-16

text 100
drawing 97.5
book 97.5
sketch 97.3
person 96.6
human face 95
clothing 89.3
painting 84.8
cartoon 83
baby 62.5
woman 53.4
man 50.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 72.7%
Happy 0.4%
Angry 1%
Disgusted 0%
Surprised 0.2%
Calm 2.8%
Sad 76.9%
Fear 18%
Confused 0.6%

AWS Rekognition

Age 16-28
Gender Female, 96.1%
Calm 99.3%
Disgusted 0%
Surprised 0%
Fear 0%
Happy 0.1%
Angry 0%
Confused 0%
Sad 0.5%

AWS Rekognition

Age 27-43
Gender Female, 51.9%
Surprised 0%
Sad 74.3%
Fear 25.5%
Angry 0.1%
Happy 0%
Disgusted 0%
Confused 0%
Calm 0.1%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 97.6%

Categories

Imagga

people portraits 94.7%
paintings art 5.2%

Captions

Microsoft
created on 2019-11-16

a person sitting on top of a book 31.7%
a person sitting on a book 30.2%
a person sitting next to a book 30.1%

Text analysis

Amazon

amba
alias
ntata
ante
te
Cum
C
frarentes,
alvete
Felices
Fa
Felices amba ante alias alvete frarentes, C te ntata ala romimumi': latare, triumpha:
latare,
de
tua:
triumpha:
Latitia
romimumi':
rrge
tue.
afarticiserive
fere
fudita
Cum fere nprumis nrus rrge fudita tue. Fa 107 Latitia afarticiserive tua: $S
A1607.
ala
nrus
(By gieit.
(M de (By gieit. Me
exeud
nprumis
(M
Me
107
$S
S

Google

GWanthen
eus
xud
Cs
te
nata
ala
homnlatare,
trumha
CFac
n
latitia
ante
alias
alvete
areates
guere
GWanthen eus xud Cs te nata ala homnlatare, trumha CFac n latitia gartiipeque tua Frehce amba ante alias alvete areates Cun guere
gartiipeque
tua
Frehce
amba
Cun