Human Generated Data

Title

Madonna and Sleeping Child with Saint John

Date

19th century

People

Artist: Paolo Caronni, Italian c. 1779 - 1842

Artist after: Il Sassoferrato, Italian 1609 - 1685

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R5656

Human Generated Data

Title

Madonna and Sleeping Child with Saint John

People

Artist: Paolo Caronni, Italian c. 1779 - 1842

Artist after: Il Sassoferrato, Italian 1609 - 1685

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 97.5
Human 97.5
Person 97.1
Art 95
Painting 95
Person 91.7
Face 58.5
Photography 58.5
Portrait 58.5
Photo 58.5

Clarifai
created on 2019-10-29

people 99.8
art 98.2
adult 97.3
illustration 97
woman 96.9
baby 96.6
man 96.4
one 95.9
portrait 95.1
two 94.7
print 93
child 90.9
reclining 90.6
family 89.2
affection 89.1
religion 88
book 87.5
love 87.3
antique 86.8
saint 84.2

Imagga
created on 2019-10-29

phonograph record 85.5
money 54.5
currency 49.4
dollar 47.4
cash 45.8
finance 40.6
wealth 34.1
bank 32.8
banking 32.2
business 31.6
financial 31.2
bill 30.4
paper 28.2
dollars 27.1
us 27
hundred 25.2
close 25.1
one 24.6
savings 23.3
rich 21.4
treasury 19.8
franklin 19.7
banknote 18.4
states 18.4
pay 17.3
closeup 16.8
depository 16.6
stamp 16.4
loan 16.3
exchange 16.2
economy 15.8
note 15.6
mail 15.3
president 14.7
banknotes 14.7
investment 14.7
finances 14.5
united 14.3
vintage 14.1
facility 14.1
postmark 13.8
funds 13.7
bills 13.6
portrait 13.6
old 13.2
symbol 12.8
coin 12.4
face 12.1
concepts 11.6
profit 11.5
post 11.4
sign 11.3
letter 11
envelope 10.8
postage 10.8
postal 10.8
success 10.5
card 10.4
ancient 10.4
object 10.3
art 10.2
circa 9.9
commerce 9.3
number 9.3
retro 9
market 8.9
philately 8.9
wages 8.8
value 8.7
price 8.7
notes 8.6
creation 8.1
federal 7.9
buck 7.9
payment 7.7
change 7.7
tender 7.7
culture 7.7
save 7.6
capital 7.6
single 7.4
message 7.3

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

text 99.9
book 97.6
person 92.7
human face 89.6
drawing 82.3
sketch 65.8
cartoon 64.8
old 59.8
woman 58.5
vintage 45.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 99.3%
Calm 95.6%
Disgusted 0.2%
Angry 0%
Surprised 0.1%
Happy 2.3%
Fear 0%
Sad 1.7%
Confused 0.1%

AWS Rekognition

Age 6-16
Gender Female, 78.9%
Fear 0%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0.6%
Calm 98.6%
Confused 0.1%
Happy 0.4%

AWS Rekognition

Age 2-8
Gender Male, 60.5%
Fear 2%
Angry 64.5%
Confused 2.6%
Calm 13.9%
Sad 2.5%
Happy 1%
Surprised 3.2%
Disgusted 10.3%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Painting 95%

Captions

Microsoft

a vintage photo of a person sitting on a book 58.8%
a vintage photo of a person holding a book 56.8%
a vintage photo of a person holding a book 56.7%

Text analysis

Amazon

VIGILAT.
ET
DORMIO
EGO
MEUM
EGO DORMIO ET COR MEUM VIGILAT.
Srancesco
nperatore?
COR
mstri
lnstriino
1111.79 Srancesco nperatore? lnstriino
ormakmme:
heii
hem
ormakmme: binmin heii hem liiilaea mstri
binmin
timrheris
liiilaea
ulmiii
1111.79
ch
. ch timrheris rmu ulmiii
rmu
.

Google

DORMIO
COR
MEUM
strn
Vne.Dalmas
di
Gornsalemme
mc
Ledemeria
MIRASancesco
ngher
EGO
ET
VIGILAT
mperatore
Lombanda
Re
icena
alee
EGO DORMIO ET COR MEUM VIGILAT MIRASancesco mperatore strn Lombanda Vne.Dalmas hriduca ust Re di Gornsalemme ngher mc icena alee Ledemeria
hriduca
ust