Human Generated Data

Title

Madonna and Child with Saint John
Date

17th century
People

Artist: Jan Witdoeck, Flemish 1615? - after 1641

Artist after: Cornelis Schut I, Flemish 1597 - 1655
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2149

Human Generated Data

Title

Madonna and Child with Saint John

People

Artist: Jan Witdoeck, Flemish 1615? - after 1641

Artist after: Cornelis Schut I, Flemish 1597 - 1655

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2149

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 96.9
Human 96.9
Person 96.9
Art 96.2
Painting 86.3

Clarifai
created on 2019-11-16

people 99.7
art 98.8
one 97.4
print 97.4
adult 96.8
portrait 96.3
painting 93.3
illustration 93
man 92.6
veil 91.4
religion 90.3
baby 90
antique 87.7
Renaissance 85.6
retro 85.2
old 85.1
wear 83.5
woman 83.2
crown 82.4
vintage 81.8

Imagga
created on 2019-11-16

cash 37.5
money 37.4
currency 35
china 34.2
finance 29.6
bank 29.6
banking 29.4
bill 27.6
dollar 26.9
porcelain 26.2
financial 24.9
paper 24.6
wealth 24.2
close 22.2
ceramic ware 21.6
dollars 21.2
savings 20.5
business 19.4
tattoo 18.8
pay 18.2
banknote 17.5
rich 16.7
portrait 16.2
economy 15.8
note 15.6
decoration 15.4
us 15.4
exchange 15.3
banknotes 14.7
utensil 14.1
face 13.5
one 13.4
man 13.4
investment 12.8
design 12.8
bills 12.6
payment 12.5
art 12.5
hundred 11.6
ancient 11.2
old 11.1
closeup 10.8
concepts 10.7
market 10.7
finances 10.6
loan 10.5
vintage 9.9
sculpture 9.8
sketch 9.7
love 9.5
commerce 9.3
people 8.9
drawing 8.9
franklin 8.9
twenty 8.8
detail 8.8
funds 8.8
value 8.7
antique 8.7
notes 8.6
male 8.6
head 8.4
sign 8.3
success 8
statue 7.9
debt 7.7
culture 7.7
profit 7.7
person 7.6
capital 7.6
save 7.6
human 7.5
number 7.5
black 7.2
history 7.2

Google
created on 2019-11-16

Illustration 82.2
Vintage clothing 76.9
Art 73.1
Vintage advertisement 60
Antique 55.3
Painting 50.4

Microsoft
created on 2019-11-16

text 100
book 99.5
human face 95.4
painting 93.7
drawing 93.7
person 92
sketch 86.4
baby 80.8
clothing 77.8
art 67
cartoon 64.4
museum 59.5
woman 53.5
old 41.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-32
Gender Female, 98.4%
Angry 2.2%
Calm 95.7%
Surprised 0.3%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Sad 1.1%
Fear 0.1%

AWS Rekognition

Age 31-47
Gender Male, 98.5%
Fear 0%
Calm 99.4%
Angry 0.2%
Disgusted 0.1%
Confused 0%
Surprised 0.1%
Sad 0%
Happy 0.1%

AWS Rekognition

Age 17-29
Gender Male, 67.3%
Calm 61.5%
Angry 26.6%
Fear 2.2%
Happy 3.4%
Sad 1.7%
Confused 1%
Disgusted 1%
Surprised 2.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Painting 86.3%

Categories

Imagga

paintings art 97.4%
people portraits 2%

Captions

Microsoft
created on 2019-11-16

a person holding a book 40.1%
an old photo of a book 40%
a close up of a book 39.9%

Text analysis

Amazon

diclata
gremiuim,
infanlem
prabet
puilel
vbi
filp
Jo
Liduis vbi csl gremiuim, prabet diclata puellas;
puilel infanlem posic
puellas;
cruces!
csl
discere
Irus discere cruces!
priilegio.
posic
Irus
Comr Schiisti inignl Ciem. priilegio. Jo wililank filp
Liduis
Schiisti
inignl
wililank
Comr
Ciem.

Google

udiis vbi a gremiim, prabet dictata pielis: pilet infanirm discerr posic cnices Iwildoeh feidpR Cun. priudlegio Cor Schit iricnt
udiis
vbi
a
gremiim,
prabet
dictata
pielis:
pilet
infanirm
discerr
posic
cnices
Iwildoeh
feidpR
Cun.
priudlegio
Cor
Schit
iricnt