Human Generated Data

Title

Aunt of Gerard Dou

Date

1780

People

Artist: Johann Georg Wille, German 1715 - 1808

Artist after: Gerhard Dou, Dutch 1613 - 1675

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3156

Human Generated Data

Title

Aunt of Gerard Dou

People

Artist: Johann Georg Wille, German 1715 - 1808

Artist after: Gerhard Dou, Dutch 1613 - 1675

Date

1780

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-09

Human 99.6
Person 99.6
Art 96.8
Painting 95.9
Drawing 65.2
Photography 61.1
Photo 61.1
Face 59.7
Portrait 59.7

Clarifai
created on 2019-08-09

people 97.7
no person 96.5
art 96.1
portrait 94
architecture 92.6
one 91.6
retro 90.9
painting 90.3
illustration 90.1
adult 89.2
travel 88.6
print 88.2
old 87.9
vintage 87.5
picture frame 87.5
building 84.5
decoration 84.4
man 84.1
museum 82.4
desktop 82.1

Imagga
created on 2019-08-09

stucco 61.4
brass 58.4
memorial 50.7
structure 43.6
old 40.5
vintage 38.1
antique 28.6
art 27.8
ancient 24.2
grunge 23
retro 23
texture 22.9
paper 22.8
architecture 21.4
culture 20.5
wall 19.7
history 18.8
postage 18.7
stamp 18.6
frame 18.3
mail 18.2
post 18.1
design 17.5
religion 17
pattern 15.7
letter 15.6
decoration 15.2
symbol 14.8
postmark 14.8
postal 14.7
historic 14.7
sculpture 14.6
building 14.5
religious 14.1
detail 13.7
stone 12.7
monument 12.2
travel 12
ornate 11.9
carving 11.9
aged 11.8
museum 11.6
obsolete 11.5
rusty 11.4
close 11.4
church 11.1
finance 11
envelope 10.9
border 10.9
landmark 10.8
collection 10.8
currency 10.8
gold 10.7
palace 10.6
one 10.5
blank 10.3
classic 10.2
dirty 10
temple 9.7
decor 9.7
binding 9.5
ornament 9.5
historical 9.4
famous 9.3
dollar 9.3
wallpaper 9.2
decorative 9.2
cash 9.2
global 9.1
tourism 9.1
financial 8.9
style 8.9
stamps 8.9
renaissance 8.8
paintings 8.8
closeup 8.8
icon 8.7
entrance 8.7
old fashioned 8.6
money 8.5
black 8.4
masterpiece 7.9
printed 7.9
carved 7.8
delivery 7.8
window 7.8
golden 7.7
attraction 7.7
international 7.6
painted 7.6
fine 7.6
bill 7.6
door 7.6
ornamental 7.6
city 7.5
traditional 7.5
exterior 7.4
office 7.4
bank 7.4
arch 7.4
brown 7.4
banking 7.4
book jacket 7.3
material 7.1
facade 7
textured 7

Google
created on 2019-08-09

Photograph 95.6
Picture frame 86.8
Art 73.1
Room 65.7
Illustration 65.5
Painting 65.4
History 62.6
Stock photography 62.1
Portrait 61.5
Collection 59.7
Antique 55.3

Microsoft
created on 2019-08-09

human face 97.3
person 91.1
gallery 89.3
drawing 88.9
scene 88.8
clothing 86.2
room 83.4
sketch 74.7
text 73.8
old 70
painting 19.2
picture frame 13.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Female, 51.8%
Happy 0.1%
Calm 7.1%
Angry 5%
Sad 79.8%
Confused 1.6%
Disgusted 4.2%
Fear 1.9%
Surprised 0.4%

Microsoft Cognitive Services

Age 47
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

an old photo of a painting 67.7%
a painting on the wall 67.6%
a painting of a person 64%

Text analysis

Amazon

TANTE
Royale
G.
TANTE DE G. DOW.
DE
Comte
DOW.
etablie
remdyek.
aatre
la
Raypanie?
Monsieur
Malincee
Commiksaired
Dassein
G
de
Direction
peur
Dalieionsicure
peur la Direction Un dss aatre Commiksaired
Clrebilecun
Dassein Cl Clrebilecun / Aoademie Royale de
etablie a Malincee
Aoademie
I. G Wale
Wale
/
Dalieionsicure Monsieur EY I, Comte de
Seriyneur
Seriyneur D remdyek. Raypanie?
am
I,
I.
4entle
dss
Seryiser
Un
Cher
Iir Cher G.. am 4entle Seryiser
a
Cl
G..
EY
Iir
D

Google

I
de
pour
alineee
GWille
e
Darie'a
ofiyneur
un
et
Rapani?
Commissairea
Royale
e par TANTE DE Darie'a Monsicur St. I ofiyneur de emdyek, un pour laDirecion de Mawein et d'Crebilecture G. DOW Comte de Rapani? Juatre Commissairea acadimie Royale de etablie ia alineee GWille
par
Monsicur
laDirecion
G.
etablie
St.
Mawein
d'Crebilecture
ia
TANTE
DE
emdyek,
DOW
Comte
Juatre
acadimie