Human Generated Data

Title

The Doctor and Death

Date

1651

People

Artist: Wenceslaus Hollar, Bohemian 1607 - 1677

Artist after: Hans Holbein the Younger, German 1497/98 - 1543

Artist after: Abraham van Diepenbeeck, Flemish 1596 - 1675

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. A. White, M770

Human Generated Data

Title

The Doctor and Death

People

Artist: Wenceslaus Hollar, Bohemian 1607 - 1677

Artist after: Hans Holbein the Younger, German 1497/98 - 1543

Artist after: Abraham van Diepenbeeck, Flemish 1596 - 1675

Date

1651

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Art 98.4
Painting 95.9
Person 95
Human 95
Person 93.3
Person 87.4
Person 85.7
Person 82.3
Drawing 72
Person 70
Person 64.4
Archaeology 59.3
Sketch 55.7

Clarifai
created on 2021-04-03

art 99.5
people 99.3
painting 99.2
man 96.4
one 96.1
print 95.6
no person 94.6
adult 94.2
museum 94
retro 93.9
portrait 93.5
wear 92.6
sculpture 92.5
veil 91
old 89.9
vintage 88
group 87.8
antique 87.2
Renaissance 86.7
Gothic 86.3

Imagga
created on 2021-04-03

frame 42
vintage 36.4
old 36.2
antique 35.5
art 32.4
ancient 30.3
stucco 29.8
decoration 27.5
gold 26.3
wall 24.2
texture 23.6
ornate 22
retro 21.3
design 20.8
blank 19.7
religion 18.8
decorative 18.4
wood 18.4
grunge 17.9
decor 17.7
aged 17.2
border 17.2
empty 17.2
pattern 17.1
museum 16.5
ornament 16.4
golden 16.3
style 16.3
carving 16.3
painting 16.3
interior 15.9
wooden 15.8
framework 15.5
architecture 15.4
home 15.4
building 15.2
window 14.6
culture 14.5
door 13.8
carved 13.7
church 12.9
arabesque 12.7
deco 12.7
ornamental 12.3
binding 12.3
temple 11.4
detail 11.3
religious 11.2
sculpture 11.1
object 11
paper 11
house 10.9
covering 10.8
entrance 10.6
brown 10.3
historic 10.1
structure 10.1
square 10
gilded 9.9
gallery 9.8
exhibition 9.8
frames 9.8
paintings 9.8
rustic 9.6
obsolete 9.6
decorated 9.6
decorate 9.5
history 8.9
furniture 8.9
baroque 8.8
rectangle 8.8
textured 8.8
furnishing 8.8
tile 8.6
space 8.5
travel 8.5
traditional 8.3
letter 8.3
prayer rug 7.9
framed 7.8
saint 7.7
rusty 7.6
old fashioned 7.6
stone 7.6
city 7.5
rich 7.5
room 7.4
rug 7.3
dirty 7.2
shelf 7.1
icon 7.1

Google
created on 2021-04-03

Book 85.7
Font 84.2
Wood 82.5
Art 80.9
Painting 80
Rectangle 77.5
Illustration 72.1
Visual arts 69.9
Drawing 68.9
Paper 68.1
History 66.6
Pattern 66.6
Room 64.9
Antique 63.9
Ancient history 63.1
Paper product 61.8
Collection 57.7
Artwork 57.4
Vintage clothing 56.9
Publication 56.9

Microsoft
created on 2021-04-03

gallery 99.7
scene 99.6
room 99.5
indoor 98.8
wall 97.8
drawing 96.8
text 94
art 85.2
sketch 84.9
museum 81.1
person 74.5
painting 62.9
book 59.8
picture frame 58
engraving 55.1
old 46.4
decorated 36.1

Face analysis

Amazon

AWS Rekognition

Age 45-63
Gender Male, 98.8%
Calm 98.6%
Angry 0.7%
Disgusted 0.3%
Happy 0.2%
Sad 0.1%
Surprised 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 22-34
Gender Male, 79.1%
Calm 78.6%
Angry 19.1%
Sad 1%
Happy 0.6%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 2-8
Gender Male, 99.3%
Calm 97%
Angry 2.7%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Sad 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 29-45
Gender Female, 88.9%
Sad 68.5%
Calm 13.8%
Happy 12.8%
Angry 4%
Confused 0.4%
Fear 0.3%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-66
Gender Male, 98.5%
Calm 96.9%
Sad 1.4%
Angry 0.7%
Happy 0.6%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Confused 0%

Feature analysis

Amazon

Person 95%

Captions

Microsoft

a painting hanging on a wall 87.2%
a painting in a frame hanging on a wall 83.2%
a painting on the wall 83.1%

Text analysis

Amazon

Medice
curate
Medice curate ipfi.
ipfi.

Google

Medice,
cura
¢
ipfitm
13 Medice, cura te ipfitm . ¢
13
.
te