Human Generated Data

Title

Untitled (portrait of artist's mother, left page); Untitled (sailor smoking pipe, right page)

Date

1943

People

Artist: Otto Piene, German 1928 - 2014

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.2.28

Human Generated Data

Title

Untitled (portrait of artist's mother, left page); Untitled (sailor smoking pipe, right page)

People

Artist: Otto Piene, German 1928 - 2014

Date

1943

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2021-03-26

Text 96.5
Drawing 92.3
Art 92.3
Diary 86.5
Sketch 83.5
Painting 82.9

Clarifai
created on 2021-03-26

art 99.1
retro 98.6
painting 98.2
antique 97.7
paper 97.6
wear 97.4
vintage 97.4
old 97
illustration 96.3
ancient 95.8
sepia pigment 95.1
man 91.6
people 91.1
portrait 90.6
artistic 89.6
print 89.1
dirty 87.4
desktop 86.5
visuals 86.5
one 86.3

Imagga
created on 2021-03-26

burlap 100
grunge 53.7
paper 53.6
old 50.3
vintage 48.9
retro 47.6
antique 42.5
texture 42.4
aged 39.9
ancient 39.9
dirty 35.3
book 35
bath towel 33.9
empty 31.8
blank 31.8
material 31.3
parchment 29.8
towel 29.2
page 27.9
damaged 27.7
bath linen 27.1
document 25.1
brown 24.3
rough 23.7
frame 23.3
crumpled 23.3
textured 22.8
border 22.7
cardboard 22.1
worn 22
linen 21.1
manuscript 20.6
decay 20.3
wallpaper 19.9
design 19.7
old fashioned 19.1
grungy 19
stains 18.5
container 18.1
sheet 17.9
torn 17.4
stained 17.3
pattern 17.1
space 17.1
grain 16.6
ragged 16.6
burnt 16.5
letter 16.5
art 16.3
surface 15.9
wall 15.4
history 15.2
historic 14.7
grime 14.7
wallet 14.3
weathered 14.3
canvas 14.3
text 14
cover 13.9
pages 13.7
yellow 13.3
backdrop 13.2
backgrounds 13
fracture 12.7
scrapbook 12.6
open 12.6
decorative 12.5
aging 12.5
age 12.4
case 12.2
shabby 11.8
faded 11.7
spot 11.5
obsolete 11.5
rusty 11.5
structure 11.3
envelope 11.2
card 11.1
scratched 10.8
stain 10.6
fiber 10.6
message 10.1
crease 9.8
mottled 9.8
sepia 9.7
close 9.7
detail 9.7
artistic 9.6
graphic 9.5
note 9.2
style 8.9
decoration 8.9
distressed 8.9
broad 8.9
beige 8.7
dirt 8.6
back 8.3
correspondence 7.8
uneven 7.8
tracery 7.8
succulent 7.8
crack 7.8
messy 7.7
board 7.7
textures 7.6
object 7.3
effect 7.3
copy 7.1
nobody 7

Google
created on 2021-03-26

Handwriting 90.6
Art 81.3
Font 77.7
Wrinkle 73.6
Painting 73.5
Big cats 71.2
Wood 70.7
Drawing 70.6
Illustration 69.7
Visual arts 68.1
Paper 68
Terrestrial animal 67.9
Paper product 66.7
Felidae 64.1
Ancient history 63.4
Relief 62.9
Artwork 62.6
History 62.2
Sketch 59.2
Line art 58.5

Microsoft
created on 2021-03-26

drawing 98.2
sketch 95.7
handwriting 92.2
text 89
illustration 82.2
art 73.4
stone 29.2

Face analysis

Amazon

Google

AWS Rekognition

Age 37-55
Gender Female, 56.9%
Fear 54.6%
Happy 10.8%
Sad 8.5%
Angry 8.4%
Calm 7.2%
Surprised 6.5%
Disgusted 2.3%
Confused 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Painting 82.9%

Captions

Microsoft

a close up of a stone wall 60.3%
a close up of text on a white surface 60.2%
a selfie of a stone wall 50%

Text analysis

Amazon

o
35643
Mlulott
iie
Eiee
iie arloat
arloat

Google

Pastanto 36643
Pastanto
36643