Human Generated Data

Title

Untitled (sketch of small animal, left page); Untitled (portrait of female figure [artist's mother], right page)
Date

1939-1944
People

Artist: Otto Piene, German 1928 - 2014
Classification

Drawings
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.2.2

Human Generated Data

Title

Untitled (sketch of small animal, left page); Untitled (portrait of female figure [artist's mother], right page)

People

Artist: Otto Piene, German 1928 - 2014

Date

1939-1944

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2021-03-26

Art 97.7
Drawing 93.7
Canvas 92.9
Sketch 92.4
Text 82.6
Animal 72
Pet 72
Dog 72
Mammal 72
Canine 72
Painting 66.3
Sea Life 64.1
Reptile 64.1
Turtle 64.1

Clarifai
created on 2021-03-26

art 98.8
painting 98.3
people 97.1
no person 96.2
retro 96
portrait 95.8
illustration 95.8
wear 95.6
two 95.6
one 95.5
man 95.2
cat 93.5
old 92.8
mammal 92.8
paper 92.2
adult 90.3
artistic 90.1
dirty 89.1
print 88.4
parchment 88.1

Imagga
created on 2021-03-26

grunge 50.2
paper 42.7
vintage 42.2
old 41.1
antique 39.8
retro 36.9
texture 36.1
aged 30.8
sketch 28.6
drawing 27.9
ancient 26.8
frame 25
art 24.6
decoration 23.3
graffito 22.9
blank 22.3
envelope 21.8
dirty 21.7
empty 20.6
page 20.4
parchment 20.2
border 19.9
material 19.7
textured 19.3
pattern 18.5
design 18.1
container 17.7
damaged 17.2
grungy 17.1
floral 17
brown 16.9
representation 16.5
flower 16.2
crumpled 15.5
torn 15.5
worn 15.3
text 14.8
stamp 14.7
rough 14.6
wallpaper 14.6
stain 14.4
letter 13.8
old fashioned 13.3
graphic 13.1
document 13
space 12.4
card 11.9
book 11.8
paint 11.8
shabby 11.8
wall 11.7
decorative 11.7
stains 11.7
stained 11.5
textures 11.4
backgrounds 11.4
leaf 10.9
manuscript 10.8
faded 10.7
decay 10.6
cardboard 10.6
weathered 10.5
artistic 10.4
color 10
grime 9.8
fracture 9.7
burnt 9.7
rustic 9.6
bath towel 9.6
rusty 9.5
canvas 9.5
money 9.4
tile 9.2
cash 9.2
backdrop 9.1
history 8.9
structure 8.9
burned 8.8
surface 8.8
ragged 8.8
album 8.8
messy 8.7
rust 8.7
business 8.5
sheet 8.5
grain 8.3
style 8.2
currency 8.1
mottled 7.8
towel 7.8
scrapbook 7.8
aging 7.7
bath linen 7.6
rich 7.4
note 7.4
banking 7.4
historic 7.3
fabric 7.3
yellow 7.3
die 7.3
shower 7.2
detail 7.2
bank 7.2

Google
created on 2021-03-26

Polar bear 94.4
Jaw 88.1
Gesture 85.3
Carnivore 85.1
Art 83.1
Wall 80.8
Dinosaur 79.9
Paint 78.9
Painting 78.6
Felidae 76.6
Wood 73.5
Extinction 71.7
Drawing 71.5
Rectangle 71
Illustration 70.4
Visual arts 69.7
Terrestrial animal 69.6
Big cats 69.2
Dog breed 68.6
Font 65.1

Microsoft
created on 2021-03-26

drawing 99.5
sketch 99.1
text 98.2
child art 95.9
art 83.6
illustration 67.4
cartoon 65.7
painting 50.3

Face analysis

Amazon

AWS Rekognition

Age 50-68
Gender Male, 85.5%
Sad 86.6%
Fear 5.5%
Calm 4.4%
Angry 1.7%
Confused 0.7%
Disgusted 0.4%
Surprised 0.3%
Happy 0.3%

Feature analysis

Amazon

Dog 72%
Turtle 64.1%

Captions

Microsoft

a close up of text on a white surface 63.9%
a close up of text on a white background 62.9%
a close up of text on a black background 54.8%

Text analysis

Amazon

malinhe,maisemaissinke!
Pinmn
/no.308.39
Sudnpn /no.308.39
Or Pinmn Diu1tn-!l!
NImine
Or
Sudnpn
Diu1tn-!l!

Google

G.P.
9. G.P. maliike, maiase, maidsinte! Linbinkn i/0.308.39
maidsinte!
9.
maiase,
Linbinkn
i/0.308.39
maliike,