Human Generated Data

Title

Inserted sketch of artist's mother

Date

1939

People

Artist: Otto Piene, German 1928 - 2014

Classification

Archival Material

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.2.22.1

Human Generated Data

Title

Inserted sketch of artist's mother

People

Artist: Otto Piene, German 1928 - 2014

Date

1939

Classification

Archival Material

Machine Generated Data

Tags

Amazon
created on 2021-03-26

Text 99
Diary 98.3
Book 92.3
Drawing 91.4
Art 91.4
Sketch 86
Document 85.2
Passport 85.2
Id Cards 85.2
Page 63.8

Clarifai
created on 2021-03-26

paper 98.2
retro 96.8
wear 96.7
old 94.3
art 94.1
ancient 93.2
chalk out 93
empty 91.1
writing 91.1
painting 90.8
dirty 90.3
illustration 90.1
people 89.8
desktop 89.8
sepia pigment 89.5
parchment 89.4
no person 89.2
antique 89.2
man 88.5
vintage 88.3

Imagga
created on 2021-03-26

bath towel 100
towel 85.3
bath linen 84.7
linen 64
grunge 54.6
vintage 52.2
paper 51.2
old 47.5
antique 43.4
retro 41.9
envelope 40.4
texture 40.4
ancient 39
aged 39
blank 31.8
empty 31
book 26.9
dirty 26.3
handkerchief 25.5
page 25.1
frame 22.5
document 22.3
container 22.3
stained 22.2
brown 22.1
parchment 22.1
border 21.7
material 21.5
piece of cloth 20.9
letter 20.2
worn 20.1
sheet 19.8
design 19.7
damaged 19.1
art 18.9
pattern 18.5
fabric 18
crumpled 17.5
grungy 17.1
canvas 17.1
manuscript 16.7
torn 16.5
decorative 15.9
stains 15.6
rough 15.5
decay 15.5
open 15.3
text 14.9
note 14.7
burnt 14.6
scrapbook 14.6
cardboard 14.4
history 14.3
age 14.3
wallpaper 13.8
card 13.8
historic 13.8
pages 13.7
surface 13.3
cover 13
notebook 12.4
structure 12.2
yellow 11.9
ragged 11.7
stain 11.6
spot 11.5
decoration 11.5
rusty 11.5
textured 11.4
backgrounds 11.4
wall 11.3
floral 11.1
broad 10.8
shabby 10.8
grime 10.8
used 10.6
grain 10.2
space 10.1
color 10
flower 10
mottled 9.8
creative 9.7
aging 9.6
mail 9.6
roll 9.5
graphic 9.5
back 9.2
correspondence 8.8
object 8.8
diary 8.8
tracery 8.8
fracture 8.8
faded 8.8
succulent 8.8
sepia 8.8
memory 8.7
artistic 8.7
post 8.6
old fashioned 8.6
weathered 8.6
backdrop 8.3
artwork 8.3
message 8.2
style 8.2
decor 8
postal 7.9
stationery 7.8
medieval 7.7
write 7.5
writing 7.5
cotton 7.5
element 7.5
greeting 7.4
paint 7.3
detail 7.3
stamp 7.1
leaf 7

Google
created on 2021-03-26

Gesture 85.3
Art 84.8
Font 83.3
Figure drawing 73.9
Paper 72.7
Line art 71.7
Illustration 70.8
Drawing 70.5
Pattern 69.7
Visual arts 69.7
Paper product 68.1
Painting 66.9
Rectangle 63.3
Artwork 62.4
Ink 60.5
Sketch 57.8
Notebook 56.7
Wood 53.3
Handwriting 51.4

Microsoft
created on 2021-03-26

drawing 99.6
sketch 99.2
handwriting 96.1
child art 95.8
text 93.7
cartoon 68
illustration 60.1
stone 4.6

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 9-19
Gender Female, 88.8%
Sad 99.7%
Calm 0.2%
Angry 0%
Fear 0%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 22-34
Gender Male, 97.5%
Sad 69.7%
Calm 28%
Angry 1.7%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 38-56
Gender Male, 79.9%
Fear 97.2%
Surprised 2%
Sad 0.3%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Calm 0.1%
Disgusted 0%

AWS Rekognition

Age 18-30
Gender Male, 81.3%
Surprised 67.7%
Fear 27.8%
Angry 1.3%
Confused 0.8%
Happy 0.7%
Disgusted 0.7%
Calm 0.5%
Sad 0.4%

AWS Rekognition

Age 37-55
Gender Male, 93.2%
Happy 84.5%
Calm 6.6%
Surprised 2.7%
Fear 2.6%
Confused 2.1%
Sad 0.7%
Disgusted 0.5%
Angry 0.4%

Microsoft Cognitive Services

Age 56
Gender Male

Feature analysis

Amazon

Book 92.3%
Passport 85.2%

Captions

Microsoft

a close up of text on a white surface 50.6%
a close up of text on a white background 49.2%
a close up of text on a black background 43.1%

Text analysis

Amazon

L
ntemven L
A
Puthe
ntemven
em
Minn Puthe
Com
Com Vilbr
Minn
Vilbr

Google

Aantomeven
Aantomeven