Human Generated Data

Title

Untitled (portrait of young man, left page); Untitled (sketch of woman on street, right page)

Date

1943

People

Artist: Otto Piene, German 1928 - 2014

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.2.27

Human Generated Data

Title

Untitled (portrait of young man, left page); Untitled (sketch of woman on street, right page)

People

Artist: Otto Piene, German 1928 - 2014

Date

1943

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2021-03-26

Text 99.6
Diary 97.9
Person 97.5
Human 97.5
Book 97.3
Person 86.9
Passport 75.4
Id Cards 75.4
Document 75.4
Art 70.4
Drawing 70.4
Person 50.7

Clarifai
created on 2021-03-26

people 98.3
art 98.2
painting 97.6
sepia pigment 97
retro 96.9
paper 96.7
wear 96.5
vintage 96.5
old 96.5
man 96.4
print 96.1
antique 95.6
illustration 94.6
portrait 93.4
adult 92.9
ancient 92.5
one 87.5
chalk out 85.4
engraving 83
document 82

Imagga
created on 2021-03-26

envelope 80.1
paper 55.1
container 54.5
vintage 52.2
old 48.9
grunge 48.6
retro 43.5
binding 39.1
antique 37.3
texture 35.5
ancient 34.7
book 34.5
aged 33.5
blank 30.1
empty 29.3
page 26
document 25.1
dirty 24.4
brown 24.3
border 22.7
material 22.4
frame 20
letter 19.3
parchment 19.2
damaged 18.2
design 18
notebook 17.9
card 17.2
history 17
art 16.3
open 16.2
sheet 16
rough 15.5
stained 15.4
worn 15.3
pattern 15.1
note 14.7
historic 14.7
pages 14.7
wallpaper 14.6
canvas 14.3
grungy 14.3
cover 13.9
manuscript 13.7
stains 13.6
crumpled 13.6
cardboard 13.5
decorative 13.4
style 13.4
textured 13.2
journal 13.1
scrapbook 12.6
torn 12.6
packet 12.2
package 11.7
memory 11.6
decay 11.6
mail 11.5
post 11.5
age 11.5
old fashioned 11.4
text 11.4
wallet 11
message 11
diary 10.8
sepia 10.7
backgrounds 10.6
decoration 10.2
graphic 10.2
money 10.2
grain 10.2
stamp 9.9
backdrop 9.9
postal 9.8
correspondence 9.8
century 9.8
grime 9.8
surface 9.7
aging 9.6
spot 9.6
write 9.4
floral 9.4
greeting 9.3
currency 9
color 8.9
postage 8.9
broad 8.9
shabby 8.8
ragged 8.8
fracture 8.8
structure 8.7
artistic 8.7
case 8.7
postcard 8.6
yellow 8.6
historical 8.5
cash 8.3
object 8.1
decor 8
mottled 7.8
faded 7.8
burnt 7.8
ornament 7.8
flower 7.7
used 7.7
rusty 7.6
weathered 7.6
communication 7.6
element 7.5
bank 7.2
board 7.1
creative 7.1
leaf 7

Google
created on 2021-03-26

Handwriting 90.5
Signature 89.1
Book 84.6
Font 84.1
Line 81.6
Art 80.1
Illustration 71.8
Paper 70.7
Drawing 70.3
Paper product 69.1
Visual arts 68.4
History 67.8
Collectable 66.8
Vintage clothing 66.4
Room 62.5
Publication 61
Ink 60.5
Fiction 56
Sketch 54.2
Writing 54.2

Microsoft
created on 2021-03-26

text 99.7
handwriting 97.1
drawing 95.6
sketch 92.4
letter 76.3
illustration 58.4

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-42
Gender Male, 98.2%
Angry 61%
Surprised 14.8%
Calm 12.9%
Confused 3.1%
Disgusted 2.5%
Fear 2.3%
Happy 1.8%
Sad 1.5%

Microsoft Cognitive Services

Age 30
Gender Male

Feature analysis

Amazon

Person 97.5%
Book 97.3%
Passport 75.4%

Captions

Microsoft

a close up of text on a white background 60.7%
a close up of text on a black background 56.4%
a close up of text on a white surface 56.2%

Text analysis

Amazon

643
24 643
DmO
24
DP4 Gu
DP4 Gu DmO Boribenfeiiituys beer
feiy
Boribenfeiiituys
beer
Liunttuii
feiy Rep
Rep

Google

P4643
24.643
P4643 24.643