Human Generated Data

Title

Untitled (sketches of facial expressions, two-page spread)

Date

1943

People

Artist: Otto Piene, German 1928 - 2014

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.2.22

Copyright

© Otto Piene Estate

Human Generated Data

Title

Untitled (sketches of facial expressions, two-page spread)

People

Artist: Otto Piene, German 1928 - 2014

Date

1943

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.2.22

Copyright

© Otto Piene Estate

Machine Generated Data

Tags

Amazon
created on 2021-03-26

Drawing 99.3
Art 99.3
Human 99.3
Sketch 98.5
Passport 93.6
Document 93.6
Id Cards 93.6
Text 93.6
Bird 70.3
Animal 70.3
Person 63
Doodle 55.4

Clarifai
created on 2021-03-26

paper 98.5
chalk out 97.7
art 96.2
wear 96.2
retro 95.6
blank 95
painting 94.6
empty 94.5
old 93.9
desktop 93.6
vintage 92.1
people 91.8
illustration 89.8
ancient 88.8
man 87.7
texture 86.9
dirty 86.4
sepia pigment 85.6
portrait 85.5
design 84.9

Imagga
created on 2021-03-26

grunge 54.6
envelope 51.1
vintage 50.5
old 49.5
paper 47.9
antique 40.7
retro 40.2
aged 38
ancient 37.2
texture 36.9
container 36.8
graffito 34.9
blank 28.3
dirty 28
decoration 27.8
empty 25.8
document 24.2
material 23.2
parchment 23.1
design 22.7
book 22.5
page 22.3
art 22.1
brown 22.1
damaged 22
pattern 21.9
drawing 21.7
wallpaper 21.5
sketch 21.5
grungy 20.9
frame 20.8
border 19.9
letter 19.3
stained 19.2
worn 19.1
decorative 18.4
rough 18.2
manuscript 16.6
handkerchief 16.6
bath towel 16.5
canvas 15.2
sheet 15.1
stains 14.6
crumpled 14.6
decay 14.5
floral 14.5
towel 14.4
fabric 14.3
card 14.3
piece of cloth 13.6
stain 13.5
representation 13.4
bath linen 13.2
textured 13.2
artistic 13
note 12.9
faded 12.7
stamp 12.6
scrapbook 12.6
torn 12.6
cardboard 12.5
age 12.4
text 12.2
wall 11.9
historic 11.9
shabby 11.8
ragged 11.7
graphic 11.7
history 11.6
flower 11.5
mail 11.5
post 11.5
space 10.9
postal 10.8
linen 10.8
open 10.8
burnt 10.7
old fashioned 10.5
weathered 10.5
grain 10.2
color 10
pages 9.8
grime 9.8
mottled 9.8
creative 9.7
style 9.7
write 9.4
notebook 9.3
cover 9.3
structure 9.2
message 9.1
backdrop 9.1
paint 9.1
backgrounds 8.9
surface 8.8
correspondence 8.8
stationery 8.8
fracture 8.8
spot 8.6
ornament 8.6
yellow 8.6
leaf 8.6
symbol 8.1
broad 7.9
memory 7.7
aging 7.7
money 7.7
textures 7.6
board 7.5
artwork 7.3
currency 7.2

Google
created on 2021-03-26

Nose 98.4
Chin 96.6
Hairstyle 95.1
Eyebrow 94.4
Gesture 85.3
Whiteboard 81.9
Font 81.9
Art 76.5
Drawing 71.6
Line art 70
Visual arts 69.7
Paper 68.5
Illustration 68.1
Artwork 62.2
Sketch 60.6
Paper product 52.3
Rectangle 51.9

Microsoft
created on 2021-03-26

text 99.8
drawing 99.2
sketch 98.4
child art 95.2
whiteboard 93.7
handwriting 93.5
illustration 76.4
cartoon 70.8
human face 68.4

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 9-19
Gender Male, 98.4%
Confused 66.2%
Calm 11.8%
Fear 10.4%
Surprised 4.7%
Sad 3.5%
Happy 2%
Disgusted 1%
Angry 0.4%

AWS Rekognition

Age 22-34
Gender Male, 98.2%
Sad 62.1%
Calm 36.1%
Angry 1.1%
Confused 0.4%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-33
Gender Male, 98.3%
Calm 82.3%
Happy 7.3%
Sad 6.1%
Confused 2.9%
Surprised 0.6%
Angry 0.6%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 8-18
Gender Male, 90.8%
Happy 95.9%
Calm 2%
Confused 0.7%
Surprised 0.4%
Sad 0.3%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 8-18
Gender Male, 85.9%
Happy 90.1%
Calm 4.3%
Confused 2.3%
Surprised 1%
Sad 0.9%
Angry 0.6%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 38-56
Gender Male, 76.4%
Fear 98.1%
Surprised 1.5%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Calm 0%
Disgusted 0%

Microsoft Cognitive Services

Age 56
Gender Male

Feature analysis

Amazon

Passport 93.6%
Bird 70.3%
Person 63%

Categories

Imagga

paintings art 88%
text visuals 10.9%

Captions

Text analysis

Amazon

p
Le
p f93
f93
ntimven
ntimven Eis Le
Labein
Imrlmy
Eis