Human Generated Data

Title

Paper God: Kitchen God, the "Arbiter of Fate" ("Si Ming Zhu") and Wife, Seated
Date

early 20th century
People
Classification

Prints
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Carl Schuster, Esq., 1935.37.36

Human Generated Data

Title

Paper God: Kitchen God, the "Arbiter of Fate" ("Si Ming Zhu") and Wife, Seated

People
Date

early 20th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-07-06

Human 91.2
Art 91.1
Advertisement 88.7
Collage 88.7
Person 85.9
Drawing 81.9
Leisure Activities 77.8
Person 77.3
Circus 71.7
Person 71.6
Doodle 70.6
Crowd 70.1
People 66
Tapestry 63.7
Ornament 63.7
Poster 58.7
Modern Art 55.7

Clarifai
created on 2019-07-06

art 98.9
illustration 97.1
painting 95.8
print 90.7
people 90.6
artistic 90
pattern 88.8
culture 88.5
design 88.4
decoration 88.3
religion 87.8
wall 84.9
retro 84
mural 83.7
color 82.3
woman 82.1
creativity 81.5
scribble 80.9
vintage 79.5
texture 77.9

Imagga
created on 2019-07-06

drawing 34.5
cartoon 33.1
art 31.2
design 25.9
graphic 25.6
pattern 23.3
tile 22.9
card 20.7
decoration 17.4
comic book 16.7
retro 16.4
flower 16.2
set 16.1
holiday 15.8
element 15.7
wallpaper 15.3
bird 14.9
symbol 14.8
texture 14.6
floral 14.5
fun 14.2
colorful 13.6
shape 13.4
clip art 13
cute 12.9
color 12.8
vintage 12.4
artistic 12.2
party 12.1
funny 12
sketch 11.8
decorative 11.7
leaf 11.7
decor 11.5
seamless 11.4
game 11.4
celebration 11.2
heart 11.1
paper 11
children 11
fashion 10.6
character 10.4
ornament 10.4
child 10
animal 9.7
club 9.4
happy 9.4
banner 9.2
traditional 9.2
old 9.1
collection 9
draw 9
kid 8.9
doodle 8.9
drawn 8.8
colors 8.8
boy 8.7
postcard 8.6
play 8.6
hand 8.5
black 8.4
pinball machine 8.4
elements 8.4
birthday 8.3
entertainment 8.3
silhouette 8.3
artwork 8.3
playing 8.2
style 8.2
childhood 8.1
icon 7.9
cards 7.8
pyramid 7.8
gift 7.8
mosaic 7.7
grunge 7.7
moon 7.5
amulet 7.5
frame 7.5
greeting 7.4
man 7.4
branch 7.3
hat 7.3
swatch 7.3
motif 7.2
hippie 7.2
love 7.1
fabric 7

Google
created on 2019-07-06

Tapestry 90.8
Art 89.8
Textile 82
History 74
Middle ages 68.8
Miniature 67
Illustration 66.9
Painting 63
Visual arts 62.5
Pattern 56.3

Microsoft
created on 2019-07-06

cartoon 99.5
drawing 98.4
text 95.9
illustration 93.4
painting 92.2
child art 85
sketch 76.8
art 74.7
human face 68.9
person 67.1
poster 57.8
clothing 55.5
comic 53.2
mural 53

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 94.4%
Disgusted 0.9%
Surprised 1.7%
Happy 65%
Sad 2%
Angry 1.2%
Confused 1.2%
Calm 28.1%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 85.9%
Poster 58.7%

Captions

Microsoft

a graffiti covered wall 51.9%
graffiti on a wall 48.2%
a close up of a graffiti covered wall 45.8%

Text analysis

Amazon

oP