Human Generated Data

Title

Eleven-Headed Guanyin
Date

dated to 985
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Grenville L. Winthrop, 1943.57.14

Human Generated Data

Title

Eleven-Headed Guanyin

People
Date

dated to 985

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 94.8
Human 94.8
Person 94
Person 90.1
Art 88.5
Person 86.9
Architecture 86.9
Building 86.9
Worship 78
Person 77.4
Temple 76
Person 76
Painting 74.1
Person 71.8
Shrine 68.4
Archaeology 60.6
Person 46.5

Clarifai
created on 2018-02-10

art 98.7
painting 98
religion 97.6
ancient 94.3
illustration 94.2
old 93.7
decoration 92.5
culture 91
people 90.6
symbol 90.2
mosaic 88.7
antique 88.5
crown 87.4
church 87.2
pattern 86.9
design 86.2
temple 85.5
no person 84.3
ornate 84.2
god 83.8

Imagga
created on 2018-02-10

mosaic 47.4
rug 41.2
vintage 39.8
stamp 38.8
art 37.6
mail 34.5
postmark 32.6
old 31.4
retro 31.2
furnishing 30.9
letter 30.3
postage 28.5
tile 26.4
ancient 26
postal 25.6
covering 24.3
post 23.9
transducer 22.5
envelope 21.7
antique 19.8
paper 18.8
printed 18.7
culture 18
philately 17.8
shows 17.8
aged 17.2
religion 17.1
texture 16.7
puzzle 16.7
pattern 15.1
symbol 14.8
stamps 14.8
design 14.8
global 14.6
grunge 14.5
history 14.3
circa 13.8
icon 13.5
decoration 13.4
church 13
painted 12.4
unique 12.4
card 12.1
close 12
currency 11.7
museum 11.7
money 11.1
finance 11
game 11
message 11
canceled 10.9
masterpiece 10.9
map 10.8
device 10.8
collection 10.8
painter 10.8
cutting 10.6
communications 10.6
one 10.5
traditional 10
renaissance 9.8
delivery 9.7
parchment 9.6
god 9.6
dollar 9.3
frame 9.2
cash 9.2
paint 9.1
border 9.1
bank 9
post mail 8.9
philatelic 8.9
zigzag 8.9
office 8.9
obsolete 8.6
historic 8.3
financial 8
fame 7.9
known 7.9
colorful 7.9
creation 7.9
paintings 7.8
artistic 7.8
letters 7.8
fine 7.6
communication 7.6
black 7.2
architecture 7

Google
created on 2018-02-10

art 88.5
tapestry 87
history 81.9
ancient history 78.8
miniature 64.7
middle ages 61.2
religion 60.8
archaeological site 60.2
pattern 51.1
costume design 50.1

Microsoft
created on 2018-02-10

indoor 95.5
various 64.4
decorated 62.7
items 57.4
painting 52.9
fabric 19.7
several 16.1
altar 14.3

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Calm 54.7%
Angry 45.1%
Confused 45%
Surprised 45%
Sad 45.1%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 15-25
Gender Male, 50.2%
Calm 50.3%
Angry 49.5%
Confused 49.5%
Surprised 49.5%
Sad 49.6%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Calm 49.9%
Happy 49.6%
Disgusted 49.6%
Confused 49.5%
Angry 49.6%
Sad 49.7%
Surprised 49.6%

AWS Rekognition

Age 29-45
Gender Male, 72.2%
Confused 4.6%
Angry 7.5%
Sad 5.2%
Calm 57.6%
Disgusted 16.4%
Surprised 6.6%
Happy 2.1%

AWS Rekognition

Age 35-55
Gender Female, 50%
Happy 49.5%
Disgusted 49.6%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.6%
Happy 49.5%
Confused 49.5%
Surprised 49.6%
Sad 49.5%
Calm 50.2%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Disgusted 49.5%
Angry 49.6%
Sad 49.9%
Happy 49.5%
Calm 49.6%
Surprised 49.5%
Confused 49.8%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.7%
Happy 49.6%
Disgusted 49.7%
Confused 49.6%
Angry 49.5%
Sad 49.8%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.6%
Calm 49.5%
Angry 49.6%
Disgusted 50.1%
Surprised 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Disgusted 49.5%
Sad 49.7%
Happy 49.5%
Calm 49.8%
Angry 49.6%
Surprised 49.6%
Confused 49.7%

AWS Rekognition

Age 15-25
Gender Female, 56.1%
Disgusted 7.6%
Sad 4.7%
Happy 26.3%
Angry 8.6%
Surprised 7.7%
Confused 9.7%
Calm 35.4%

Feature analysis

Amazon

Person 94.8%
Painting 74.1%

Captions

Microsoft

a painting on the wall 77.5%
a painting on a wall 76.7%
a painting hanging on a wall 76.6%

Text analysis

Amazon

4
n
8AA
duass
4141340
aSLn's taasl 4141340 K A HLSE Atastiy pa 4
AAUR
1912
aSLn's taasl
K A HLSE
dhIi>
XAHLlur
Eeli
Atastiy pa
2 7 A106
eaa
A
rre
Kietr
s
aRe