Human Generated Data

Title

Snuff box with lovers discovered

Date

mid-19th century

People

-

Classification

Boxes

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Saeed Kouros in honor of Kazem R. Kooros, 2018.8

Human Generated Data

Title

Snuff box with lovers discovered

Date

mid-19th century

Classification

Boxes

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Saeed Kouros in honor of Kazem R. Kooros, 2018.8

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 93.5
Person 93.5
Art 92.5
Painting 92.5
Accessory 64.9
Accessories 64.9
Pottery 61.6
Wallet 59.5

Clarifai
created on 2018-02-16

art 98.6
illustration 97.7
design 95.2
retro 95
symbol 94.7
decoration 93.5
painting 92.8
desktop 91.1
vintage 89.7
no person 89.7
antique 89.3
pattern 88.3
gold 88
old 87.4
shape 87.1
one 87
sign 86.8
traditional 86.1
ancient 85.9
image 85.5

Imagga
created on 2018-02-16

container 62
chest 54.2
box 45.8
old 32
ancient 29.4
vintage 26.5
art 25.5
religion 25.1
decoration 23.3
wallet 21.4
gold 21.4
pattern 21.2
antique 20.3
style 20
architecture 19.5
design 19.2
majolica 18.6
culture 17.9
earthenware 17.7
texture 17.4
retro 17.2
golden 17.2
tray 16.9
case 16.3
paper 15.7
symbol 15.5
religious 15
stamp 14.7
historic 14.7
bag 14.4
postage 13.8
letter 13.8
ornate 13.7
receptacle 13.7
detail 13.7
travel 13.4
church 12.9
decorative 12.5
history 12.5
mail 12.4
god 12.4
decor 12.4
temple 12.3
wall 12
postmark 11.8
object 11.7
color 11.7
faith 11.5
grunge 11.1
money 11.1
postal 10.8
holy 10.6
post 10.5
east 10.3
mosaic 10.2
colorful 10
frame 10
rug 9.9
interior 9.7
prayer 9.7
black 9.6
ornament 9.5
oriental 9.4
finance 9.3
traditional 9.1
tourism 9.1
utensil 9
material 9
icon 8.7
sculpture 8.7
spiritual 8.6
craft 8.6
historical 8.5
elegance 8.4
fashion 8.3
aged 8.1
brown 8.1
close 8
fabric 7.9
bible 7.8
sacred 7.8
grand 7.8
palace 7.7
door 7.6
textile 7.6
wood 7.5
business 7.3
border 7.2
office 7.2
collection 7.2
wealth 7.2
currency 7.2

Google
created on 2018-02-16

antique 52.6
art 52.2

Microsoft
created on 2018-02-16

indoor 87.4
container 52.2
colorful 38.2
box 37
painting 19

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Male, 93.2%
Surprised 3.4%
Happy 1.6%
Sad 2.7%
Calm 82.8%
Disgusted 2.3%
Angry 2.4%
Confused 4.9%

AWS Rekognition

Age 35-55
Gender Male, 90.4%
Confused 3.3%
Angry 3.9%
Sad 4.5%
Calm 82.3%
Happy 1.5%
Disgusted 1.1%
Surprised 3.3%

AWS Rekognition

Age 14-25
Gender Female, 83.1%
Calm 20.4%
Sad 35.1%
Surprised 9.8%
Happy 11.4%
Confused 5.8%
Angry 6.7%
Disgusted 10.8%

AWS Rekognition

Age 38-57
Gender Male, 89.8%
Calm 19.9%
Surprised 1.8%
Sad 65.5%
Angry 3.4%
Disgusted 1.9%
Confused 5.4%
Happy 2.2%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.5%
Painting 92.5%

Categories

Captions

Microsoft
created on 2018-02-16

a painting of a box 65.2%
a painting in a box 60.5%
a painting on the wall 60.4%