Human Generated Data

Title

Pen Box with a Visit to a Sage
Date

c. 1850-1875
People
Classification

Artists' Tools
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.337

Human Generated Data

Title

Pen Box with a Visit to a Sage

People
Date

c. 1850-1875

Classification

Artists' Tools

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Sport 94.3
Sports 94.3
Blade 86.3
Weapon 86.3
Weaponry 86.3
Skateboard 85.1
Knife 84.9

Clarifai
created on 2018-02-10

medicine 98.9
addiction 97.8
prescription 97.8
no person 96.6
desktop 96.1
medical 94.2
cutout 93.8
science 93.8
one 93.2
closeup 93
symbol 91.8
pill 91.3
still life 90.5
healthcare 89.5
smoke 89
isolated 86.3
color 86.2
metallic 85.8
illness 85.6
drug 85

Imagga
created on 2018-02-10

device 39.3
food 28.4
bangle 22.7
close 20.5
meal 20.3
scabbard 20.2
meat 18.4
fresh 17.7
tasty 17.6
snack 17.1
diet 17
sheath 16.1
object 15.4
delicious 14.9
brown 14.7
breakfast 14.1
cooking 14
bread 13.9
healthy 13.9
cut 13.4
baked 13.1
closeup 12.8
loaf 12.6
knife 12.5
health 11.8
horizontal 11.7
cuisine 11.5
fat 11.2
dinner 10.9
eating 10.9
slice 10.9
nutrition 10.9
eat 10.9
sliced 10.6
wheat 10.5
nobody 10.1
single 9.9
bakery 9.5
natural 9.4
pepper 9.3
color 8.9
ingredient 8.8
crust 8.7
unhealthy 8.6
lunch 8.6
appetizer 8.5
gourmet 8.5
shoehorn 8.4
covering 8.3
freshness 8.3
grain 8.3
wealth 8.1
kitchen 8.1
raw 8
pork 7.7
roll 7.6
one 7.5
taste 7.4
equipment 7.4
chocolate 7.4
cook 7.3
tool 7.1
sweet 7.1

Google
created on 2018-02-10

product design 64.6
skateboarding equipment and supplies 55.3

Face analysis

Amazon

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Surprised 49.5%
Happy 49.5%
Sad 49.5%
Disgusted 50.4%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 14-25
Gender Female, 52.8%
Surprised 45.2%
Happy 45.6%
Disgusted 46.6%
Angry 45.2%
Confused 45.2%
Calm 50.2%
Sad 47%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Disgusted 50.1%
Confused 49.5%
Surprised 49.5%
Calm 49.7%
Angry 49.6%
Happy 49.5%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Female, 51.2%
Happy 45.5%
Surprised 45.9%
Sad 45.4%
Angry 45.5%
Disgusted 46%
Confused 45.2%
Calm 51.5%

AWS Rekognition

Age 15-25
Gender Female, 50%
Disgusted 50.4%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Calm 49.6%
Surprised 49.5%
Sad 49.5%

Captions

Microsoft

a close up of a knife 68%
close up of a knife 63.9%
a knife with a black background 54.2%