Human Generated Data

Title

Pen Box with Holy Family and Female Portrait Medallions
Date

1848-1849
People

Artist: Najaf `Ali,

Classification

Artists' Tools
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.319

Human Generated Data

Title

Pen Box with Holy Family and Female Portrait Medallions

People

Artist: Najaf `Ali,

Date

1848-1849

Classification

Artists' Tools

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Reptile 90.4
Animal 90.4
Snake 90.4
Cutlery 80.6
Strap 78
Spoon 69.6
Blade 67.4
Weaponry 67.4
Weapon 67.4
Knife 66.2
Bronze 62.9
Machine 60.8
Clothing 59.5
Apparel 59.5
Gemstone 58.4
Accessories 58.4
Jewelry 58.4
Diamond 58.4
Accessory 58.4
Art 55.1

Clarifai
created on 2018-02-10

medicine 98.9
prescription 97.9
art 97.2
medical 97
texture 93.8
illustration 92.6
retro 92.5
desktop 91.9
addiction 91.2
healthcare 90.9
no person 90.8
symbol 90.2
science 89.3
closeup 85.8
scribble 85.7
pill 83.9
sausage 83.1
sketch 83.1
one 81.2
herb 80.9

Imagga
created on 2018-02-10

knife 65.2
cutter 31.9
object 19
antique 18.9
food 15.6
close 14.3
bread 13.9
cigarette 13.6
antiquity 13.3
stick 13.2
single 13.1
brown 12.5
diet 12.1
nobody 11.7
delicious 11.6
healthy 10.7
gold 10.7
yellow 10.6
meal 10.5
tasty 10
tobacco 9.8
smoking 9.8
metal 9.7
unhealthy 9.6
wheat 9.5
closeup 9.4
product 9.4
tool 9.3
fresh 9.1
breakfast 8.8
horizontal 8.4
smoke 8.4
health 8.3
device 8.1
habit 7.9
loaf 7.8
addiction 7.7
snack 7.7
old 7.7
nutrition 7.5
baked 7.5
traditional 7.5
paper 7.1

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-38
Gender Male, 91.3%
Surprised 3.3%
Happy 1.2%
Sad 28.6%
Calm 21.5%
Disgusted 26.5%
Angry 6.3%
Confused 12.5%

AWS Rekognition

Age 15-25
Gender Female, 87.6%
Happy 0.7%
Disgusted 1.2%
Angry 1.3%
Calm 87.7%
Surprised 0.8%
Sad 7%
Confused 1.3%

AWS Rekognition

Age 9-14
Gender Female, 51.6%
Happy 45.6%
Sad 48.6%
Disgusted 47.4%
Surprised 45.7%
Calm 45.6%
Confused 46.1%
Angry 45.8%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Calm 50.2%
Sad 49.7%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%

Microsoft Cognitive Services

Age 24
Gender Female

Feature analysis

Amazon

Snake 90.4%

Captions

Microsoft

a close up of a yellow wall 57%
a close up of a bed 34.8%
a person sitting on a bed 7.6%

Text analysis

Amazon

r