Human Generated Data

Title

Pen Box with Figures in Indoor and Outdoor Settings, and Medallions
Date

1903-1904
People

Artist: Mubarraz al-Shu'ara,

Classification

Artists' Tools
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Lily and Hamid Kooros, 2017.305

Human Generated Data

Title

Pen Box with Figures in Indoor and Outdoor Settings, and Medallions

People

Artist: Mubarraz al-Shu'ara,

Date

1903-1904

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Lily and Hamid Kooros, 2017.305

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Weaponry 95.4
Weapon 95.4
Blade 94
Human 91.8
Person 91.8
Knife 90.5
Cutlery 89.9
Person 88.5
Letter Opener 77.9
Spoon 77.6
Person 70.3
Strap 57
Person 46.7
Person 43.7

Clarifai
created on 2018-02-16

art 97.5
illustration 97.2
texture 95.5
no person 95.3
retro 94.4
desktop 93.3
sausage 89.3
sign 88.4
design 87.9
pattern 86.7
cutout 85.9
one 84.9
color 84.4
vector 84.1
vintage 83.6
scribble 83.4
symbol 82.7
graphic 82.7
abstract 82.2
science 81

Imagga
created on 2018-02-16

scabbard 34.3
clip 28.8
fastener 27.6
sheath 27.5
bangle 26.3
knife 19.3
device 18.9
restraint 18.9
food 17.9
object 17.6
close 16.5
shiny 14.2
gold 14
covering 13.5
wealth 13.5
fresh 13.1
diet 12.9
meat 12.9
fashion 12.8
jewel 12.6
antique 12.5
dagger 12.4
single 12.3
meal 12.2
luxury 12
brown 11.8
metal 11.3
gem 11.3
golden 11.2
snack 11.1
healthy 10.7
cooking 10.5
nutrition 10.1
tool 10.1
tasty 10
delicious 9.9
antiquity 9.8
precious 9.7
blade 9.6
black 9.6
jewelry 9.6
closeup 9.4
baked 9.4
dinner 9.3
elegance 9.2
eat 9.2
cuisine 8.9
diamond 8.7
decoration 8.7
ring 8.7
health 8.3
pepper 8.3
one 8.2
weapon 8.2
cut 8.1
raw 8
market 8
yellow 7.9
nobody 7.8
sliced 7.7
money 7.7
accessory 7.6
plate 7.6
fat 7.5
bright 7.1
silver 7.1
breakfast 7.1

Google
created on 2018-02-16

product design 60.6

Microsoft
created on 2018-02-16

weapon 45.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Female, 50.5%
Angry 49.5%
Disgusted 49.5%
Sad 49.5%
Happy 49.5%
Calm 50.4%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 30-47
Gender Male, 51%
Angry 45.2%
Disgusted 45.2%
Sad 48.3%
Happy 45.7%
Calm 50.3%
Surprised 45.2%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Angry 49.6%
Happy 49.6%
Calm 50%
Surprised 49.5%
Sad 49.5%
Disgusted 49.8%
Confused 49.5%

AWS Rekognition

Age 17-27
Gender Female, 52.8%
Calm 48.2%
Surprised 45.3%
Disgusted 49.5%
Angry 45.4%
Sad 45.9%
Confused 45.2%
Happy 45.6%

AWS Rekognition

Age 14-25
Gender Female, 54.4%
Calm 50.6%
Surprised 45.6%
Disgusted 47.3%
Angry 45.4%
Sad 45.2%
Confused 45.1%
Happy 45.6%

AWS Rekognition

Age 10-15
Gender Female, 50.2%
Surprised 49.5%
Happy 49.6%
Sad 49.8%
Calm 49.9%
Disgusted 49.6%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Happy 50.2%
Sad 49.6%
Surprised 49.5%
Confused 49.5%
Calm 49.6%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Happy 49.3%
Sad 46%
Surprised 45.6%
Confused 45.4%
Calm 46.8%
Angry 45.5%
Disgusted 46.4%

AWS Rekognition

Age 23-38
Gender Male, 50.3%
Confused 49.6%
Calm 49.8%
Surprised 49.6%
Sad 49.7%
Happy 49.6%
Disgusted 49.6%
Angry 49.7%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Angry 49.5%
Happy 49.6%
Disgusted 49.6%
Confused 49.5%
Sad 49.8%
Calm 50%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.6%
Happy 49.5%
Disgusted 50.1%
Confused 49.5%
Sad 49.6%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Confused 49.5%
Angry 49.6%
Sad 49.7%
Calm 49.5%
Happy 49.6%
Disgusted 50%
Surprised 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Happy 49.6%
Calm 50.2%
Angry 49.5%
Disgusted 49.5%
Sad 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50%
Surprised 49.6%
Happy 49.9%
Sad 49.5%
Calm 49.7%
Disgusted 49.6%
Angry 49.7%
Confused 49.5%

Feature analysis

Amazon

Person 91.8%

Captions

Microsoft
created on 2018-02-16

a close up of a knife 58%
close up of a knife 53.1%
a knife next to it 44.4%

Text analysis

Amazon

XR