Human Generated Data

Title

Pen Box with a Visit to a Sage

Date

1870-1871

People

-

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.336

Human Generated Data

Title

Pen Box with a Visit to a Sage

Date

1870-1871

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.336

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 98.8
Skateboard 98.6
Sports 98.6
Sport 98.6
Person 85.8
Person 76.8
Person 72.3
Photo 64.2
Photography 64.2
People 63.3
Blade 55.6
Weaponry 55.6
Weapon 55.6

Clarifai
created on 2018-02-10

medicine 97.6
no person 96.3
art 95.3
sausage 95
prescription 94.1
desktop 94.1
one 93.2
texture 92.2
color 91.3
medical 91.1
cutout 90.2
still life 90.1
science 89.8
pill 89.8
grow 87.9
closeup 87.8
food 87.3
symbol 87.3
illustration 86.6
dog 84.8

Imagga
created on 2018-02-10

device 27.7
knife 26.1
tool 25.1
object 22
blade 18.6
close 17.7
scabbard 16.7
food 15.8
metal 15.3
sheath 13.6
handle 13.4
single 13.2
weapon 12.8
steel 12.7
equipment 12.5
fresh 12.4
cooking 12.2
fastener 11.9
clip 11.8
health 11.1
brown 11
healthy 10.7
cuisine 10.6
meal 10.5
diet 10.5
sharp 10.5
old 10.4
closeup 10.1
nobody 10.1
one 9.7
baked 9.4
meat 9.1
gold 9
cut 9
color 8.9
silver 8.8
dagger 8.6
restraint 8.6
dinner 8.4
pencil 8.4
horizontal 8.4
bangle 8.3
plastic 8.3
sword 8.2
yellow 8
work 7.9
black 7.8
cigarette 7.8
loaf 7.8
space 7.8
stainless 7.8
cutting 7.7
preparation 7.7
grilled 7.6
plate 7.6
studio 7.6
roll 7.6
nutrition 7.6
tasty 7.5
wood 7.5
metallic 7.4
cook 7.3
danger 7.3
paper 7.1

Google
created on 2018-02-10

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 12-22
Gender Male, 52.8%
Surprised 45%
Happy 45%
Disgusted 54.8%
Confused 45%
Sad 45%
Angry 45%
Calm 45.1%

AWS Rekognition

Age 16-27
Gender Male, 52.4%
Sad 47.2%
Disgusted 45.8%
Angry 46.7%
Calm 45.6%
Surprised 45.7%
Happy 48.5%
Confused 45.4%

AWS Rekognition

Age 15-25
Gender Male, 54.8%
Calm 53%
Sad 45.9%
Surprised 45.2%
Happy 45.2%
Confused 45.2%
Angry 45.3%
Disgusted 45.3%

AWS Rekognition

Age 20-38
Gender Male, 53.6%
Happy 45.3%
Angry 45.5%
Disgusted 45.4%
Sad 45.6%
Surprised 45.4%
Calm 52.6%
Confused 45.1%

AWS Rekognition

Age 10-15
Gender Male, 54%
Confused 45.2%
Sad 45.6%
Disgusted 45.1%
Happy 45.8%
Angry 45.3%
Surprised 45.7%
Calm 52.3%

AWS Rekognition

Age 15-25
Gender Male, 53.7%
Confused 45.3%
Sad 45.4%
Disgusted 51.5%
Happy 45.3%
Surprised 45.4%
Angry 46.6%
Calm 45.4%

AWS Rekognition

Age 35-52
Gender Male, 52.1%
Surprised 45.3%
Angry 45.6%
Happy 45.4%
Sad 52.5%
Disgusted 45.3%
Confused 45.4%
Calm 45.5%

AWS Rekognition

Age 17-27
Gender Male, 50.6%
Disgusted 46.7%
Confused 45.6%
Happy 45.6%
Angry 45.9%
Calm 50.2%
Surprised 45.4%
Sad 45.5%

AWS Rekognition

Age 26-44
Gender Male, 50.1%
Calm 53.1%
Happy 45.2%
Disgusted 45.1%
Surprised 45.3%
Angry 45.2%
Sad 45.9%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Male, 51.2%
Sad 45.4%
Disgusted 50.6%
Angry 45.8%
Calm 46.1%
Surprised 46%
Happy 45.7%
Confused 45.6%

Feature analysis

Amazon

Person 85.8%

Captions

Microsoft
created on 2018-02-10

a close up of a knife 57.6%
a knife next to it 49%
close up of a knife 48.9%