Human Generated Data

Title

Pen Box with European Women and Other Figures in Landscape
Date

c. 1850-1875
People
Classification

Artists' Tools
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.334

Human Generated Data

Title

Pen Box with European Women and Other Figures in Landscape

People
Date

c. 1850-1875

Classification

Artists' Tools

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 87
Person 72.5
Person 68.9
Hair Slide 66.6
Person 62.9
Person 62.2
Graphics 58.7
Pattern 58.7
Floral Design 58.7
Art 58.7
Pencil Box 57.2
Diamond 55.9
Jewelry 55.9
Accessories 55.9
Accessory 55.9
Gemstone 55.9
Person 42.1

Clarifai
created on 2018-02-10

no person 96.7
desktop 96.1
medicine 95
sausage 93.2
food 92.8
closeup 92.6
color 92.5
pill 92.2
isolated 92
illustration 90.5
addiction 89.3
cutout 89.2
science 88.7
unhealthy 88.6
symbol 88.4
sign 88.3
design 87.9
abstract 87.1
still life 86.7
disjunct 86.2

Imagga
created on 2018-02-10

bangle 30.3
food 19.6
bread 19.4
fastener 18
close 17.1
wheat 16.4
brown 15.5
object 15.4
tool 15.2
knife 14.6
healthy 14.5
tasty 14.2
clip 14.2
diet 13.7
breakfast 13.3
nobody 13.2
delicious 13.2
single 13.2
meal 13
restraint 12.6
device 12.5
closeup 12.1
fresh 11.8
loaf 11.6
snack 11.1
grain 11.1
yellow 10.6
antique 10.3
metal 9.7
baked 9.4
nutrition 9.2
horizontal 9.2
damask 9.2
gold 9
color 8.9
objects 8.7
equipment 8.6
pastry 8.5
product 8.4
candy 8.4
health 8.3
cut 8.1
meat 8
comb 7.9
flour 7.8
crust 7.7
old 7.7
dinner 7.6
seed 7.5
slice 7.3
dessert 7.1

Google
created on 2018-02-10

product design 62.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Surprised 45.1%
Sad 48.5%
Angry 45.5%
Calm 46.6%
Confused 45.2%
Disgusted 45.9%
Happy 48.1%

AWS Rekognition

Age 15-25
Gender Female, 88.9%
Sad 4.5%
Calm 91%
Disgusted 0.4%
Surprised 0.9%
Angry 0.7%
Happy 0.3%
Confused 2.2%

AWS Rekognition

Age 26-43
Gender Female, 98.1%
Surprised 1.3%
Happy 7.8%
Sad 17.4%
Disgusted 64.6%
Confused 1.4%
Calm 4.8%
Angry 2.7%

AWS Rekognition

Age 15-25
Gender Female, 52.5%
Happy 45.6%
Sad 52.4%
Calm 45.8%
Confused 45.5%
Disgusted 45.3%
Surprised 45.1%
Angry 45.3%

AWS Rekognition

Age 14-25
Gender Female, 54.4%
Disgusted 48.6%
Confused 45.3%
Surprised 45.2%
Calm 47.1%
Angry 45.4%
Happy 45.6%
Sad 47.9%

AWS Rekognition

Age 16-27
Gender Female, 54.9%
Happy 45.4%
Surprised 45.3%
Sad 46.5%
Angry 45.5%
Disgusted 46.2%
Confused 45.2%
Calm 50.9%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Happy 45.7%
Disgusted 48.4%
Angry 46%
Confused 45.4%
Calm 46.3%
Surprised 45.5%
Sad 47.7%

AWS Rekognition

Age 10-15
Gender Female, 50.4%
Surprised 49.5%
Calm 50.1%
Sad 49.7%
Confused 49.5%
Angry 49.6%
Happy 49.5%
Disgusted 49.6%

AWS Rekognition

Age 15-25
Gender Female, 51.4%
Surprised 45.1%
Confused 45.1%
Calm 53%
Happy 46%
Disgusted 45.1%
Angry 45.1%
Sad 45.6%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 72.5%

Captions

Microsoft

a close up of a knife 59.7%
a yellow and knife next to it 47.7%
a yellow and knife 47.6%