Human Generated Data

Title

Sherd

Date

People
Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.162

Human Generated Data

Title

Sherd

People
Date

Classification

Fragments

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Soil 97.8
Ornament 96.4
Accessory 95.7
Accessories 95.7
Gemstone 93.4
Jewelry 93.4
Food 88
Bread 88
Fossil 77.2
Agate 73.2
Archaeology 65.4

Clarifai
created on 2019-07-08

no person 97.3
desktop 94.9
paper 93.8
food 93.5
old 93.2
one 92.6
texture 90.6
wear 90.5
vintage 90.1
retro 89.7
art 87.3
cutout 86.8
color 85.2
pattern 83.7
closeup 82.8
design 82.2
traditional 81.1
stranded 80.7
container 79.8
snap 77.4

Imagga
created on 2019-07-08

container 88.2
wallet 64.2
purse 60.8
bag 58.9
case 49.8
brown 23.6
box 20.5
paper 19.7
food 17.6
bread 15.7
note 15.6
old 15.3
vintage 14.9
money 14.5
currency 14.4
snack 13.7
object 13.2
pencil box 13.1
texture 12.5
card 11.9
cash 11.9
finance 11.8
delicious 11.6
book 11.2
tasty 10.9
close 10.8
closeup 10.8
breakfast 10.6
pastry 10.5
fresh 10.5
blank 10.3
open 9.9
retro 9.8
meal 9.7
dessert 9.7
worn 9.5
leather 9.5
sweet 9.5
grunge 9.4
page 9.3
nutrition 9.2
eat 9.2
decoration 9
diet 8.9
wooden 8.8
banknote 8.7
gift 8.6
bakery 8.6
dollar 8.4
slice 8.2
fastener 8.2
style 8.2
design 8.2
business 7.9
objects 7.8
ancient 7.8
loaf 7.8
empty 7.7
pay 7.7
health 7.6
gourmet 7.6
plate 7.6
pattern 7.5
dark 7.5
baked 7.5
sugar 7.5
fat 7.5
toast 7.4
slide fastener 7.3
yellow 7.3
aged 7.2
wealth 7.2
cut 7.2
bank 7.2
financial 7.1

Google
created on 2019-07-08

Rock 54.2
Artifact 50.1

Microsoft
created on 2019-07-08

piece 99
slice 97
half 69
eaten 20.5
sliced 20
square 17.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 99.9%
Angry 3.6%
Sad 81.3%
Confused 3.7%
Happy 2.6%
Calm 3.4%
Surprised 2.3%
Disgusted 3.2%

Feature analysis

Amazon

Bread 88%

Captions

Microsoft

a piece of cake with a slice cut out 59.2%
a piece of cake 59.1%
a piece of cake on a plate 54.1%