Human Generated Data

Title

Fragment of small base
Date
People
Classification

Fragments
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. William L. Payson, 1986.609.115

Human Generated Data

Title

Fragment of small base

People
Date

Classification

Fragments

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Bread 99.9
Food 99.9
Confectionery 94.3
Sweets 94.3
Dessert 66.2
Plant 64.4

Clarifai
created on 2019-07-07

no person 99.4
food 98.6
breakfast 96.2
delicious 95.8
round out 95.7
desktop 92.3
baking 91.5
nut 91.4
bread 91.3
sweet 90.4
refreshment 88.9
chocolate 88.6
hard 88.4
isolated 87.7
dark 87
nutrition 86.6
stranded 86
simplicity 85.5
broken 85.3
disjunct 85.1

Imagga
created on 2019-07-07

seed 53.4
food 51.2
buckeye 46.5
brown 42.7
toast 41.6
fruit 41.5
bread 40.4
snack 39.3
baked 35.7
pastry 35.1
bakery 32.7
dessert 32.7
sweet 32.4
muffin 30.8
breakfast 30.3
gourmet 28.9
tasty 27.6
delicious 26.5
meal 26.1
chocolate 26.1
candy 25.9
close 25.7
loaf 25.3
sugar 25
eating 24.4
cake 23.5
healthy 22.7
eat 21.8
nut 21.5
cookie 19.5
crust 19.4
natural 18.8
baking 18.4
homemade 18.3
fresh 17
closeup 16.9
nutrition 16.8
bake 16.4
wheat 16.3
chestnut 15.8
slice 15.5
quick bread 15.2
organic 15.1
edible nut 14.9
biscuit 14.7
lunch 14.6
diet 14.6
group 14.5
whole 14.4
heap 14.1
spice 13.4
fat 13.1
grain 12.9
rye 12.7
cookies 12.7
flour 12.7
chip 12
health 11.8
confectionery 11.7
refreshment 11.6
treat 11.4
stack 11.1
nobody 10.9
cereal 10.6
object 10.3
ingredient 10.2
acorn 10.1
dinner 10.1
baker 9.8
fattening 9.8
plate 9.8
junk 9.7
baked goods 9.4
cut 9
color 8.9
crusty 8.9
objects 8.7
sliced 8.7
yellow 8.6
hazelnut 8.6
nutritious 8.6
studio 8.4
chocolate sauce 8
biscuits 7.9
carbohydrates 7.9
cupcake 7.9
chips 7.8
dough 7.8
round 7.8
coffee 7.8
seeds 7.7
flavor 7.6
piece 7.6
horizontal 7.5
dark 7.5
cook 7.3
gray 7.2
spa 7.2
kitchen 7.2
circle 7.1
sauce 7

Google
created on 2019-07-07

Food 75.8
Dish 68.4
Cuisine 62.8
Rock 54.2

Microsoft
created on 2019-07-07

dessert 97.6
baked goods 97.6
food 89.4
doughnut 86.7
slice 52.2
macaroon 51.7
gluten 51.5
bread 25.3

Feature analysis

Amazon

Bread 99.9%

Captions

Microsoft

a piece of food 80.1%
a piece of cake on a plate 43.2%
a close up of a doughnut on a plate 43.1%