Human Generated Data

Title

Piece of worked marble
Date
People
Classification

Fragments
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. William L. Payson, 1986.609.195

Human Generated Data

Title

Piece of worked marble

People
Date

Classification

Fragments

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Bread 100
Food 100
Rock 98.9
Confectionery 95.9
Sweets 95.9
Limestone 58.4
Mineral 55.6

Clarifai
created on 2019-07-07

no person 99.6
food 97
cookie 93.2
bread 93.1
breakfast 91.6
stranded 90.4
sweet 89.2
delicious 89.1
flour 88.9
wheat 88.8
refreshment 86.7
pastry 86.2
sugar 85.6
isolated 83.3
one 81.8
little 81.4
desktop 81.1
chocolate 80.7
simplicity 79.6
bakery 79.3

Imagga
created on 2019-07-07

bread 60.1
food 55.9
vanilla 52.9
toast 45.5
snack 37.7
brown 37.6
meal 37.4
breakfast 37.2
loaf 37
baked 35.7
wheat 35.5
tasty 33.5
bakery 33.5
slice 29.2
crust 28.1
fresh 27.5
delicious 27.3
eating 27
pastry 26.2
confectionery 25.3
healthy 25.3
close 25.2
gourmet 24.7
dinner 23.6
nutrition 23.5
diet 23.5
grain 21.3
bake 21.3
lunch 20.6
sweet 20.6
dessert 20.6
studio 19.8
sliced 19.3
cut 18.9
seed 18.8
nobody 17.1
object 16.9
organic 16.8
eat 16.8
carbohydrates 16.8
baker 16.7
cereal 15.6
flour 15.6
bun 15.6
closeup 15.5
whole 15.3
traditional 15
crusty 14.8
baking 14.6
sandwich 14.5
piece 14.2
fat 14
butter 13.8
rye 13.7
homemade 13.5
cake 13.2
kitchen 12.6
dough 12.5
appetizing 11.6
cheese 11.4
roll 11.4
objects 11.3
chip 11.2
single 10.7
cuisine 10.7
plug 10.6
meat 10
freshness 10
cooking 9.6
natural 9.4
stack 9.3
horizontal 9.2
sugar 9
chocolate 8.9
yeast 8.9
baguette 8.9
detail 8.9
crisp 8.8
golden 8.6
nutritious 8.6
fiber 8.4
health 8.4
cutout 8.3
morning 8.2
ingredient 7.9
biscuit 7.8
slices 7.8
unhealthy 7.7
one 7.5
refreshment 7.5
cook 7.3
candy 7.3
color 7.2

Google
created on 2019-07-07

Rock 77.9
Food 63.5
Cuisine 62.4
Dish 58.8

Microsoft
created on 2019-07-07

piece 83.7
food 77.3
bread 73.6
baked goods 73.3
pastry 59.7
half 59.5
dessert 43.7
eaten 35.3

Feature analysis

Amazon

Bread 100%

Captions

Microsoft

a half eaten doughnut 59.4%
a half eaten donut 59.3%
a half eaten donut next to it 49.6%