Human Generated Data

Title

PLATE

Date

People
Classification

Vessels

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from the Department of the Classics, Harvard University, Bequest of Henry W. Haynes, 1912, 1977.216.2870

Human Generated Data

Title

PLATE

People
Date

Classification

Vessels

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Food 100
Bread 100
Cracker 76.8
Dish 72.3
Meal 72.3
Confectionery 64.1
Sweets 64.1
Dessert 57.5
Cookie 57.2
Biscuit 57.2

Imagga
created on 2022-01-29

bread 86
food 64.4
toast 62.7
wheat 53.4
breakfast 43.6
loaf 42.8
baked 40.4
brown 39.8
bakery 38.7
tasty 34.3
snack 34.2
loaf of bread 33.9
bun 33.4
meal 32.6
pastry 30.3
eating 30.3
delicious 29.8
crust 29.1
healthy 28.4
grain 27
fresh 26.2
nutrition 25.2
gourmet 24.6
sweet 24.5
flour 24.4
diet 22.8
dinner 22.8
bake 22.2
close 21.1
cereal 20.7
lunch 20.6
organic 20.2
whole 20.1
baked goods 19.9
edible fruit 19.8
seed 19.6
dessert 18.6
eat 17.6
fruit 17.5
slice 17.3
rye 16.6
baking 15.5
homemade 15.4
studio 15.2
yam 15
produce 15
natural 14.7
refreshment 14.2
traditional 14.2
cake 14.1
fat 14
yeast 13.8
baguette 13.8
kitchen 13.4
freshness 13.3
nutritious 13.3
dough 13
carbohydrates 12.8
cookie 12.7
sliced 12.5
baker 11.8
vegetable 11.5
group 11.3
golden 11.2
sandwich 10.8
closeup 10.8
cut 10.8
root vegetable 10.5
chocolate 10.3
nobody 10.1
cook 10.1
horizontal 10.1
rolls 9.8
cooking 9.6
objects 9.6
object 9.5
product 9.4
yellow 9.3
texture 9
health 9
corn 9
crusty 8.9
poppy 8.9
sesame 8.8
ingredient 8.8
agriculture 8.8
roll 8.5
nut 7.9
biscuit 7.8
pie 7.8
plate 7.6
treat 7.6
single 7.4
warm 7.4
sugar 7.1
butter 7.1

Google
created on 2022-01-29

Table 94.7
Food 94.1
Tire 85.7
Tree 85
Baked goods 83.2
Cuisine 82.3
Fast food 81.6
Dish 81.5
Wood stain 80.6
Wood 80.5
Plant 79.8
Ingredient 77.2
Circle 68.3
Plywood 63.3
Rock 59.1
Dishware 59.1
Vegetable 58.1
Peach 57.3
Font 56.5
Baking 56.5

Microsoft
created on 2022-01-29

baked goods 90.1
bread 82.6
food 68.4

Feature analysis

Amazon

Bread 100%

Captions

Microsoft

a piece of food 55%
a close up of food 54.9%
a cut in half on a plate 49.9%