Human Generated Data

Title

SHERD

Date

People
Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Miss Bettina J. Kahnweiler, 1935.35.71.O

Human Generated Data

Title

SHERD

People
Date

Classification

Fragments

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Cushion 75.7
Wood 61.5
Box 57.9
Lute 57.6
Musical Instrument 57.6

Imagga
created on 2022-01-22

food 57.1
chocolate 55.1
brown 39
bread 36.2
slice 33.7
loaf 31.1
toast 31
meal 30.8
bakery 30
delicious 29.7
dessert 28.4
tasty 27.6
pastry 26.9
cake 26.3
snack 25.6
baked 24.4
healthy 23.9
diet 23.4
sweet 22.9
piece 22.7
nutrition 22.7
wheat 21
crust 20.3
fresh 20.3
eat 20.1
doormat 19.5
closeup 18.9
cream 18.7
sugar 18.6
breakfast 18.6
candy 17.9
gourmet 17.8
close 17.7
binding 17.7
container 17.5
cut 17
bake 16.4
eating 16
grain 15.7
mat 15.4
dark 15
plate 14.4
rye 13.7
concertina 13.6
organic 13.4
whole 13.4
nobody 13.2
baking 12.6
wallet 11.9
floor cover 11.7
pie 11.6
cereal 11.6
box 11.3
fat 11.2
free-reed instrument 10.9
baker 10.8
sliced 10.6
object 10.3
board 10.1
dinner 10.1
ingredient 9.9
kitchen 9.8
flour 9.8
homemade 9.6
sauce 9.4
wind instrument 9.2
carbohydrates 8.8
portion 8.7
natural 8.7
covering 8.7
product 8.6
case 8.6
lunch 8.6
traditional 8.3
decoration 8.3
crusty 7.9
life 7.8
color 7.8
butter 7.8
cook 7.3
dish 7.2
black 7.2

Google
created on 2022-01-22

Brown 98
Wood 86.5
Rectangle 86.2
Cuisine 76.4
Wood stain 72.2
Baked goods 71.1
Dish 70.2
Art 68.3
Fashion accessory 67.2
Font 64.8
Leather 56.6
Rock 52.9
Snack 50
Natural material 50

Microsoft
created on 2022-01-22

cake 99.5
chocolate 92.6
piece 77.4
art 67.3
painting 64
slice 55

Feature analysis

Amazon

Box 57.9%

Captions

Microsoft

a piece of chocolate cake on a table 39.7%
a piece of cake sitting on top of a table 39.6%
a piece of chocolate cake 39.5%