Human Generated Data

Title

SHERD

Date

People
Classification

Fragments

Human Generated Data

Title

SHERD

People
Date

Classification

Fragments

Machine Generated Data

Tags

Amazon

Wood 83.6
Arrowhead 69.5
Soil 65.7
Box 65.3

Clarifai

no person 99.4
winter 96.8
still life 94.9
one 94.1
snow 92.4
food 92.4
cold 89.9
rock 89.4
stone 87.6
broken 87.1
cutout 86
sweet 84.1
nature 83.9
chocolate 81.8
geology 80.2
recreation 79.8
wood 79.3
container 78.7
simplicity 77.7
two 77.4

Imagga

box 79.9
chest 66.1
container 49.3
chocolate 33.1
brown 30.2
food 29.4
slice 24.6
seat 22.3
dessert 20.3
sweet 19.8
snack 17.9
sugar 17.8
furniture 17.4
piece 16.1
tasty 15.9
dark 15.9
delicious 15.7
bakery 15.5
closeup 15.5
close 15.4
block 14.6
gourmet 14.4
object 13.9
healthy 13.2
antique 13
bread 13
diet 12.9
old 12.5
decoration 11.8
eat 11.7
cake 11.3
cream 11.2
stack 11.1
candy 11.1
treasure 10.6
broken 10.6
pastry 10.5
furnishing 10.5
eating 10.1
cocoa 9.8
wooden 9.7
treat 9.5
baked 9.4
bar 9.2
black 9
meal 8.9
ingredient 8.8
loaf 8.7
natural 8.7
temptation 8.7
bag 8.6
money 8.5
nutrition 8.4
wood 8.3
fresh 7.8
color 7.8
nobody 7.8
addiction 7.7
calorie 7.7
crate 7.6
plate 7.6
pile 7.5
case 7.5
savings 7.5
cutout 7.4
full 7.3
stone 7.2
cut 7.2
bank 7.2

Google

Rock 82.7
Beige 74.9

Microsoft

cake 99.9
chocolate 97.2
food 87.9
piece 82.1
box 76.8
sweet 69.3
dessert 26.4

Feature analysis

Amazon

Box 65.3%

Captions

Microsoft

a piece of chocolate cake 74.9%
a piece of cake covered in chocolate 74.8%
a piece of chocolate cake on a table 55.6%