Human Generated Data

Title

Sherd

Date

People
Classification

Fragments

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. George C. Scanlon, 1970.157.179

Human Generated Data

Title

Sherd

People
Date

Classification

Fragments

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Food 97.4
Bread 97.4
Hole 68.5
Snake 66.9
Reptile 66.9
Animal 66.9
Triangle 62.8
Pottery 61.1
Wasp 57.9
Invertebrate 57.9
Insect 57.9
Andrena 57.9
Hornet 57.9
Bee 57.9
Wood 55

Clarifai
created on 2019-07-08

vintage 97.5
old 97.4
one 97.2
no person 96.5
desktop 95.8
decoration 95.7
symbol 95.1
texture 94.5
art 94.3
color 93.5
retro 93.3
sign 91.3
pattern 91.2
food 91.1
wall 90.9
design 90.9
letter 90.8
wear 90.7
pottery 90.7
painting 87.7

Imagga
created on 2019-07-08

stamp 81.5
die 62.5
shaping tool 47
tool 29.8
old 25.8
grunge 22.1
texture 20.8
vintage 20.7
paper 20.4
brown 19.1
dirty 19
toast 16.4
food 15.8
antique 15.6
retro 15.6
frame 14.2
bread 14.1
textured 14
page 13.9
blank 13.7
symbol 13.5
grungy 13.3
close 13.1
art 13
pattern 13
aged 12.7
design 12.5
shield 12.5
meal 11.4
container 11.3
ancient 11.2
fresh 11.1
sheet 10.3
snack 10.3
eat 10.1
armor 10.1
slice 10
yellow 9.9
sign 9.8
decoration 9.8
breakfast 9.7
dessert 9.7
bakery 9.5
empty 9.4
card 9.4
document 9.3
tasty 9.2
letter 9.2
rough 9.1
fastener 9
earthenware 8.9
celebration 8.8
text 8.7
parchment 8.6
rusty 8.6
piece 8.5
communication 8.4
sweet 7.9
holiday 7.9
protective covering 7.8
torn 7.7
worn 7.6
damaged 7.6
post 7.6
age 7.6
covering 7.6
healthy 7.6
nutrition 7.6
delicious 7.4
object 7.3
diet 7.3
ceramic ware 7.3
love 7.1

Google
created on 2019-07-08

Blue 91.2
Ceramic 78.6
Art 62.5
Fictional character 52.8

Microsoft
created on 2019-07-08

piece 78.6
half 56.3

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 87.9%
Confused 18.3%
Sad 21.9%
Angry 19.9%
Disgusted 4%
Surprised 4.3%
Happy 2.5%
Calm 29.1%

Feature analysis

Amazon

Bread 97.4%
Snake 66.9%

Captions

Microsoft

a piece of cake 59.7%
a piece of cake sitting on top of a table 30.3%
a piece of cake on a table 30.2%