Human Generated Data

Title

Untitled

Date

People
Classification

Straus Materials

Credit Line

Harvard Art Museums/Straus Center for Conservation and Technical Studies, Forbes Pigment Collection, Straus.1325

Human Generated Data

Title

Untitled

People
Date

Classification

Straus Materials

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Drink 97.3
Milk 97.3
Beverage 97.3
Paint Container 93.3
Rug 88.9
Palette 78.5
Jar 71.3

Clarifai
created on 2019-07-20

no person 93.5
business 93.2
desktop 91.4
container 89
symbol 88
family 85.1
medicine 82.2
illustration 81.8
indoors 81.8
paper 80.6
reflection 80
glass items 80
empty 79.6
window 79.3
house 78.6
isolate 78.2
color 77.1
conceptual 76.9
office 76.2
glass 75.6

Imagga
created on 2019-07-20

container 31.5
tray 18.3
jelly 17
receptacle 14.8
paper 14.2
art 13.8
substance 13.6
design 13.5
grunge 12.8
blank 12
old 11.8
texture 11.8
brown 11.8
retro 11.5
food 11.4
color 11.1
vintage 10.7
nobody 10.1
frame 10
empty 9.9
black 9.6
antique 9.5
mosaic 9.1
object 8.8
symbol 8.7
colorful 8.6
close 8.6
poker 7.8
casino 7.8
jack 7.8
cards 7.8
wallet 7.7
eat 7.5
pattern 7.5
game 7.4
style 7.4
book 7.3
yellow 7.3
tile 7.3
decoration 7.2
dessert 7

Google
created on 2019-07-20

Microsoft
created on 2019-07-20

Feature analysis

Amazon

Milk 97.3%
Rug 88.9%

Captions

Microsoft

a cup on a counter 30.2%

Text analysis

Amazon

5cm.
5

Google

5
cm.
5 cm.