Human Generated Data

Title

Untitled

Date

1947

People

Artist: Mark Rothko, American 1903 - 1970

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of The Mark Rothko Foundation, Inc., 1986.467

Copyright

© Kate Rothko Prizel & Christopher Rothko / Artists Rights Society (ARS), New York

Human Generated Data

Title

Untitled

People

Artist: Mark Rothko, American 1903 - 1970

Date

1947

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 97.1
Painting 95.6
Modern Art 81.8
Rug 66.4
Mural 63.4
Canvas 56.8

Clarifai
created on 2018-03-16

painting 98.9
abstract 97.3
art 96.3
creativity 96
paper 95.7
illustration 95.5
pattern 94.5
wear 93.9
wall 93.6
no person 93.5
graffiti 93.4
texture 93.3
desktop 93.2
spray 91.5
vintage 91.2
image 90
print 89.6
color 89.1
water-color 88.8
artistic 88.2

Imagga
created on 2018-03-16

graffito 100
decoration 92.6
grunge 52.9
texture 46.6
old 43.2
vintage 38.1
aged 35.3
antique 32.9
wall 32.5
surface 31.8
paint 31.7
grungy 30.4
pattern 29.4
rusty 28.6
dirty 28.1
frame 27.5
art 27.5
wallpaper 26.8
material 25.9
canvas 25.6
border 25.4
retro 24.6
design 24.2
rough 23.7
textured 23.7
aging 23
damaged 22.9
decay 22.2
paper 21.2
weathered 20.9
color 20.6
rust 20.3
grain 17.6
stained 17.3
acrylic 17.1
brown 17
metal 16.9
mottled 16.6
backgrounds 16.2
detail 16.1
structure 15.7
worn 15.3
decorative 15
backdrop 14.9
fracture 14.6
graphic 14.6
crack 14.5
stain 14.4
parchment 14.4
obsolete 14.4
empty 13.8
grime 13.7
faded 13.6
spot 13.4
dirt 13.4
painted 13.4
space 13.2
flower 13.1
iron 13.1
artistic 13
ancient 13
stains 12.7
style 12.6
messy 12.6
floral 11.9
artwork 11.9
detailed 11.6
cotton 11.2
close 10.9
element 10.8
text 10.5
textures 10.4
blank 10.3
peeling 9.9
steel 9.7
crumpled 9.7
yellow 9.3
metallic 9.2
effect 9.1
scratched 8.8
burst 8.8
ragged 8.8
burnt 8.8
torn 8.7
drawing 8.6
sheet 8.5
cover 8.3
industrial 8.2
painterly 7.9
colorful 7.9
smudged 7.9
edge 7.7
industry 7.7

Google
created on 2018-03-16

painting 90
art 83.4
modern art 70.9
textile 69.2
paint 59.6
acrylic paint 57.4
artwork 56
visual arts 53.5

Microsoft
created on 2018-03-16

abstract 51.6
graffiti 41.1

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 83.2%
Angry 12.8%
Confused 18.9%
Disgusted 5.3%
Surprised 9.7%
Sad 16.1%
Calm 28.8%
Happy 8.3%

AWS Rekognition

Age 26-43
Gender Female, 87.4%
Surprised 2.7%
Sad 4.2%
Happy 0.8%
Disgusted 0.2%
Angry 0.9%
Calm 86.6%
Confused 4.5%

AWS Rekognition

Age 29-45
Gender Male, 97%
Surprised 3.3%
Confused 0.7%
Calm 87.5%
Sad 4.2%
Happy 1.4%
Disgusted 0.5%
Angry 2.4%

AWS Rekognition

Age 20-38
Gender Male, 73.2%
Surprised 4.9%
Happy 3.2%
Angry 1.9%
Sad 9.5%
Calm 76.4%
Confused 3.3%
Disgusted 0.8%

Feature analysis

Amazon

Painting 95.6%
Rug 66.4%

Captions

Microsoft

a graffiti covered wall 71.4%
a train cake is covered with graffiti 29.5%
a train covered in graffiti 29.4%