Human Generated Data

Title

The Straw Hat, after Rubens
Date

1887
People

Artist: Joseph Lindon Smith, American 1863 - 1950

Artist after: Peter Paul Rubens, Flemish 1577 - 1640
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Denman W. Ross, class of '75, 1915.16

Human Generated Data

Title

The Straw Hat, after Rubens

People

Artist: Joseph Lindon Smith, American 1863 - 1950

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

1887

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Denman W. Ross, class of '75, 1915.16

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Clothing 99.1
Apparel 99.1
Hat 99.1
Human 98
Art 97.7
Drawing 97.7
Person 96.1
Sketch 94.8

Clarifai
created on 2019-05-30

art 97.9
desktop 97.5
bill 97.4
blank 97.2
people 96.7
design 95.6
picture frame 95.4
paper 95.1
illustration 94.6
retro 94.3
vintage 93.2
vector 92.4
portrait 92.3
graphic 92.2
adult 92
abstract 91.7
pattern 90.9
card 89.4
wear 88.7
empty 87.9

Imagga
created on 2019-05-30

sketch 100
drawing 100
representation 96.3
art 33
retro 27.9
design 27.6
vintage 21.5
symbol 20.9
card 19.9
style 19.3
floral 18.7
frame 18.7
pattern 17.8
line 17.2
silhouette 16.6
paper 16.5
decorative 15.9
graphic 15.3
grunge 14.5
black 14.4
old 14
texture 13.9
decoration 13.9
ornament 13.8
sign 13.6
curl 13.3
creative 12.4
modern 11.9
ornate 11.9
icon 11.9
shape 11.9
elegance 11.8
flower 11.6
ancient 11.3
greeting 11.2
border 10.9
curve 10.5
artistic 10.4
note 10.1
cartoon 9.8
fashion 9.8
decor 9.7
elegant 9.4
spring 9.4
page 9.3
elements 9.3
message 9.1
business 9.1
element 9.1
paint 9.1
love 8.7
holiday 8.6
scroll 8.6
blank 8.6
leaf 8.6
envelope 8.6
outline 8.5
clip art 8.4
antique 8.3
aged 8.2
gift 7.8
ink 7.7
wallpaper 7.7
template 7.4
object 7.3
artwork 7.3
painting 7.2
office 7.2

Google
created on 2019-05-30

Drawing 93.7
Sketch 86.3
Text 85.2
Notebook 78.2
Art 73.1
Paper 67.7
Illustration 66.9
Artwork 66.6
Visual arts 62.5
Figure drawing 60
Paper product 55.7
Fictional character 52.8

Microsoft
created on 2019-05-30

sketch 99.8
drawing 99.7
text 99.4
whiteboard 99
child art 97.4
art 97.2
human face 87.7
illustration 84.3
cartoon 81.8
painting 58.7

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 11-18
Gender Female, 98%
Sad 12.1%
Happy 1.3%
Confused 10.1%
Angry 6.3%
Surprised 4.3%
Disgusted 1.2%
Calm 64.7%

Microsoft Cognitive Services

Age 21
Gender Female

Feature analysis

Amazon

Hat 99.1%
Person 96.1%

Categories

Imagga

paintings art 66.9%
text visuals 23.5%
food drinks 5.8%
nature landscape 1.9%

Captions

Microsoft
created on 2019-05-30

a close up of text on a whiteboard 68.2%
a close up of a whiteboard 67.3%
a whiteboard with writing on them 67.2%

Text analysis

Amazon

Rubens
AAter Rubens
AAter
Hat:
Strawl
1887
ICNoren Strawl Hat:
GALLER:
LOITDolt.
NATIOIAL. GALLER: LOITDolt.
NATIOIAL.
E 1887
ICNoren
E

Google

Rubens
Lorpol
er Rubens AR Lorpol
er
AR