Human Generated Data

Title

Self-portrait

Date

18th century

People

Artist: Carlo Spiridone Mariotti, Italian 1726 - 1790

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Alexander B.V. Johnson and Roberta J.M. Olson, 2001.261

Human Generated Data

Title

Self-portrait

People

Artist: Carlo Spiridone Mariotti, Italian 1726 - 1790

Date

18th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Art 98.2
Drawing 98.2
Sketch 95.5
Animal 95.2
Bird 95.2
Bird 84
Painting 74.7

Clarifai
created on 2019-06-01

illustration 99
chalk out 98.4
print 98.3
art 97.7
retro 97.7
vintage 97.5
people 97.4
old 94.5
paper 94.1
woodcut 93.7
man 93.6
engraving 92.9
antique 91
visuals 90.7
painting 87.8
ancient 86
sketch 83.3
adult 82.7
desktop 81.8
symbol 81.6

Imagga
created on 2019-06-01

sketch 81.8
drawing 76.2
representation 45.2
retro 34.5
vintage 33.1
design 29.9
art 28.5
grunge 25.6
graphic 25.6
old 25.1
floral 24.7
silhouette 23.2
pattern 19.9
paper 18.9
frame 18.7
decorative 18.4
decoration 18.1
antique 17.7
style 17.1
bookmark 16.5
card 16.4
symbol 16.2
envelope 15.9
flower 15.4
shape 14.9
ancient 13.9
ornate 13.7
leaf 13.3
painting 12.7
texture 12.5
decor 12.4
black 12.1
ornament 12.1
border 11.8
scroll 11.5
page 11.2
swirl 11.1
creative 10.6
curve 10.5
greeting 10.2
clip art 10.2
banner 10.1
template 10.1
cartoon 9.8
ink 9.6
icon 9.5
elements 9.3
element 9.1
plant 9.1
invitation 8.7
line 8.6
curl 8.6
journal 8.6
grungy 8.6
wallpaper 8.4
elegance 8.4
book 8.1
holiday 7.9
artistic 7.8
elegant 7.7
tree 7.7
pencil 7.7
backdrop 7.4
birthday 7.4
container 7.4
brown 7.4
artwork 7.3
dirty 7.2
celebration 7.2
spring 7.1
modern 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

sketch 99.8
drawing 99.7
text 99.4
illustration 96.9
book 95
cartoon 88.8
art 85.7
human face 84.7
person 75.6
ink 64.3
child art 55.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-27
Gender Female, 70.3%
Happy 2.6%
Angry 10.6%
Surprised 5.7%
Disgusted 5%
Sad 30.6%
Calm 37.8%
Confused 7.7%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Bird 95.2%

Captions

Microsoft

a close up of a book 38%
close up of a book 32.8%
a close up of text on a white surface 32.7%