Human Generated Data

Title

Mary, Queen of Scots
Date

19th century
People

Artist: Léopold Massard, French 1812 - 1889
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. William Simes, M9432

Human Generated Data

Title

Mary, Queen of Scots

People

Artist: Léopold Massard, French 1812 - 1889

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. William Simes, M9432

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Drawing 98.1
Art 98.1
Human 98.1
Person 97.6
Sketch 93.4
Face 62.4
Photo 61.7
Photography 61.7
Portrait 60.2

Clarifai
created on 2019-03-22

people 98.8
wear 98.5
adult 98.4
portrait 97.9
one 97.1
retro 95.2
art 95.1
vintage 93.4
painting 92
wall 90
picture frame 87.2
woman 85
old 81.7
veil 80.3
facial expression 80.3
room 80.1
furniture 76.4
girl 73.6
antique 73.2
dirty 70

Imagga
created on 2019-03-22

sketch 65.6
drawing 56.1
vintage 53.8
old 51.6
paper 50.5
grunge 46.9
texture 46.6
representation 45.3
antique 39.1
envelope 38.2
aged 36.2
wallpaper 35.2
retro 32.8
ancient 30.3
document 29.7
dirty 28.9
parchment 27.8
cardboard 26.9
rough 26.4
container 26
material 25
page 24.1
frame 23.3
canvas 22.8
empty 22.3
letter 22
worn 22
design 21.4
blank 20.6
art 20.3
damaged 20
manuscript 19.6
decorative 19.2
aging 19.2
brown 18.4
decay 18.3
artistic 18.3
border 18.1
sheet 17.9
stain 17.3
textured 16.7
pattern 16.4
grungy 16.1
book 15.9
text 15.7
grain 15.7
floral 15.3
notebook 14.9
cover 14.8
flower 14.6
crumpled 14.6
old fashioned 14.3
backgrounds 13.8
backdrop 13.2
shabby 12.8
grime 12.7
symbol 12.1
distressed 11.8
book jacket 11.8
pages 11.7
fracture 11.7
space 11.6
ornament 11.2
historic 11
card 10.9
tattered 10.9
stains 10.7
stained 10.6
stucco 10.5
graphic 10.2
leaf 10.1
jacket 10.1
silhouette 9.9
sign 9.8
ragged 9.8
burnt 9.7
surface 9.7
scroll 9.5
textures 9.5
color 9.5
photograph 9.4
yellow 9.3
note 9.2
paint 9.1
structure 8.9
decor 8.8
creative 8.8
torn 8.7
obsolete 8.6
rusty 8.6
wall 8.6
artwork 8.2
wrapping 7.9
decoration 7.9
scratched 7.8
scratch 7.8
fiber 7.7
board 7.7
style 7.4
mug shot 7.4
detail 7.2

Google
created on 2019-03-22

Photograph 96.6
Head 87.6
Picture frame 86
Snapshot 82.9
Vintage clothing 73.3
Drawing 68.4
Portrait 66.6
Room 65.7
Illustration 65.5
Art 58.1
Black-and-white 56.4
Sketch 54.4
Paper product 53.3
Paper 51
Rectangle 50.5

Microsoft
created on 2019-03-22

whiteboard 81.9
white 75.5
art 47.1
open 47.1
animal 42.7
fashion 38.3
wedding 33.7
drawing 33.5
black and white 32
snow 29.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 79.5%
Sad 12.8%
Disgusted 1.3%
Confused 4.7%
Happy 0.9%
Angry 10.1%
Calm 67.8%
Surprised 2.4%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-03-22

a close up of a whiteboard 63.8%
close up of a whiteboard 57%
a close up of a white door 33.6%

Text analysis

Amazon

Siart
ane Siart
ane
nnilt
ak nnilt
a
ak

Google

928
928