Human Generated Data

Title

The Jealous Ones

Date

18th century

People

Artist: Gérard Jean Baptiste Scotin II, French 1698 - after 1755

Artist after: Jean-Antoine Watteau, French 1684 - 1721

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Richard Norton Memorial Fund, 2017.120.35

Human Generated Data

Title

The Jealous Ones

People

Artist: Gérard Jean Baptiste Scotin II, French 1698 - after 1755

Artist after: Jean-Antoine Watteau, French 1684 - 1721

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Richard Norton Memorial Fund, 2017.120.35

Machine Generated Data

Tags

Amazon
created on 2020-06-17

Human 98.8
Person 98.8
Art 96.2
Person 93.9
Painting 91.8
Person 79.7
Person 49.2

Clarifai
created on 2020-06-17

people 99.7
painting 99.3
print 99.3
art 99.2
wear 97.9
adult 97.9
group 96.6
man 96.3
retro 95.4
illustration 94.8
woman 94.6
two 94.1
sepia pigment 93.5
vintage 92.8
antique 92.4
leader 91.5
paper 91
portrait 90.5
engraving 88.7
sepia 87.7

Imagga
created on 2020-06-17

blackboard 75.1
vintage 58.8
old 55.8
grunge 55.4
brass 50
frame 49.3
texture 46.6
structure 44.3
retro 42.7
memorial 40.3
antique 39
aged 35.3
wall 34.3
blank 32.6
binding 32.5
border 30.8
paper 30.6
empty 30.1
rusty 29.6
ancient 28.6
dirty 27.1
material 25.9
art 23.7
damaged 22.9
wallpaper 22.2
design 22.1
textured 21.9
chalkboard 20.6
board 20.6
black 20.5
pattern 19.9
grungy 19
backdrop 19
wood 18.4
rough 18.3
spot 17.3
old fashioned 17.1
obsolete 15.4
grain 14.8
space 14.8
grime 14.7
mottled 14.6
chalk 14.6
parchment 14.4
concrete 14.4
letter 13.8
book jacket 13.7
stains 13.6
crumpled 13.6
photograph 13.5
rust 13.5
school 13.5
aging 13.4
brown 13.3
symbol 12.8
fracture 12.7
faded 12.7
decay 12.6
decoration 12.5
stain 12.5
film 12.5
text 12.2
education 12.1
broad 11.8
ragged 11.7
album 11.7
jacket 11.6
surface 11.5
worn 11.5
sheet 11.3
study 11.2
nobody 10.9
dark 10.9
element 10.8
tracery 10.7
succulent 10.7
crack 10.7
wooden 10.6
learn 10.4
note 10.1
historic 10.1
ornate 10.1
gray 9.9
crease 9.8
backgrounds 9.7
classroom 9.7
museum 9.7
edge 9.6
weathered 9.5
graphic 9.5
stone 9.5
page 9.3
decorative 9.2
book 9.2
drawing 8.7
memory 8.7
age 8.6
close 8.6
textures 8.5
writing 8.5
finance 8.5
wrapping 8.1
idea 8
icon 7.9
rotting 7.9
instant 7.9
scratched 7.8
messy 7.7
stained 7.7
photography 7.6
covering 7.4
style 7.4
cover 7.4
template 7.3
message 7.3
global 7.3
history 7.2
stamp 7.1
interior 7.1

Google
created on 2020-06-17

Microsoft
created on 2020-06-17

text 99.4
person 89.5
clothing 86.9
gallery 83.6
room 56.1
tree 53.2
photograph 52.7
picture frame 49.6
painting 24.8

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-40
Gender Female, 54.9%
Confused 45.1%
Sad 45.1%
Surprised 45.6%
Calm 51.9%
Angry 45.1%
Fear 45.1%
Happy 47.1%
Disgusted 45.1%

AWS Rekognition

Age 11-21
Gender Female, 54.6%
Confused 45%
Sad 45.1%
Surprised 45.1%
Calm 48.2%
Angry 45.2%
Fear 45.1%
Happy 51.4%
Disgusted 45%

AWS Rekognition

Age 51-69
Gender Male, 51%
Confused 45.9%
Sad 45.4%
Surprised 46%
Calm 50.2%
Angry 45.6%
Fear 45.7%
Happy 46%
Disgusted 45.2%

AWS Rekognition

Age 22-34
Gender Female, 53.4%
Confused 45%
Sad 45%
Surprised 45%
Calm 52.6%
Angry 45%
Fear 45%
Happy 47.3%
Disgusted 45%

AWS Rekognition

Age 23-37
Gender Female, 51.9%
Confused 45.2%
Sad 46.6%
Surprised 46%
Calm 45.9%
Angry 45.8%
Fear 50.1%
Happy 45.2%
Disgusted 45.2%

AWS Rekognition

Age 58-76
Gender Male, 54.3%
Confused 45%
Sad 45.4%
Surprised 45.1%
Calm 47.7%
Angry 45.5%
Fear 45.2%
Happy 51%
Disgusted 45.1%

Microsoft Cognitive Services

Age 6
Gender Female

Feature analysis

Amazon

Person 98.8%
Painting 91.8%

Categories

Captions

Microsoft
created on 2020-06-17

a painting on the wall 64%
a painting on a wall 63.2%
a painting of a person 48%

Text analysis

Amazon

INVIDIOSI
LES
Ecemplar
Depictum
JALOUX
le
LES Dioret INVIDIOSI
a
magnitudinis
dapres
Sarlpti
randeur:
Gravee
Eiusdtem
Waleavo
Gravee dapres le Tableuu orniginale Peintpar Sarlpti jurta Ecemplar Eiusdtem magnitudinis
IVatteaude masme randeur: a Waleavo Depictum
orniginale
masme
Peintpar
Tableuu
jurta
IVatteaude
Dioret

Google

G.ScotinSaulp. A.Walten pnnt. Qiorot conternh LES JALOUX Gravée d'apres le Tableau originale Peint par Watteau, de mesme grandeur. INVIDIOSI Scalpti juxta Exemplar Ejusdem magnitudinis à Wateavo Depictum. du Cabinet de M de Jullienne. aParis chee Fchersu, anweur de Roy rie SJacquesr aur deux pillirs dor avec privilaye du Roy.
A.Walten
conternh
LES
d'apres
le
Tableau
par
Watteau,
grandeur.
INVIDIOSI
juxta
Ejusdem
à
Wateavo
Cabinet
de
M
Jullienne.
aParis
anweur
G.ScotinSaulp.
pnnt.
Qiorot
JALOUX
Gravée
originale
Peint
mesme
Scalpti
Exemplar
magnitudinis
Depictum.
du
chee
Fchersu,
Roy
rie
SJacquesr
aur
deux
pillirs
dor
avec
privilaye
Roy.