Human Generated Data

Title

Love Lesson

Date

18th century

People

Artist: Philippe Mercier, 1689 - 1760

Artist after: Jean-Antoine Watteau, French 1684 - 1721

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Richard Norton Memorial Fund, 2017.120.68

Human Generated Data

Title

Love Lesson

People

Artist: Philippe Mercier, 1689 - 1760

Artist after: Jean-Antoine Watteau, French 1684 - 1721

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Richard Norton Memorial Fund, 2017.120.68

Machine Generated Data

Tags

Amazon
created on 2020-05-28

Human 98.5
Person 98.5
Art 90.5
Painting 87.1
Text 81.3
Drawing 68.4
Scroll 57.5

Clarifai
created on 2020-05-28

people 99.8
print 98.9
art 98.6
group 98.3
painting 98
wear 97.8
adult 97.4
woman 96.6
man 95.7
illustration 94.1
veil 93.4
retro 93
two 91.7
vintage 90.3
many 89.3
antique 87.8
war 86.7
cavalry 86.3
portrait 86.2
sepia pigment 86.2

Imagga
created on 2020-05-28

binding 44.3
vintage 42.2
old 41.8
grunge 40
envelope 39.5
container 37.7
retro 36.1
paper 30.7
texture 29.9
aged 28.1
frame 27.7
ancient 24.2
antique 22.6
design 19.2
tray 19
blank 18
art 18
wall 16.4
border 16.3
dirty 16.3
receptacle 15.4
rusty 15.2
grungy 15.2
page 14.9
card 14.8
money 14.5
blackboard 14.2
chalkboard 13.7
floral 13.6
finance 13.5
board 13.5
graphic 13.1
currency 12.6
map 12.4
bill 12.4
text 12.2
message 11.9
decoration 11.9
album 11.7
pattern 11.6
flower 11.5
book 11.3
empty 11.2
note 11
cash 11
leaf 10.9
wallpaper 10.7
material 10.7
structure 10.6
damaged 10.5
drawing 10.4
binder 10.3
box 10.2
letter 10.1
earth 10.1
color 10
paint 10
carton 9.9
world 9.8
geography 9.6
black 9.6
space 9.3
artwork 9.2
global 9.1
covering 9.1
protective covering 9.1
bank 9
history 8.9
idea 8.9
brown 8.8
symbol 8.8
scrapbook 8.7
states 8.7
china 8.6
worn 8.6
dirt 8.6
business 8.5
planet 8.5
banking 8.3
atlas 8.3
backdrop 8.2
rough 8.2
stamp 8
framework 7.9
textured 7.9
postmark 7.9
grime 7.8
faded 7.8
continent 7.8
torn 7.7
mail 7.7
north 7.7
international 7.6
japan 7.6
united 7.6
textures 7.6
communication 7.6
decorative 7.5
ocean 7.5
dollar 7.4
greeting 7.4
globe 7.4
backgrounds 7.3

Google
created on 2020-05-28

Microsoft
created on 2020-05-28

text 99.4
drawing 95.5
sketch 90.9
person 89.9
clothing 89.6
painting 88.2
woman 66
picture frame 18.3
plaque 16.5

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 25-39
Gender Female, 63.3%
Calm 82.9%
Angry 0.1%
Disgusted 0.1%
Surprised 0.2%
Fear 0.1%
Sad 0.6%
Confused 0.1%
Happy 15.9%

AWS Rekognition

Age 11-21
Gender Female, 51.5%
Calm 54.8%
Disgusted 45%
Angry 45%
Fear 45%
Happy 45%
Confused 45%
Surprised 45%
Sad 45.2%

AWS Rekognition

Age 16-28
Gender Female, 65.3%
Sad 0.9%
Calm 65.7%
Confused 0.5%
Disgusted 0.3%
Happy 31.7%
Fear 0.1%
Angry 0.3%
Surprised 0.5%

AWS Rekognition

Age 19-31
Gender Male, 52.6%
Angry 45.6%
Fear 45%
Disgusted 45.1%
Sad 45.1%
Surprised 45.2%
Calm 53.5%
Happy 45.3%
Confused 45%

AWS Rekognition

Age 15-27
Gender Female, 52.7%
Surprised 45%
Fear 45%
Angry 54.8%
Calm 45%
Sad 45%
Happy 45.1%
Disgusted 45%
Confused 45%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Feature analysis

Amazon

Person 98.5%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2020-05-28

a close up of a sign 46.7%
a close up of text on a white surface 30.4%
a sign on a wall 30.3%

Text analysis

Amazon

Cailus
Comiti
Pictoria,
domi
nobili
de
cultori
ac
plendide
otosa
et
Tabulam
eadem
.Tllustrr Viro. Comiti de
oto
dicat.
Belli;
Belli; ar rtium digniimo: ac 'dextra. nobili milinia eadem Cailus domi & Pictoria,
pacisque
m
ar
&
Chaleograpt
digniimo:
artsgue
.Tllustrr
pacisque et Chaleograpt cultori aptifema; plendide conspicuo. Tabulam e m anmo oto dicat. mnime otosa artsgue .m.
aptifema;
mnime
Viro.
anmo
milinia
conspicuo.
'dextra.
rtium
e
.m.

Google

-P.M.del.et Sculp. Tllustri, ac nobili Viro, Comiti de Cailus, & & &. Belli, pacisqueArtium cultori dignifsimo: dextrá, Militia præclarå, eadem domi in otio minime.otioså, drtisque Pictoria, Vatteau pinxit. et Chalcographia Aptisima; Viro Splendide conspicuo: Hanc Tabulam ex animo dicat. 263 A
-P.M.del.et
Sculp.
Tllustri,
ac
nobili
Viro,
Comiti
de
Cailus,
&
&.
Belli,
pacisqueArtium
cultori
dignifsimo:
dextrá,
Militia
præclarå,
eadem
domi
in
otio
minime.otioså,
drtisque
Pictoria,
Vatteau
pinxit.
et
Chalcographia
Aptisima;
Viro
Splendide
conspicuo:
Hanc
Tabulam
ex
animo
dicat.
263
A