Human Generated Data

Title

Lady and Confidante in a Forest
Date

mid 18th century
People

Artist: Unknown Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Stuart Cary Welch, Jr. in memory of Mildred K. Frost, 1995.101

Human Generated Data

Title

Lady and Confidante in a Forest

People

Artist: Unknown Artist,

Date

mid 18th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Painting 96.3
Art 96.3
Human 90.6
Person 90.6
Person 69.8
Book 63.1
Green 57.9
Advertisement 56.5

Clarifai
created on 2019-05-22

painting 99.5
art 99.5
illustration 99.4
print 97.5
religion 96.1
god 95.2
people 94.9
saint 93.5
tree 92.4
woman 91.3
old 89.3
Renaissance 88.1
holy 87.5
aura 87.1
Gothic 87
spirituality 85.6
visuals 85.3
book 85.3
image 84
adult 83.1

Imagga
created on 2019-05-22

decoration 26.4
book jacket 24.1
bottle 21.7
wine bottle 20.8
old 20.2
art 20
jacket 19.7
vintage 18.6
graffito 18.1
design 17.6
vessel 17.1
light 16.7
grunge 16.2
wrapping 15.2
pattern 15
ornament 14.6
forest 13.9
artistic 13.9
paper 13.3
frame 13.3
container 12.8
paint 12.7
black 12.6
texture 12.5
retro 12.3
wallpaper 12.2
antique 12.1
painting 11.7
covering 11.3
leaf 10.9
colorful 10.7
color 10.6
summer 10.3
floral 10.2
dark 10
modern 9.8
style 9.6
leaves 9.6
graphic 9.5
natural 9.4
holiday 9.3
yellow 9.3
flower 9.2
foliage 9.2
decorative 9.2
dirty 9
shape 8.9
canvas 8.5
fractal 8.3
backdrop 8.2
fantasy 8.1
decor 8
tree 7.9
spring 7.8
season 7.8
wall 7.8
ancient 7.8
elegant 7.7
painted 7.6
page 7.4
drawing 7.4
ornate 7.3
peace 7.3
fresh 7.2
life 7

Google
created on 2019-05-22

Painting 97.5
Art 89.7
Illustration 87
Botany 78.7
Tree 74.7
Organism 71.5
Visual arts 62.5
Fictional character 61.9
Miniature 60.5
Plant 58.5
Prophet 51
Mythology 50.3

Microsoft
created on 2019-05-22

tree 99.9
text 99.3
drawing 96
book 95
cartoon 93.8
child art 87.6
illustration 83
sketch 79.2
person 78.5
clothing 78
fairytale 73.4
woman 68.3
painting 23.6
several 12.3

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 53.9%
Calm 45.5%
Disgusted 45.2%
Surprised 45.6%
Sad 46.4%
Confused 45.5%
Happy 45.4%
Angry 51.4%

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Angry 45.7%
Sad 46.6%
Surprised 45.8%
Confused 45.4%
Happy 48.6%
Calm 47.5%
Disgusted 45.4%

Feature analysis

Amazon

Painting 96.3%
Person 90.6%

Captions

Microsoft

a painting of a christmas tree 80.3%
a painting of a book 56.6%
a painting of a book with a christmas tree 56.5%