Human Generated Data

Title

The Grotto
Date

1807
People

Artist: Carl Wilhelm Kolbe, German 1759 - 1835

Artist after: Salomon Gessner, Swiss 1730 - 1788
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12275

Human Generated Data

Title

The Grotto

People

Artist: Carl Wilhelm Kolbe, German 1759 - 1835

Artist after: Salomon Gessner, Swiss 1730 - 1788

Date

1807

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12275

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Art 97.6
Painting 86.3
Person 81.9
Human 81.9
Person 42

Clarifai
created on 2023-10-28

painting 99.6
people 99.1
art 99.1
wear 97.8
portrait 97
retro 96.5
print 95.8
one 95.8
man 95.3
adult 95
vintage 94.3
paper 94.3
woman 94.2
museum 93.1
old 93
illustration 91
picture frame 90.8
no person 86.8
two 85.6
antique 84

Imagga
created on 2022-02-26

blackboard 100
grunge 55.4
vintage 52.2
old 50.9
texture 48.7
antique 41.6
wall 40.2
frame 39.2
retro 36.9
aged 36.2
doormat 33.4
material 32.2
ancient 32
rusty 29.6
dirty 29
empty 28.4
mat 27.4
damaged 26.7
board 24.5
paper 24.3
textured 23.7
border 23.5
pattern 23.3
design 23.2
blank 23.2
grungy 22.8
structure 22.3
chalkboard 20.6
chalk 20.5
rough 20.1
floor cover 20
surface 19.4
concrete 19.2
binding 19.1
grime 17.6
decay 17.4
backdrop 17.3
wallpaper 16.9
faded 16.6
art 16.4
stain 16.4
spot 16.3
covering 16.2
weathered 16.2
black 15.6
crumpled 15.6
space 15.5
parchment 15.4
text 14.9
grain 14.8
brown 14.7
message 14.6
obsolete 14.4
old fashioned 14.3
mottled 13.7
worn 13.4
wood 13.4
ragged 12.7
fracture 12.7
stains 12.7
school 12.6
nobody 12.5
element 12.4
textures 12.3
backgrounds 12.2
education 12.1
note 12
crease 11.8
tracery 11.7
dark 11.7
graphic 11.7
crack 11.6
rust 11.6
aging 11.5
drawing 11.5
stone 11.1
historic 11
rotting 10.9
succulent 10.7
messy 10.7
canvas 10.4
learn 10.4
sheet 10.3
study 10.3
gray 9.9
broad 9.8
scratched 9.8
idea 9.8
your 9.7
detail 9.7
stained 9.6
great 9.6
building 9.5
word 9.4
symbol 9.4
architecture 9.4
letter 9.2
cement 8.8
broken 8.7
dirt 8.6
communication 8.4
page 8.4
urban 7.9
decoration 7.9
color 7.8
cracked 7.8
burnt 7.8
classroom 7.8
announcement 7.8
built 7.7
spotted 7.7
construction 7.7
age 7.6
close 7.4
style 7.4
cover 7.4
book 7.3
history 7.2
world 7.1
wooden 7

Google
created on 2022-02-26

Plant 91.8
Wood 84.4
Art 83.2
Tree 82.5
Tints and shades 76.8
Painting 76.4
Rectangle 76.4
Trunk 76.1
Visual arts 68.4
Drawing 67.8
Illustration 66.8
History 62.1
Room 61.8
Paper product 61.4
Paper 60.4
Artwork 56.5
Still life 56.1
Printmaking 56
Modern art 54.8
Font 54.4

Microsoft
created on 2022-02-26

room 99.9
gallery 99.9
scene 99.6
drawing 99.4
painting 96.9
sketch 95.8
text 86.4
illustration 69.8
art 65.6
picture frame 8.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 95.4%
Calm 86.7%
Sad 5.7%
Fear 5.3%
Surprised 0.7%
Disgusted 0.5%
Angry 0.5%
Happy 0.4%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 86.3%
Person 81.9%
Person 42%

Categories

Imagga

paintings art 97.3%
pets animals 1.5%

Captions

Microsoft
created on 2022-02-26

a room with art on the wall 48.1%
a sign for a photo 31.1%
a close up of a sign 31%

Text analysis

Amazon

GROTTE
LA GROTTE
LA
سم
A
de
.
IT
tabdraw IT gounde tare de about de la famille A . Gefmin
grave سم Girl A.M.
about
tabdraw
famille
tare
de la
gounde
grave
Girl
Gefmin
A.M.

Google

LA GROTTE talide aw en geusche ter de alomrt de la fmalle deS Gefne
LA
GROTTE
talide
aw
en
geusche
ter
de
alomrt
la
fmalle
deS
Gefne