Human Generated Data

Title

The Surrender of Cornwallis to Washington

Date

1844-1857

People

Artist: Toppan Carpenter & Co., American

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21554

Human Generated Data

Title

The Surrender of Cornwallis to Washington

People

Artist: Toppan Carpenter & Co., American

Date

1844-1857

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Human 99
Person 99
Person 98.8
Person 97.5
Person 97.3
Person 95.8
Art 94.8
Person 94.8
Drawing 87.8
Painting 77.2
Sketch 77
Person 75.2
Person 70.8
Person 70.7
Person 66.7
Photography 60.6
Photo 60.6
Doodle 57.3
Canvas 56.9

Imagga
created on 2022-03-12

stucco 75.9
grunge 59.6
old 54.4
wall 52.6
texture 51.4
antique 46.8
aged 45.3
material 44.7
dirty 44.3
ancient 42.4
vintage 40.6
textured 36.8
rough 34.7
surface 34.4
retro 33.6
pattern 33.5
paper 31.4
weathered 29.5
grungy 29.4
decay 29
damaged 27.7
stained 26.9
aging 26.9
graffito 26.8
wallpaper 26.1
brown 25.8
parchment 25
concrete 24.9
frame 23.3
stone 23.2
paint 22.7
backgrounds 21.9
empty 21.5
decoration 21.5
architecture 21.1
worn 21
space 21
structure 20.8
design 20.3
cement 20
rusty 19.1
canvas 19
detail 17.7
decorative 17.6
grain 17.5
sand 17.3
backdrop 17.3
obsolete 17.3
gray 17.1
textures 17.1
stain 16.4
old fashioned 16.2
building 15.9
document 15.8
text 15.7
manuscript 15.7
color 15.6
stains 15.6
cracked 15.6
burnt 15.6
crumpled 15.5
torn 15.5
blank 15.4
cardboard 15.4
dirt 15.3
page 14.9
scratched 14.7
ragged 14.6
border 14.5
exterior 13.8
book 13.7
effect 13.7
fracture 13.6
artistic 13
rock 13
construction 12.8
distressed 12.8
grime 12.7
yellow 12.6
art 12.4
close 12
messy 11.6
earth 11.3
historic 11
dark 10.9
masonry 10.8
soil 10.8
materials 10.8
uneven 10.8
doormat 10
history 9.8
plaster 9.8
facade 9.6
fiber 9.6
stencil 9.4
natural 9.4
abrasion 8.9
tattered 8.9
shabby 8.8
crack 8.7
your 8.7
spot 8.6
age 8.6
horizontal 8.4
closeup 8.1
graphic 8
mat 7.9
pasteboard 7.9
corroded 7.9
urban 7.9
burned 7.9
level 7.8
faded 7.8
nobody 7.8
rust 7.7
sheet 7.5

Google
created on 2022-03-12

Rectangle 85.2
Art 81.5
Wood 80.3
Font 79.9
Tints and shades 76.1
Painting 75.4
Visual arts 69.8
Illustration 69.6
Drawing 69.5
Paper 68.8
Paper product 67.8
History 65.2
Working animal 63.5
Stock photography 62.8
Printmaking 59.1
Artwork 57.4
Modern art 54.9
Tree 52.8
Sketch 51

Microsoft
created on 2022-03-12

drawing 99.1
sketch 96.3
indoor 86
painting 74.9
text 60.5
old 46.6
dirty 18.6

Face analysis

Amazon

AWS Rekognition

Age 16-22
Gender Male, 96.5%
Calm 96.2%
Sad 1.8%
Fear 0.9%
Confused 0.4%
Happy 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 16-22
Gender Female, 51.1%
Happy 71.1%
Calm 11.3%
Surprised 8.2%
Confused 3.4%
Fear 3.3%
Sad 1.2%
Disgusted 1%
Angry 0.5%

AWS Rekognition

Age 6-16
Gender Male, 99.9%
Calm 85%
Sad 7%
Happy 3.2%
Fear 2.4%
Surprised 0.8%
Disgusted 0.8%
Confused 0.7%
Angry 0.3%

AWS Rekognition

Age 18-24
Gender Female, 85.4%
Sad 40.6%
Surprised 12.3%
Disgusted 11.9%
Confused 11.4%
Calm 10%
Angry 6.3%
Fear 4.3%
Happy 3.2%

AWS Rekognition

Age 20-28
Gender Male, 96.9%
Calm 99.4%
Fear 0.3%
Confused 0.1%
Sad 0.1%
Surprised 0%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 73.1%
Sad 23.1%
Fear 2.1%
Happy 0.5%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Sad 63.9%
Calm 30.4%
Fear 2.8%
Confused 1%
Happy 0.6%
Angry 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 14-22
Gender Male, 99.5%
Confused 50.5%
Calm 24%
Surprised 12.8%
Happy 6.7%
Angry 2.6%
Fear 1.7%
Disgusted 1.3%
Sad 0.4%

AWS Rekognition

Age 33-41
Gender Male, 87.2%
Calm 66.7%
Sad 16.8%
Fear 7.2%
Confused 6.2%
Disgusted 0.9%
Surprised 0.9%
Happy 0.7%
Angry 0.6%

AWS Rekognition

Age 21-29
Gender Male, 96.1%
Calm 62.4%
Sad 19.7%
Fear 10.3%
Angry 2.1%
Confused 1.6%
Happy 1.4%
Disgusted 1.3%
Surprised 1.2%

AWS Rekognition

Age 19-27
Gender Female, 61.5%
Calm 98.9%
Sad 0.6%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 18-26
Gender Female, 56.1%
Calm 98.3%
Fear 0.4%
Sad 0.4%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a close up of a sign 49.2%
close up of a sign 43.2%
a sign on a wall 30.9%