Human Generated Data

Title

Andrew Jackson

Date

1844-1857

People

Artist: Toppan Carpenter & Co., American

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21569

Human Generated Data

Title

Andrew Jackson

People

Artist: Toppan Carpenter & Co., American

Date

1844-1857

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Person 98.7
Human 98.7
Face 86.8
Art 85.3
Painting 79.6
Text 73.5
Photo 64.2
Photography 64.2
Portrait 63.8
Drawing 57.5
Performer 56.8

Imagga
created on 2022-03-12

vintage 59.6
old 50.9
antique 49.6
paper 49.5
grunge 48.6
stucco 48.6
texture 45.2
aged 43.5
retro 36.1
ancient 34.6
wallpaper 33
parchment 30.7
envelope 29.1
material 28.6
dirty 28
frame 26.9
empty 26.6
border 26.2
cardboard 26
design 24.4
document 24.1
decay 23.2
rough 22.8
canvas 22.8
blank 22.3
page 22.3
damaged 22
worn 21
art 20.5
card 20.4
stain 20.2
backgrounds 19.5
letter 19.3
text 18.3
aging 18.2
brown 17.7
grime 17.6
crumpled 17.5
sheet 16.9
grain 16.6
stains 16.5
textured 15.8
pattern 15.7
book 15.4
rusty 15.3
old fashioned 15.2
space 14.8
manuscript 14.7
ragged 14.6
fracture 14.6
floral 14.5
stained 14.4
textures 14.2
decoration 13.4
decorative 13.4
element 13.2
graphic 13.1
artistic 13
cover 13
wall 12.8
pages 12.7
torn 12.6
backdrop 12.4
weathered 12.4
grungy 12.3
symbol 12.1
historic 11.9
mottled 11.7
faded 11.7
drawing 11.7
container 11.3
artwork 11
shabby 10.8
structure 10.8
flower 10.8
album 10.7
burnt 10.7
surface 10.6
obsolete 10.5
style 10.4
tattered 9.9
distressed 9.8
spotted 9.6
country 9.1
paint 9.1
history 9
crack 8.7
ornament 8.6
yellow 8.6
age 8.6
sign 8.3
notebook 8.2
detail 8.1
map 8
messy 7.7
beige 7.7
fiber 7.7
tracery 7.7
spot 7.7
corner 7.6
pirate 7.6
flag 7.3
painting 7.2
leaf 7

Google
created on 2022-03-12

Art 82.7
Rectangle 79.6
Facial hair 79.4
Collar 76.2
Font 74.9
Suit 73
Beard 70.9
Visual arts 66.9
Moustache 65.5
Illustration 65.1
Paper product 64.8
Paper 64.3
History 63.5
Self-portrait 60.3
Portrait 58.4
Circle 56.5
Room 56.1
Drawing 53.9
Painting 51.6
Book 50.8

Microsoft
created on 2022-03-12

human face 97.1
wall 95.8
indoor 92
person 91.5
text 91.4
stationary 81.2
envelope 67.6
old 45.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 92.7%
Confused 5.7%
Happy 0.4%
Sad 0.4%
Angry 0.4%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a close up of a box 61%
close up of a box 55.1%
a clock on the wall 31.5%