Human Generated Data

Title

Winfield Scott

Date

1844-1857

People

Artist: Toppan Carpenter & Co., American

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21566

Human Generated Data

Title

Winfield Scott

People

Artist: Toppan Carpenter & Co., American

Date

1844-1857

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Human 96
Person 96
Coin 64.4
Money 64.4

Imagga
created on 2022-03-12

clock 100
timepiece 100
wall clock 100
measuring instrument 70.3
old 36.2
instrument 35.1
vintage 33.1
antique 32
grunge 31.5
texture 29.9
paper 26.7
retro 25.4
aged 25.3
dirty 25.3
parchment 20.1
empty 19.8
wallpaper 19.1
ancient 18.2
wall 18
material 17
document 15.8
pattern 15.7
rough 15.5
decay 15.4
cardboard 15.4
worn 15.3
art 15
blank 14.6
damaged 13.4
rusty 13.3
decorative 12.5
design 12.4
canvas 12.3
text 12.2
book 11.9
textured 11.4
sign 11.3
sheet 11.3
page 11.1
letter 11
aging 10.5
metal 10.5
weathered 10.4
close 10.3
symbol 10.1
space 10.1
stains 9.7
crumpled 9.7
detail 9.7
rust 9.6
stain 9.6
sand 9.6
age 9.5
old fashioned 9.5
grungy 9.5
backdrop 9.1
border 9
surface 8.8
ragged 8.8
closeup 8.8
artistic 8.7
stained 8.7
card 8.5
cover 8.3
frame 8.3
grain 8.3
technology 8.2
backgrounds 8.1
brown 8.1
wooden 7.9
manuscript 7.8
grime 7.8
architecture 7.8
ornament 7.8
torn 7.7
door 7.6
beach 7.6
element 7.4
water 7.3
travel 7

Google
created on 2022-03-12

Microsoft
created on 2022-03-12

drawing 87.5
human face 87.2
white 68
text 67.1
handwriting 63.7
envelope 42
dirty 27.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 65-75
Gender Male, 97.2%
Calm 65.7%
Angry 30.2%
Sad 2.2%
Confused 0.8%
Disgusted 0.3%
Fear 0.3%
Happy 0.3%
Surprised 0.3%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96%

Captions

Microsoft

a piece of paper 41.4%
a hole in the ground 41.3%
a close up of a hole in the ground 41.2%

Text analysis

Amazon

Scott
brainfield Scott
brainfield