Human Generated Data

Title

Nathaniel Russell, Plymouth, Massachusetts (1837-1862)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2037

Human Generated Data

Title

Nathaniel Russell, Plymouth, Massachusetts (1837-1862)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.8
Human 99.8
Text 99.6
Handwriting 95.4
Art 84.8
Clothing 82
Apparel 82
Drawing 76
Tie 72.9
Accessories 72.9
Accessory 72.9
Signature 62.7
Autograph 62.7
Photography 60.5
Photo 60.5
Suit 59.2
Coat 59.2
Overcoat 59.2
Portrait 58.5
Face 58.5
Glasses 57.6
Doodle 55.9

Imagga
created on 2022-01-08

money 31.5
currency 29.6
cash 23.8
finance 23.6
bank 18.9
representation 18.9
dollar 18.6
financial 17.8
banking 17.5
planet 16.7
drawing 16.7
diagram 16.3
close 16
coin 15.3
vintage 15
art 14.7
bill 14.3
moon 13.4
closeup 12.8
one 12.7
business 12.1
black 12
old 11.8
wealth 11.7
coins 11.6
us 11.6
pay 11.5
retro 11.5
symbol 11.4
sign 11.3
object 11
paper 11
pick 10.4
rich 10.2
device 10
dollars 9.7
silhouette 9.1
creation 9.1
human 9
banknote 8.7
love 8.7
design 8.6
exchange 8.6
cone 8.4
economy 8.3
person 8.3
world 8.1
graphic 8
face 7.8
male 7.8
hundred 7.7
celestial body 7.7
change 7.7
mug shot 7.6
map 7.6
dark 7.5
style 7.4
man 7.4
global 7.3
shape 7.2
stamp 7.1
cartoon 7.1
antique 7
reflection 7

Google
created on 2022-01-08

Head 97.2
Chin 96.7
Eyebrow 94.4
Facial expression 93.3
Sleeve 84.7
Oval 83.2
Collar 81.3
Font 77.1
Tints and shades 76.2
Blazer 76.1
Vintage clothing 76.1
Art 76
Handwriting 75.8
Suit 73.1
Circle 72.7
Facial hair 71.9
Beard 69.6
Moustache 67.3
Formal wear 66.1
Monochrome 63.7

Microsoft
created on 2022-01-08

text 100
book 96.2
person 94.2
human face 93.7
man 92.9
clothing 81.9
handwriting 75.6
drawing 64.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 81.5%
Sad 6.9%
Confused 5.4%
Angry 4%
Surprised 0.8%
Happy 0.6%
Disgusted 0.6%
Fear 0.2%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 72.9%

Captions

Microsoft

a close up of a book 52.8%
close up of a book 49%
a hand holding a book 47.2%

Text analysis

Amazon

June
Peymouth,
Russell.
June 13th33
Peymouth, mass-
A. Russell.
mass-
A.
13th33

Google

A. Qullell- June 19t-47. Pymo utth, Mall-
A.
Qullell-
June
19t-47.
Pymo
utth,
Mall-