Human Generated Data

Title

Horace Pratt Tobey, Wareham, Massachusetts (1838-1918)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2064

Human Generated Data

Title

Horace Pratt Tobey, Wareham, Massachusetts (1838-1918)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Text 98.7
Suit 96.1
Clothing 96.1
Overcoat 96.1
Coat 96.1
Apparel 96.1
Handwriting 90.8
Tuxedo 70.4
Art 69.2
Drawing 62.8
Signature 60.5
Autograph 60.5
Photography 56.9
Photo 56.9

Imagga
created on 2022-01-08

planet 30
currency 28.7
money 27.2
finance 20.3
cash 20.1
puck 19.7
dollar 18.6
celestial body 18.1
disk 16.4
phonograph record 16.4
financial 16
banking 15.6
bank 15.4
black 14.5
bill 14.3
circle 13.7
close 13.7
coin 13.3
rich 13
old 12.5
vintage 12.5
one 11.9
moon 11.9
art 11.6
business 11.5
retro 11.5
symbol 11.4
economy 11.1
representation 10.9
stamp 10.9
wealth 10.8
pick 10.6
sign 10.5
mail 10.5
diagram 10.4
card 10
states 9.7
coins 9.6
pay 9.6
device 9.4
closeup 9.4
paper 9.4
postmark 8.9
metal 8.8
dollars 8.7
us 8.7
male 8.5
envelope 8.5
savings 8.4
drawing 8.3
silhouette 8.3
man 8.1
design 7.9
hundred 7.7
exchange 7.6
creation 7.6
graphics 7.6
head 7.6
map 7.5
person 7.4
object 7.3
earth 7.3
people 7.2
cartoon 7.1
icon 7.1
face 7.1
love 7.1
world 7.1

Google
created on 2022-01-08

Forehead 98.5
Chin 96.6
Eyebrow 94.4
Facial expression 93.2
Oval 88.6
Sleeve 85.3
Collar 83.3
Handwriting 80
Vintage clothing 77.5
Tints and shades 76.2
Facial hair 73.9
Font 73.2
Suit 72.8
Blazer 71.2
Art 69.4
Circle 68
Collectable 67.7
Moustache 67.7
Tie 66
History 65.4

Microsoft
created on 2022-01-08

text 99.9
human face 91.7
man 91.5
person 88.6
clothing 67.2
drawing 53.2
handwriting 53.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 97.7%
Sad 1.3%
Confused 0.4%
Angry 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

text 19.7%

Text analysis

Amazon

P.
1838
Wareham,
the
Wareham, llafs
I any the 1838
Horace P. Soberg
Horace
llafs
I any
Soberg

Google

%6orace P. Warcham, llaft. any4 1838
%6orace
P.
Warcham,
llaft.
any4
1838