Human Generated Data

Title

Frank Howard Shorey, Dedham, Massachusetts (1837-1862)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2051

Human Generated Data

Title

Frank Howard Shorey, Dedham, Massachusetts (1837-1862)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Text 98.7
Person 98.7
Human 98.7
Tie 94.1
Accessories 94.1
Accessory 94.1
Suit 90.9
Clothing 90.9
Overcoat 90.9
Coat 90.9
Apparel 90.9
Handwriting 81.9
Art 68.7
Label 63.4
Signature 57.3
Autograph 57.3
Tuxedo 56.1

Imagga
created on 2022-01-08

money 28.1
currency 27.8
cash 20.1
finance 19.4
bank 18
object 17.6
close 16.5
banking 15.6
coin 14.3
round 13.8
coins 13.5
china 13.5
pay 13.4
old 13.2
dollar 13
financial 12.5
holiday 12.2
one 11.9
ball 11.4
vintage 11.2
planet 11.1
art 11
closeup 10.8
moon 10.1
us 9.6
bill 9.5
globe 9.3
dark 9.2
museum 9.1
business 9.1
porcelain 8.9
symbol 8.7
light 8.7
ornament 8.6
black 8.6
mug shot 8.5
tree 8.5
retro 8.2
decoration 8.2
cartoon 8
creation 8
representation 7.9
paper 7.9
design 7.8
banknote 7.8
ceramic ware 7.7
head 7.6
historical 7.5
map 7.5
silhouette 7.4
sphere 7.4
earth 7.3
global 7.3
metal 7.2
world 7.2
collection 7.2
wealth 7.2
celebration 7.2
glass 7.1
season 7

Google
created on 2022-01-08

Eyebrow 94.5
Facial expression 93.2
Oval 86.2
Collar 80.8
Beard 80
Facial hair 77.7
Art 77.5
Tints and shades 77
Vintage clothing 76.6
Font 74.4
Handwriting 73.8
Suit 73.3
Blazer 72.9
Moustache 71
Formal wear 70.6
Circle 63.1
Collectable 62.3
History 62
Monochrome 61.8
Paper product 61.4

Microsoft
created on 2022-01-08

text 99.8
book 95.7
man 91.8
person 90
human face 88.5
clothing 69.7
drawing 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 97.9%
Calm 90.9%
Sad 7.9%
Confused 0.4%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 94.1%

Captions

Microsoft

a close up of a book 32.9%
close up of a book 29.4%
a close up of a book cover 29.3%

Text analysis

Amazon

Boston
Frank
Nov.
2
H.
nd
Boston Nov. 2 nd 1857
Dedham
Frank H. Sherry.
1857
Sherry.

Google

Brekon Nar. 2 nd 1837.
Brekon
Nar.
2
nd
1837.