Human Generated Data

Title

Frank Howard Shorey, Dedham, Massachusetts (1837-1862)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2051

Human Generated Data

Title

Frank Howard Shorey, Dedham, Massachusetts (1837-1862)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2051

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Text 98.7
Person 98.7
Human 98.7
Tie 94.1
Accessories 94.1
Accessory 94.1
Suit 90.9
Clothing 90.9
Overcoat 90.9
Coat 90.9
Apparel 90.9
Handwriting 81.9
Art 68.7
Label 63.4
Autograph 57.3
Signature 57.3
Tuxedo 56.1

Clarifai
created on 2023-10-25

portrait 99.8
one 99.8
people 99.7
adult 99.5
man 99.3
wear 98.6
two 98.1
music 98
art 98
veil 96.4
mustache 93.6
profile 91.9
retro 91.7
side view 91.2
facial hair 90.7
lid 90.3
no person 90.2
facial expression 89.2
illustration 87.5
musician 87.2

Imagga
created on 2022-01-08

money 28.1
currency 27.8
cash 20.1
finance 19.4
bank 18
object 17.6
close 16.5
banking 15.6
coin 14.3
round 13.8
coins 13.5
china 13.5
pay 13.4
old 13.2
dollar 13
financial 12.5
holiday 12.2
one 11.9
ball 11.4
vintage 11.2
planet 11.1
art 11
closeup 10.8
moon 10.1
us 9.6
bill 9.5
globe 9.3
dark 9.2
museum 9.1
business 9.1
porcelain 8.9
symbol 8.7
light 8.7
ornament 8.6
black 8.6
mug shot 8.5
tree 8.5
retro 8.2
decoration 8.2
cartoon 8
creation 8
paper 7.9
representation 7.9
design 7.8
banknote 7.8
ceramic ware 7.7
head 7.6
historical 7.5
map 7.5
silhouette 7.4
sphere 7.4
earth 7.3
global 7.3
metal 7.2
world 7.2
collection 7.2
wealth 7.2
celebration 7.2
glass 7.1
season 7

Google
created on 2022-01-08

Eyebrow 94.5
Facial expression 93.2
Oval 86.2
Collar 80.8
Beard 80
Facial hair 77.7
Art 77.5
Tints and shades 77
Vintage clothing 76.6
Font 74.4
Handwriting 73.8
Suit 73.3
Blazer 72.9
Moustache 71
Formal wear 70.6
Circle 63.1
Collectable 62.3
History 62
Monochrome 61.8
Paper product 61.4

Microsoft
created on 2022-01-08

text 99.8
book 95.7
man 91.8
person 90
human face 88.5
clothing 69.7
drawing 51.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 97.9%
Calm 90.9%
Sad 7.9%
Confused 0.4%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 94.1%

Categories

Imagga

paintings art 89.7%
food drinks 7.4%
people portraits 2.8%

Captions

Microsoft
created on 2022-01-08

a close up of a book 32.9%
close up of a book 29.4%
a close up of a book cover 29.3%

Text analysis

Amazon

Boston
Frank
Nov.
2
H.
nd
Boston Nov. 2 nd 1857
Dedham
Frank H. Sherry.
1857
Sherry.

Google

2
nd
1837.
Brekon Nar. 2 nd 1837.
Brekon
Nar.