Human Generated Data

Title

Horatio James Gilbert, Taunton, Massachusetts (1837-1901)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1987

Human Generated Data

Title

Horatio James Gilbert, Taunton, Massachusetts (1837-1901)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Accessory 99.3
Tie 99.3
Accessories 99.3
Person 98.8
Human 98.8
Text 98.6
Overcoat 97.2
Clothing 97.2
Coat 97.2
Suit 97.2
Apparel 97.2
Handwriting 84.9
Tuxedo 79.3
Photo 60.1
Photography 60.1
Art 58.1
Drawing 56.6
Signature 55.3
Autograph 55.3

Imagga
created on 2022-01-08

hat 28.9
sombrero 28.9
currency 24.2
money 23.8
headdress 20.6
finance 16
cash 15.5
clothing 15
dollar 14.8
business 14.6
wealth 14.3
bank 14.3
bill 14.2
symbol 14.1
banking 13.8
art 13.4
financial 13.3
paper 13.3
amulet 13.2
close 12
design 11.8
closeup 11.4
decoration 11.3
card 10.6
one 10.4
charm 10.4
man 10.1
holiday 10
old 9.7
banknote 9.7
us 9.6
percussion instrument 9.6
gold 9
dollars 8.7
museum 8.6
person 8.5
retro 8.2
celebration 8
love 7.9
hundred 7.7
mail 7.6
antique 7.6
vintage 7.5
covering 7.5
sign 7.5
savings 7.4
musical instrument 7.4
note 7.3
global 7.3
gong 7.2
success 7.2
cone 7.2
portrait 7.1
silver 7.1

Google
created on 2022-01-08

Jaw 87.9
Oval 83.9
Collar 82.2
Facial hair 81.3
Handwriting 78.6
Suit 76.9
Tints and shades 76.3
Vintage clothing 74.4
Font 74.2
Tie 72.6
Moustache 72
Blazer 69.9
Formal wear 69.4
Circle 67.5
History 65.8
Collectable 64.6
Art 64.4
Signature 62.1
Illustration 60.5
Paper product 60.1

Microsoft
created on 2022-01-08

text 99.7
human face 88.9
man 88.7
person 86.4
handwriting 75.1
clothing 67.6
letter 53.1
necktie 51.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 97.7%
Angry 0.9%
Confused 0.5%
Surprised 0.3%
Sad 0.3%
Happy 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.3%
Person 98.8%

Captions

Microsoft

a close up of a book 38.5%
close up of a book 34.8%
a hand holding a book 34.6%

Text analysis

Amazon

of
Yaunton
1897
Horatin of Gilbert
Gilbert
July ?! 1897
Horatin
July ?!

Google

Pauntou.
s?
1837
July
Pauntou. July s? 1837