Human Generated Data

Title

Horatio James Gilbert, Taunton, Massachusetts (1837-1901)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1987

Human Generated Data

Title

Horatio James Gilbert, Taunton, Massachusetts (1837-1901)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1987

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Tie 99.3
Accessories 99.3
Accessory 99.3
Person 98.8
Human 98.8
Text 98.6
Suit 97.2
Clothing 97.2
Overcoat 97.2
Coat 97.2
Apparel 97.2
Handwriting 84.9
Tuxedo 79.3
Photography 60.1
Photo 60.1
Art 58.1
Drawing 56.6
Signature 55.3
Autograph 55.3

Clarifai
created on 2023-10-25

one 99.3
people 99.1
man 99
portrait 98.8
adult 98.4
wear 96.7
two 95.8
music 94.7
art 92.9
veil 91.7
woman 90.8
musician 88.6
lid 86.7
no person 86.4
facial expression 85.9
retro 85.4
side view 82.5
fashion 80.8
illustration 79.3
leader 79

Imagga
created on 2022-01-08

hat 28.9
sombrero 28.9
currency 24.2
money 23.8
headdress 20.6
finance 16
cash 15.5
clothing 15
dollar 14.8
business 14.6
wealth 14.3
bank 14.3
bill 14.2
symbol 14.1
banking 13.8
art 13.4
financial 13.3
paper 13.3
amulet 13.2
close 12
design 11.8
closeup 11.4
decoration 11.3
card 10.6
one 10.4
charm 10.4
man 10.1
holiday 10
old 9.7
banknote 9.7
us 9.6
percussion instrument 9.6
gold 9
dollars 8.7
museum 8.6
person 8.5
retro 8.2
celebration 8
love 7.9
hundred 7.7
mail 7.6
antique 7.6
vintage 7.5
covering 7.5
sign 7.5
savings 7.4
musical instrument 7.4
note 7.3
global 7.3
gong 7.2
success 7.2
cone 7.2
portrait 7.1
silver 7.1

Google
created on 2022-01-08

Jaw 87.9
Oval 83.9
Collar 82.2
Facial hair 81.3
Handwriting 78.6
Suit 76.9
Tints and shades 76.3
Vintage clothing 74.4
Font 74.2
Tie 72.6
Moustache 72
Blazer 69.9
Formal wear 69.4
Circle 67.5
History 65.8
Collectable 64.6
Art 64.4
Signature 62.1
Illustration 60.5
Paper product 60.1

Microsoft
created on 2022-01-08

text 99.7
human face 88.9
man 88.7
person 86.4
handwriting 75.1
clothing 67.6
letter 53.1
necktie 51.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 97.7%
Angry 0.9%
Confused 0.5%
Surprised 0.3%
Sad 0.3%
Happy 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.3%
Person 98.8%

Categories

Imagga

paintings art 99%

Captions

Microsoft
created on 2022-01-08

a close up of a book 38.5%
close up of a book 34.8%
a hand holding a book 34.6%

Text analysis

Amazon

of
Yaunton
1897
Horatin of Gilbert
Gilbert
July ?! 1897
Horatin
July ?!

Google

Pauntou. July s? 1837
Pauntou.
July
s?
1837