Human Generated Data

Title

John Homans, Jr, Boston (1836-1903)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2023

Human Generated Data

Title

John Homans, Jr, Boston (1836-1903)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Text 98.7
Suit 90.3
Clothing 90.3
Overcoat 90.3
Coat 90.3
Apparel 90.3
Handwriting 89.2
Tie 80.2
Accessories 80.2
Accessory 80.2
Painting 77.9
Art 77.9
Tie 66.4
Tuxedo 59.7
Signature 58.7
Autograph 58.7

Imagga
created on 2022-01-08

money 28
currency 26.9
cash 23.8
phonograph record 22.4
dollar 22.3
bill 20.9
finance 18.6
banking 18.4
one 17.9
financial 17.8
paper 17.3
business 17
bank 16.3
art 16.2
wealth 16.1
dollars 14.5
man 14.1
rich 13.9
representation 13.8
vintage 13.6
portrait 13.6
close 13.1
hat 12.8
closeup 12.8
hundred 12.6
old 12.5
us 12.5
person 11.8
people 11.7
savings 11.2
mug shot 10.9
device 10.9
pay 10.5
exchange 10.5
black 10.3
face 9.9
male 9.9
banknote 9.7
style 9.6
photograph 9.5
creation 9.3
drawing 9.2
note 9.2
dirty 9
human 9
franklin 8.9
banknotes 8.8
states 8.7
grunge 8.5
sombrero 8.4
dark 8.3
retro 8.2
card 8.2
antique 8.1
success 8
cartoon 8
men 7.7
finances 7.7
payment 7.7
commerce 7.5
economy 7.4
symbol 7.4
reflection 7.4
adult 7.1
love 7.1

Google
created on 2022-01-08

Oval 84.1
Handwriting 84
Collar 83.5
Facial hair 77.5
Tints and shades 76.5
Suit 75.6
Vintage clothing 73.7
Art 72.7
Moustache 70.1
Collectable 69.6
Formal wear 68.2
Font 66.9
Blazer 63.9
Stock photography 62.6
History 62.2
Beard 62
Paper product 58.9
Signature 56.9
Retro style 54.9
Portrait 54.9

Microsoft
created on 2022-01-08

text 99.7
human face 96.6
book 95.3
person 95
man 92.9
handwriting 89.5
clothing 85.9
old 57.9
photograph 56.9
letter 54.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 98.8%
Sad 0.7%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 80.2%
Painting 77.9%

Captions

Microsoft

an old photo of a person 54.7%
a close up of a book 28.4%

Text analysis

Amazon

John
13
Nov
How
os
John How and for
13 os too
too
and for

Google

h H ou and 13 oslon Nor 26
h
H
ou
and
13
oslon
Nor
26