Human Generated Data

Title

John Homans, Jr, Boston (1836-1903)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2023

Human Generated Data

Title

John Homans, Jr, Boston (1836-1903)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2023

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Text 98.7
Overcoat 90.3
Coat 90.3
Suit 90.3
Clothing 90.3
Apparel 90.3
Handwriting 89.2
Accessory 80.2
Tie 80.2
Accessories 80.2
Painting 77.9
Art 77.9
Tie 66.4
Tuxedo 59.7
Signature 58.7
Autograph 58.7

Clarifai
created on 2023-10-25

one 99.7
portrait 99.7
people 99.5
adult 98.4
man 98.2
music 98.1
wear 97.6
two 97.4
art 96.6
facial expression 94.1
retro 93
musician 88.7
veil 88.3
sepia 87.9
mammal 86.2
no person 85.3
menswear 85.3
woman 84.1
dancing 83.2
child 81.1

Imagga
created on 2022-01-08

money 28
currency 26.9
cash 23.8
phonograph record 22.4
dollar 22.3
bill 20.9
finance 18.6
banking 18.4
one 17.9
financial 17.8
paper 17.3
business 17
bank 16.3
art 16.2
wealth 16.1
dollars 14.5
man 14.1
rich 13.9
representation 13.8
vintage 13.6
portrait 13.6
close 13.1
hat 12.8
closeup 12.8
hundred 12.6
old 12.5
us 12.5
person 11.8
people 11.7
savings 11.2
mug shot 10.9
device 10.9
pay 10.5
exchange 10.5
black 10.3
face 9.9
male 9.9
banknote 9.7
style 9.6
photograph 9.5
creation 9.3
drawing 9.2
note 9.2
dirty 9
human 9
franklin 8.9
banknotes 8.8
states 8.7
grunge 8.5
sombrero 8.4
dark 8.3
retro 8.2
card 8.2
antique 8.1
success 8
cartoon 8
men 7.7
finances 7.7
payment 7.7
commerce 7.5
economy 7.4
symbol 7.4
reflection 7.4
adult 7.1
love 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.7
human face 96.6
book 95.3
person 95
man 92.9
handwriting 89.5
clothing 85.9
old 57.9
photograph 56.9
letter 54.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 98.8%
Sad 0.7%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 80.2%
Painting 77.9%

Categories

Imagga

paintings art 99.4%

Captions

Microsoft
created on 2022-01-08

an old photo of a person 54.7%
a close up of a book 28.4%

Text analysis

Amazon

John
13
Nov
How
os
John How and for
13 os too
too
and for

Google

13
oslon
Nor
26
h H ou and 13 oslon Nor 26
h
H
ou
and