Human Generated Data

Title

James Stevenson Hall, Troy, New York (1835-?)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2060

Human Generated Data

Title

James Stevenson Hall, Troy, New York (1835-?)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2060

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Text 98.5
Art 89.7
Handwriting 78.7
Face 75.7
Painting 72.3
Drawing 64.3
Photography 62.7
Photo 62.7
Portrait 60.7

Clarifai
created on 2023-10-25

one 99.5
adult 97.9
portrait 97.8
people 97.6
music 97
man 96.9
art 96.8
no person 96.5
wear 95.9
two 95.8
retro 93.3
musician 93
sculpture 90.9
veil 85.6
illustration 84.7
facial expression 84.4
old 81
festival 80.6
vintage 79.6
instrument 79.1

Imagga
created on 2022-01-08

money 30.6
currency 28.7
cash 22.9
finance 21.1
dollar 20.4
art 18.5
bill 17.1
bank 17
financial 16.9
planet 15.8
business 15.2
close 14.3
vintage 14.2
banking 13.8
us 13.5
wealth 13.5
paper 12.5
black 12.1
dollars 11.6
coin 11.4
design 11.3
phonograph record 11.3
moon 11.2
old 11.1
love 11
card 10.8
representation 10.8
one 10.4
graphic 10.2
closeup 10.1
frame 10
retro 9.8
hundred 9.7
map 9.6
amulet 9.6
pay 9.6
object 9.5
symbol 9.4
global 9.1
silhouette 9.1
cartoon 8.9
coins 8.7
holiday 8.6
graphics 8.6
celestial body 8.5
rich 8.4
sign 8.3
note 8.3
device 8.2
pattern 8.2
drawing 8.1
world 8.1
banknote 7.8
creation 7.7
grunge 7.7
charm 7.6
element 7.4
style 7.4
decoration 7.1
reflection 7

Google
created on 2022-01-08

Facial expression 93.3
Handwriting 90.8
Oval 81.4
Art 80.1
Font 77.8
People 77.7
Collar 76.6
Vintage clothing 74.8
Beard 74.2
Suit 73.6
Tints and shades 73.6
Blazer 73.2
Signature 71.7
Facial hair 71.2
Formal wear 69
Collectable 68.3
Paper 67.3
Paper product 65.5
Moustache 64.6
Stock photography 63.3

Microsoft
created on 2022-01-08

text 99.8
handwriting 96.9
book 94.2
letter 86.5
human face 86.1
person 84
man 79.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 93.7%
Confused 2.5%
Sad 1.9%
Angry 0.9%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 72.3%

Categories

Imagga

paintings art 99.3%

Captions

Microsoft
created on 2022-01-08

a close up of a book 40.9%
close up of a book 37%
a hand holding a book 36.9%

Text analysis

Amazon

Hall
Aug
9th
Aug 9th 1835
S.
NY.
y ames S. Hall
1835
ames
y
Trug NY.
Trug

Google

Sames I s Hall Aug g4 1835 NS.
Sames
I
s
Hall
Aug
g4
NS.
1835