Human Generated Data

Title

Riley Allen Brick, New York (1837-1889)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1991

Human Generated Data

Title

Riley Allen Brick, New York (1837-1889)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Clothing 93.7
Apparel 93.7
Overcoat 92.1
Coat 92.1
Text 88.1
Face 87.1
Label 77.5
Accessories 69.4
Accessory 69.4
Photography 67.1
Photo 67.1
Portrait 66.1
Head 65.4
Suit 64.8
Tie 61.4
Art 60.7
Man 59.5
Tie 52.1

Imagga
created on 2022-01-08

hat 43.4
headdress 27.9
cowboy hat 24.9
money 23
sombrero 20.9
clothing 20.1
currency 18.8
finance 15.2
dollar 13.9
cash 13.7
close 13.7
financial 13.4
one 12.7
covering 12.6
object 11.7
bill 11.4
old 11.1
black 10.8
coin 10.5
vintage 10.1
art 9.9
world 9.8
us 9.6
consumer goods 9.5
paper 9.5
symbol 9.4
man 9.4
globe 9.3
bank 9.2
planet 9
wealth 9
metal 8.8
closeup 8.8
shiny 8.7
space 8.5
energy 8.4
economy 8.3
earth 8.3
sign 8.3
banking 8.3
device 8.1
silver 8
business 7.9
male 7.8
banknote 7.8
map 7.6
rich 7.4
portrait 7.1

Google
created on 2022-01-08

Handwriting 85.4
Collar 83.5
Sleeve 82
Oval 81.8
Facial hair 81.6
Suit 78.6
Blazer 77.8
Vintage clothing 77.7
Tints and shades 75.1
Font 74.9
Moustache 72.4
Signature 71.7
Collectable 68.5
Formal wear 68.1
History 64.8
Circle 64.1
Paper product 63.5
Paper 61.5
Beard 61.3
Art 60.3

Microsoft
created on 2022-01-08

text 99.8
man 95.9
person 94.2
human face 91.5
clothing 87

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 97.6%
Confused 1%
Surprised 0.5%
Sad 0.3%
Angry 0.2%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 64.8%
Tie 61.4%

Captions

Microsoft

a close up of a person holding a book 25.7%
a person holding a book 25.6%

Text analysis

Amazon

October
New
RtBrick
New York ch.y.
York
ch.y.
October the 1887
1887
the

Google

RtMrick Actober 183 Urew York ch. yo
RtMrick
Actober
183
Urew
York
ch.
yo