Human Generated Data

Title

Thomas Hart Benton (1782-1858)

Date

c. 1850

People

Artist: J.H. Whitehurst Galleries, American active 1850s-1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.8

Human Generated Data

Title

Thomas Hart Benton (1782-1858)

People

Artist: J.H. Whitehurst Galleries, American active 1850s-1860s

Date

c. 1850

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Human 94.4
Person 94.4
Painting 93.5
Art 93.5
Window 77.2
Text 65.2
Porthole 65.2
Face 64.3
Photo 64.3
Portrait 64.3
Photography 64.3
Plaque 56.5
Sphere 55.2

Clarifai
created on 2021-04-03

art 98
dirty 97.6
people 97.1
old 97.1
painting 96.3
retro 96.2
portrait 95.9
gold 95.1
vintage 93.8
picture frame 93.3
one 92.3
antique 89.2
desktop 85.9
man 83.9
wear 83.8
margin 81.6
reflection 81.5
no person 81
mirror 74.6
museum 72.1

Imagga
created on 2021-04-03

shield 61.3
armor 48.5
protective covering 37.2
currency 34.1
money 34
dollar 30.6
cash 27.5
amulet 27.3
finance 27
covering 26.8
paper 26.7
vintage 24.8
art 24.4
financial 23.2
one 23.1
old 22.3
charm 21.6
business 21.3
banking 20.2
bank 19.7
close 19.4
wealth 18.9
us 17.4
post 17.2
bill 17.1
religion 17
closeup 16.8
push button 16.6
mail 16.3
culture 16.2
masterpiece 15.8
postmark 15.8
postage 15.7
banknote 15.5
stamp 15.5
dollars 15.5
icon 15
savings 14.9
symbol 14.8
painter 14.8
church 14.8
ingot 14.1
gold 14
letter 13.8
postal 13.7
museum 13.6
hundred 13.6
exchange 13.4
antique 13.2
god 12.4
rich 12.1
office 12
investment 11.9
paintings 11.7
delivery 11.7
finances 11.6
fine 11.4
face 11.4
ancient 11.2
golden 11.2
economy 11.1
note 11
global 10.9
block 10.9
frame 10.9
known 10.9
shows 10.8
printed 10.8
renaissance 10.8
envelope 10.7
retro 10.6
artist 10.6
pay 10.5
detail 10.5
black 10.2
decoration 10.1
post mail 9.9
zigzag 9.9
fame 9.9
bible 9.8
portrait 9.7
cutting 9.7
loan 9.6
communications 9.6
profit 9.6
painted 9.5
unique 9.5
mosaic 9
franklin 8.9
pattern 8.2
history 8.1
success 8
concepts 8
stamps 7.9
design 7.9
funds 7.8
banknotes 7.8
orthodox 7.8
architecture 7.8
bills 7.8
invest 7.7
holy 7.7
saint 7.7
payment 7.7
coin 7.6
religious 7.5
commerce 7.5
number 7.5
historic 7.3
market 7.1

Google
created on 2021-04-03

Head 97.4
Picture frame 96.9
Chin 96.7
Art 87
Painting 82.7
Oval 78.7
Rectangle 78.7
Visual arts 71.9
Collectable 68.2
Circle 66.2
Stock photography 65.3
History 64.4
Portrait 61.8
Event 60.4
Illustration 60.2
Antique 60.2
Metal 59.4
Self-portrait 58.9
Collection 53.5
Vintage clothing 51.6

Microsoft
created on 2021-04-03

human face 95.7
person 93.4
text 92.5
indoor 89.4
old 51.3
painting 21.6
picture frame 17.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-69
Gender Male, 97.4%
Calm 85.9%
Sad 11.1%
Confused 1.7%
Angry 0.7%
Surprised 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.4%
Painting 93.5%

Captions

Microsoft

a clock sitting in front of a mirror posing for the camera 44%
a clock sitting in front of a mirror 40.3%
Thomas Hart Benton sitting in front of a mirror posing for the camera 40.2%