Human Generated Data

Title

Robert Bruce Gelston, Baltimore (1837-1866)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1989

Human Generated Data

Title

Robert Bruce Gelston, Baltimore (1837-1866)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Text 99.8
Person 97.7
Human 97.7
Handwriting 95.9
Painting 77.2
Art 77.2
Signature 71.4
Autograph 71.4
Photography 60.7
Photo 60.7

Imagga
created on 2022-01-08

money 26.3
currency 24.2
amulet 23
art 20.2
cash 20.1
charm 18.2
finance 17.7
dollar 17.6
drawing 17.4
financial 16
close 15.4
bill 14.3
us 13.5
bank 13.4
sketch 13.3
vintage 13.2
moon 13
closeup 12.8
old 12.5
planet 12.1
paper 11.8
dollars 11.6
retro 11.5
style 11.1
grunge 11.1
banking 11
wealth 10.8
symbol 10.8
representation 10.6
coin 10.5
black 10.4
business 9.7
banknote 9.7
exchange 9.5
love 9.5
antique 9.4
one 8.9
pattern 8.9
object 8.8
graphic 8.7
pay 8.6
design 8.5
silhouette 8.3
note 8.3
graphics 8
shape 8
banknotes 7.8
map 7.7
decoration 7.7
texture 7.6
frame 7.5
element 7.4
fruit 7.4
cartoon 7.1
gong 7

Google
created on 2022-01-08

Handwriting 90.3
Collar 82.2
Oval 81.1
Font 78.9
Signature 74.7
Vintage clothing 74.4
Art 73.6
Sleeve 72.1
Collectable 69.6
Autograph 68.9
Moustache 65.9
Facial hair 62.6
Stock photography 62
Circle 60.5
Paper product 59.9
Illustration 58.8
Paper 58.6
History 55.4
Retro style 53.3
Portrait 52.4

Microsoft
created on 2022-01-08

text 98.3
handwriting 95.8
book 91.8
human face 90.7
letter 88.9
person 84.3
man 76.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Confused 43.1%
Calm 38.6%
Angry 15.2%
Sad 1.3%
Surprised 0.9%
Disgusted 0.4%
Fear 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 77.2%

Captions

Microsoft

a close up of a book 52.4%
close up of a book 47.5%
a close up of text on a book 41.6%

Text analysis

Amazon

Je
Your Je
Ballimire
Your