Human Generated Data

Title

Henry Jacob Bigelow (1818-1890) (seated)

Date

c. 1854

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 4.1979

Human Generated Data

Title

Henry Jacob Bigelow (1818-1890) (seated)

People

Artist: Unidentified Artist,

Date

c. 1854

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 4.1979

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Human 98.4
Person 98.4
Painting 97.6
Art 97.6
Apparel 76.1
Clothing 76.1
Drawing 66.4
Portrait 62.6
Photo 62.6
Face 62.6
Photography 62.6
Text 60.6

Clarifai
created on 2018-04-18

people 100
one 99.8
adult 99.8
portrait 99.6
man 99.3
painting 98.9
art 98.6
leader 98.6
print 98.5
facial hair 97.8
profile 93.4
side view 93.4
religion 92.4
veil 92.1
scientist 91.9
illustration 89.7
wear 89.2
aura 87.7
lid 87.5
saint 87

Imagga
created on 2018-04-18

phonograph record 41.5
currency 31.4
money 29.8
dollar 26.9
cash 25.6
shield 24.8
toilet seat 24.3
finance 23.6
business 22.5
financial 21.4
banking 21.1
paper 20.4
armor 20
art 19.6
seat 19.5
bill 19
wealth 18.8
one 17.9
bank 17.9
banknote 17.5
protective covering 16.6
close 16
vintage 15.7
dollars 15.4
furniture 15
closeup 14.8
church 14.8
us 14.4
religion 14.3
savings 14
covering 13.9
rich 12.1
economy 12
old 11.8
pay 11.5
exchange 11.4
detail 11.3
investment 11
mosaic 11
symbol 10.8
face 10.6
stamp 10.6
furnishing 10.5
antique 10.4
icon 10.3
color 10
masterpiece 9.9
painter 9.8
finances 9.6
mail 9.6
faith 9.6
god 9.6
culture 9.4
religious 9.4
portrait 9.1
concepts 8.9
postmark 8.9
postage 8.8
bible 8.8
banknotes 8.8
bills 8.7
man 8.7
hundred 8.7
holy 8.7
profit 8.6
colorful 8.6
post 8.6
letter 8.2
global 8.2
franklin 7.9
president 7.9
postal 7.8
funds 7.8
black 7.8
envelope 7.8
museum 7.8
golden 7.7
saint 7.7
payment 7.7
spirituality 7.7
loan 7.7
fine 7.6
note 7.3

Google
created on 2018-04-18

Microsoft
created on 2018-04-18

old 94.9
person 88.3
older 35.3
painting 15.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.7%
Disgusted 1.9%
Confused 3.1%
Calm 76.9%
Angry 11%
Surprised 2.3%
Sad 3.9%
Happy 0.8%

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 97.6%

Captions