Human Generated Data

Title

Untitled (woman with string instrument)
Date

c. 1875
People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.21

Human Generated Data

Title

Untitled (woman with string instrument)

People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911

Date

c. 1875

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.21

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 98.5
Human 98.5
Leisure Activities 96.1
Musical Instrument 94.2
Banjo 92.9
Lute 90.1
Guitar 77.5

Clarifai
created on 2018-03-16

people 99.5
woman 99.2
adult 98.5
one 97
wear 96.5
art 96
painting 95.9
portrait 95.2
veil 93.5
illustration 92.9
music 92.4
man 90.3
dress 88.8
girl 86.2
indoors 83.8
fashion 82.6
retro 82.4
two 82
print 78.8
sit 78.5

Imagga
created on 2018-03-16

vintage 34
money 30.6
old 27.9
currency 27.8
retro 25.4
cash 24.7
book jacket 24.7
paper 23.5
envelope 23.4
finance 21.1
dollar 20.4
jacket 20.1
stamp 19.5
letter 19.3
mail 19.1
symbol 18.9
business 18.8
bill 18.1
postmark 17.7
banking 17.5
covering 17.2
grunge 17
bank 17
book 16
financial 16
dollars 15.5
aged 15.4
savings 14.9
circa 14.8
postage 14.7
wrapping 14.6
wealth 14.4
blackboard 14
ancient 13.8
shows 13.8
note 13.8
printed 13.8
postal 13.7
close 13.7
one 13.4
post 13.4
texture 13.2
art 13.2
message 12.8
black 12.7
icon 12.7
product 12.3
wall 12
culture 12
structure 12
memorial 11.9
photograph 11.8
brass 11.7
banknote 11.6
hundred 11.6
creation 11.3
antique 11.3
investment 11
masterpiece 10.9
chalkboard 10.8
closeup 10.8
banknotes 10.8
binding 10.6
card 10.5
exchange 10.5
success 10.5
rich 10.2
painter 10.1
known 9.9
philately 9.9
states 9.7
us 9.6
notes 9.6
painted 9.5
blank 9.4
economy 9.3
museum 9.1
global 9.1
office 9.1
portrait 9.1
renaissance 8.8
paintings 8.8
artist 8.7
finances 8.7
fine 8.6
head 8.4
doormat 8.4
church 8.3
container 8.3
market 8
post mail 7.9
zigzag 7.9
fame 7.9
stamps 7.9
delivery 7.8
bills 7.8
frame 7.7
cutting 7.7
communications 7.7
unique 7.6
sign 7.5
mug shot 7.5
board 7.4
religion 7.2

Google
created on 2018-03-16

art 85.5
picture frame 77.6

Microsoft
created on 2018-03-16

black 68
old 56.9
gallery 52
posing 45
picture frame 26.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-25
Gender Female, 82.1%
Confused 2%
Surprised 0.3%
Happy 0.1%
Angry 2%
Disgusted 0.1%
Sad 78.4%
Calm 17.1%

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Guitar 77.5%

Categories

Imagga

paintings art 99.3%
streetview architecture 0.5%
people portraits 0.1%

Captions

Microsoft
created on 2018-03-16

an old photo of a person 77.9%
a black and white photo of a person 64.8%
old photo of a person 64.7%

Text analysis

Amazon

4r
HHI