Human Generated Data

Title

Rubens
Date

18th century
People

Artist: Eliza Maréchal, French 18th century

Artist after: Peter Paul Rubens, Flemish 1577 - 1640
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R13902

Human Generated Data

Title

Rubens

People

Artist: Eliza Maréchal, French 18th century

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R13902

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Human 98.9
Person 98.9
Art 94.6
Clothing 93.9
Apparel 93.9
Hat 93.9
Painting 92.3
Text 63

Clarifai
created on 2019-11-09

people 99.8
portrait 99
adult 98.6
one 98.3
art 98
print 97.9
wear 96.4
painting 94.6
man 92
engraving 91
woman 90.9
illustration 88.4
music 88.1
retro 83.7
writer 83.5
lid 83.4
leader 83.4
facial hair 81.1
antique 79.7
veil 79

Imagga
created on 2019-11-09

book jacket 82.9
jacket 65.5
wrapping 49
mug shot 45
money 40.9
photograph 38.7
currency 35
cash 34.8
covering 33.7
dollar 30.6
representation 30.2
paper 28.3
banking 26.7
creation 26.4
bank 26
bill 25.7
finance 25.4
close 22.8
business 22.5
wealth 22.5
one 21.7
financial 20.5
dollars 18.4
exchange 17.2
savings 16.8
vintage 16.6
us 16.4
pay 16.3
hundred 15.5
portrait 14.9
economy 14.8
franklin 14.8
old 14.6
banknote 14.6
man 14.1
letter 13.8
banknotes 13.7
stamp 13.6
finances 13.5
loan 13.4
mail 13.4
rich 13
postmark 12.8
closeup 12.8
symbol 12.1
face 12.1
painter 12
envelope 12
investment 11.9
postage 11.8
people 11.7
bills 11.7
states 11.6
market 11.6
payment 11.5
product 11.1
printed 10.8
postal 10.8
male 10.6
notes 10.6
art 10.5
success 10.5
culture 10.3
note 10.1
retro 9.8
economic 9.7
black 9.6
price 9.6
profit 9.6
fine 9.5
united 9.5
ancient 9.5
commerce 9.3
sign 9
office 8.9
circa 8.9
shows 8.9
twenty 8.9
antique 8.7
post 8.6
capital 8.5
stock 8.4
adult 8.4
book 8.4
museum 7.9
masterpiece 7.9
known 7.9
president 7.9
funds 7.8
wages 7.8
person 7.8
paintings 7.8
cutting 7.7
communications 7.7
painted 7.6
unique 7.6
human 7.5
number 7.5
global 7.3
body 7.2
religion 7.2

Google
created on 2019-11-09

Photograph 95.8
Picture frame 82.3
Art 80.3
Portrait 80.1
Painting 71.9
Room 65.7
Illustration 65.5
Visual arts 64.9
Photography 62.4
Gentleman 61.7
Stock photography 59.4
Collection 54
Vintage clothing 53.5

Microsoft
created on 2019-11-09

human face 98.3
gallery 96.2
person 95.9
text 95.1
clothing 94.4
drawing 90.7
room 88.5
scene 82.2
painting 71.7
man 69
old 68.1
sketch 67.1
portrait 62.1
handwriting 50.6
posing 44.8
picture frame 21

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Male, 98.6%
Angry 1.5%
Sad 14.2%
Calm 40.4%
Confused 38.5%
Surprised 2%
Happy 0.6%
Fear 1.5%
Disgusted 1.3%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Hat 93.9%

Categories

Imagga

paintings art 98.7%

Captions

Microsoft
created on 2019-11-09

a vintage photo of a person 74.8%
an old photo of a person 73.7%
a vintage photo of a person in a room 70.3%

Text analysis

Amazon

RUBENS.
te
dla.
Rayal
Lpnis te atlean dla. Masec Rayal
atlean
Masec
Lpnis
tethe
d
d 2 tethe
2

Google

RUBENS pis lIublean d Musi Reyal
RUBENS
pis
lIublean
d
Musi
Reyal