Human Generated Data

Title

The Drinker and His Wife Reading a Letter
Date

17th century
People

Artist: Frans van der Steen, Dutch 1626 - 1679

Artist after: David Teniers II, Flemish 1610 - 1690
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Melvin R. Seiden, S5.10.2

Human Generated Data

Title

The Drinker and His Wife Reading a Letter

People

Artist: Frans van der Steen, Dutch 1626 - 1679

Artist after: David Teniers II, Flemish 1610 - 1690

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-03

Human 96.2
Person 96.2
Art 91.7
Painting 83.9

Clarifai
created on 2018-03-24

people 100
print 99.4
engraving 98.9
adult 98.4
art 98.2
one 98.1
illustration 97.5
portrait 96.9
man 96.7
two 93.7
etching 91.8
leader 89.7
lithograph 88.7
old 88
administration 87.8
furniture 87.2
sit 85.1
writer 83.3
affection 82.9
scientist 82.7

Imagga
created on 2018-03-24

money 40
currency 37.7
cash 37.5
dollar 34.4
book jacket 33.1
finance 27.9
bank 27.8
banking 27.6
bill 26.6
financial 25.9
jacket 25.8
paper 25.4
wealth 25.1
art 24.1
dollars 23.2
close 22.8
one 22.4
business 21.3
savings 20.5
us 20.3
mosaic 19.7
wrapping 19.6
religion 17
bills 16.5
hundred 16.5
ancient 16.4
culture 16.2
rich 15.8
franklin 15.7
banknotes 15.7
pay 15.4
exchange 15.3
face 14.9
vintage 14.9
banknote 14.6
jigsaw puzzle 14.5
stamp 14.5
finances 14.5
covering 14.5
creation 14.5
loan 14.4
mail 14.4
closeup 14.2
statue 13.8
postmark 13.8
envelope 13.8
printed 13.8
puzzle 13.5
god 13.4
note 12.9
masterpiece 12.8
letter 12.8
postage 12.8
old 12.5
portrait 12.3
economy 12.1
church 12
investment 11.9
shows 11.8
postal 11.8
funds 11.8
museum 11.6
history 11.6
symbol 11.5
newspaper 11.4
capital 11.4
product 11.2
circa 10.9
market 10.7
spirituality 10.6
notes 10.6
profit 10.5
fine 10.5
religious 10.3
commerce 10.3
famous 10.2
temple 10
painter 9.8
sculpture 9.8
economic 9.7
states 9.7
holy 9.6
payment 9.6
icon 9.5
sketch 9.5
architecture 9.5
fountain 9.2
concepts 8.9
known 8.9
success 8.9
president 8.8
renaissance 8.8
game 8.8
man 8.8
paintings 8.8
artist 8.7
sales 8.7
golden 8.6
painted 8.6
post 8.6
unique 8.5
post mail 7.9
zigzag 7.9
black 7.9
fame 7.9
delivery 7.8
value 7.8
cutting 7.7
price 7.7
communications 7.7
structure 7.6
united 7.6
historic 7.3
global 7.3
people 7.3
office 7.2
stone 7.2
male 7.1
representation 7.1

Google
created on 2018-03-24

photograph 94.8
mammal 92.3
art 88.1
human behavior 84.7
vintage clothing 75.4
black and white 72.5
human 69.8
portrait 67.3
illustration 65.2
artwork 59.7
drawing 59.1
visual arts 58.7
history 54.2
stock photography 53

Microsoft
created on 2018-03-24

text 100
book 99.9

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 49-69
Gender Male, 92.1%
Confused 3%
Angry 1.7%
Calm 6.3%
Sad 82.9%
Disgusted 0.8%
Happy 3.5%
Surprised 1.9%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Surprised 1.9%
Calm 5%
Confused 3.3%
Angry 11.5%
Sad 74.5%
Disgusted 1.8%
Happy 1.9%

Microsoft Cognitive Services

Age 65
Gender Male

Feature analysis

Amazon

Person 96.2%
Painting 83.9%

Captions

Microsoft

a person holding a book 56.8%
a person sitting on top of a book 44.9%
a person sitting on a book 42.9%

Text analysis

Amazon

Abraham
Teniers
D. Teniers inu. Abraham Teniers exeudit
exeudit
yan
F. van Steenfe.
inu.
D.
F. van Steenfe. F yan
F

Google

ete
E.
Steen
Teniers
ualit
van
fe
D. Teniers inu Abraham Teniers ete ualit E. van Steen fe
D.
inu
Abraham