Human Generated Data

Title

Cavalier

Date

18th century

People

Artist: Jean-Pierre Norblin de la Gourdaine, French 1745 - 1830

Artist after: Frans Hals, Dutch 1581 - 1666

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1112NA

Human Generated Data

Title

Cavalier

People

Artist: Jean-Pierre Norblin de la Gourdaine, French 1745 - 1830

Artist after: Frans Hals, Dutch 1581 - 1666

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Clothing 99.8
Hat 99.8
Apparel 99.8
Person 97.4
Human 97.4
Art 92.2
Painting 92.2

Clarifai
created on 2019-11-09

people 99.9
print 99.8
lid 99.7
portrait 99.7
one 99.7
art 99.3
engraving 99.1
veil 98.9
adult 98.8
cape 98.2
illustration 96.3
wear 96
vintage 95.5
retro 94.7
bonnet 94.5
gown (clothing) 94.1
antique 94.1
painting 93.8
cap 93.7
lithograph 90.3

Imagga
created on 2019-11-09

sculpture 31.8
covering 29
money 26.4
art 25.9
statue 25.5
currency 25.1
cash 23.8
religion 22.4
dollar 20.4
mask 20.3
bill 20
bank 19.7
hat 17.9
painter 17.6
book jacket 17.5
banking 17.5
ancient 17.3
god 17.2
culture 17.1
finance 16.9
close 16.6
disguise 16.5
one 16.4
dollars 16.4
portrait 16.2
wealth 16.2
church 15.7
old 15.3
financial 15.2
cemetery 15
paper 14.9
bust 14.4
face 14.2
religious 14.1
sombrero 13.9
antique 13.9
jacket 13.6
clothing 13.6
us 13.5
history 13.4
historical 13.2
stone 13
golden 12.9
business 12.8
pay 12.5
closeup 12.1
banknote 11.7
figure 11.6
vintage 11.6
holy 11.6
symbol 11.5
man 11.4
museum 11.4
savings 11.2
architecture 11.1
historic 11
headdress 10.9
hundred 10.7
attire 10.5
representation 10.4
wrapping 10.3
rich 10.2
head 10.1
franklin 9.8
marble 9.7
finances 9.6
loan 9.6
person 9.3
carving 9.2
male 9.2
detail 8.9
president 8.8
banknotes 8.8
roman 8.8
prayer 8.7
spirituality 8.6
spiritual 8.6
mug shot 8.6
exchange 8.6
sketch 8.4
famous 8.4
economy 8.4
plastic art 8.3
gold 8.2
temple 8.2
icon 7.9
masterpiece 7.9
bills 7.8
pray 7.8
artist 7.7
payment 7.7
saint 7.7
faith 7.7
column 7.5
monument 7.5
consumer goods 7.4
note 7.4
building 7.1
market 7.1

Google
created on 2019-11-09

Lady 89.9
Portrait 83.2
Painting 82.9
Art 78.9
Self-portrait 76.4
Gentleman 73.5
Vintage clothing 72.5
Headgear 69.2
Illustration 60.2
Visual arts 59.3
Hat 54.3
Retro style 53.4
Style 51

Microsoft
created on 2019-11-09

human face 96.6
drawing 95.9
painting 95.4
text 94.8
sketch 94.7
hat 94.6
book 92.3
fashion accessory 86.2
clothing 85.7
person 85.5
portrait 81.2
fedora 58.2
art 53.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Male, 93.5%
Disgusted 0.1%
Sad 65.8%
Happy 0.1%
Calm 14.5%
Fear 17.3%
Surprised 0.5%
Angry 0.8%
Confused 0.9%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 97.4%
Painting 92.2%

Captions

Microsoft

a person wearing a black hat 65.5%
a person wearing a hat 65.4%
a person wearing a hat 65.3%