Human Generated Data

Title

Rembrandtii Effigies

Date

19th century

People

Artist: Giuseppe Longhi, Italian 1766 - 1831

Artist after: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12578

Human Generated Data

Title

Rembrandtii Effigies

People

Artist: Giuseppe Longhi, Italian 1766 - 1831

Artist after: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 98.9
Person 98.9
Art 96.2
Painting 88.9
Drawing 85.8
Text 74.8
Sketch 70.7
Face 67.3
Portrait 67.3
Photography 67.3
Photo 67.3

Clarifai
created on 2019-11-06

people 99.8
portrait 99.8
art 99.2
one 99.1
adult 98.9
print 98.1
painting 97
wear 96.3
engraving 94.3
leader 92.5
man 91.9
illustration 90.8
veil 90.4
woman 90.1
administration 87.7
writer 82.9
furniture 80
lid 79.5
music 76.5
facial hair 74.8

Imagga
created on 2019-11-06

money 43.4
currency 41.3
book jacket 40.7
cash 40.3
dollar 38.1
jacket 32.6
bank 30.7
bill 30.5
paper 30
finance 29.6
wealth 27
banking 26.7
binding 25.6
wrapping 24.1
close 23.4
dollars 23.2
financial 23.2
covering 22.9
business 21.9
one 21.7
savings 20.5
hundred 20.3
us 19.3
franklin 17.7
face 17.1
banknote 16.5
exchange 16.2
rich 15.8
portrait 15.5
finances 15.4
pay 15.4
loan 15.3
banknotes 14.7
envelope 14.6
old 14.6
art 14.6
closeup 14.2
economy 13.9
investment 13.8
bills 13.6
mug shot 13.5
creation 13.5
vintage 13.2
ancient 13
note 12.9
photograph 12.4
symbol 12.1
success 12.1
culture 12
representation 11.7
sign 11.3
head 10.9
funds 10.8
man 10.8
religion 10.8
notes 10.6
profit 10.5
capital 10.4
president 9.8
market 9.8
statue 9.7
states 9.7
product 9.7
sculpture 9.6
payment 9.6
price 9.6
binder 9.3
people 8.9
concepts 8.9
printed 8.9
economic 8.7
stamp 8.7
debt 8.7
antique 8.7
museum 8.6
mail 8.6
male 8.5
commerce 8.4
book 8.3
history 8.1
postmark 7.9
twenty 7.9
wages 7.8
sales 7.7
god 7.7
united 7.6
protective covering 7.6
letter 7.6
religious 7.5
famous 7.4
gold 7.4
detail 7.2
bust 7.1
marble 7.1

Google
created on 2019-11-06

Photograph 95.4
Picture frame 84.1
Art 76.1
Painting 69.8
Room 65.7
Portrait 64.3
Illustration 64
Visual arts 59.3
Paper 51

Microsoft
created on 2019-11-06

drawing 99.2
sketch 98.4
human face 97.9
gallery 95.3
room 92.4
scene 91.3
person 90.4
painting 87.7
clothing 80.7
text 75.7
man 75.6
portrait 60
handwriting 57.4
picture frame 9.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 84.3%
Surprised 31%
Angry 0.5%
Calm 8.1%
Happy 2%
Disgusted 0.3%
Fear 41.9%
Sad 10.9%
Confused 5.3%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a room with art on the wall 44.5%
a person in a room 44.4%
a close up of a mans face in a room 44.3%

Text analysis

Amazon

brchaaypo
SDembranti
in
Cconinias
ardlibus
ar. brchaaypo artante in ardlibus Cconinias Bomar.
ayiss
/ate
ar.
artante
Bomar.
For /ate h
h
For

Google

Effgics
onuini
34
ly
SPembrant
in
And.
wM SPembrant Effgics arstanti in adibns onuini Roma ly fde And. 34
Roma
wM
arstanti
adibns
fde