Human Generated Data

Title

Estate

Date

18th century

People

Artist: Giovanni Folo, Italian 1764 - 1836

Artist after: Stefano Tofanelli, Italian 1752-1812

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12055

Human Generated Data

Title

Estate

People

Artist: Giovanni Folo, Italian 1764 - 1836

Artist after: Stefano Tofanelli, Italian 1752-1812

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Person 98
Human 98
Art 95.9
Drawing 86.2
Face 77.3
Text 74.2
Painting 74.2
Sketch 69.6
Photo 66
Portrait 66
Photography 66

Clarifai
created on 2019-11-06

people 99.7
portrait 99.4
art 98.7
adult 98.5
one 97
woman 95.1
painting 94.8
retro 93.2
wear 92.6
picture frame 88.2
engraving 87.5
vintage 87.5
print 86.8
music 83.2
antique 82.6
nostalgia 81.9
man 81.7
old 80.5
illustration 75.2
writer 72.8

Imagga
created on 2019-11-06

book jacket 37.1
money 34
sketch 33.5
cash 31.1
currency 30.5
jacket 28.9
dollar 28.8
drawing 25
representation 23.8
bill 23.8
banking 23
finance 22.8
bank 22.4
wrapping 21.9
wealth 21.6
paper 20.5
financial 19.6
one 17.9
covering 17.8
close 17.7
business 17.6
dollars 15.5
savings 14.9
portrait 14.9
hundred 14.5
us 14.5
exchange 14.3
franklin 13.8
finances 13.5
billboard 13.4
pay 13.4
vintage 13.2
painter 12.8
culture 12.8
man 12.8
banknote 12.6
body 12
art 11.8
banknotes 11.8
sculpture 11.7
bills 11.7
loan 11.5
rich 11.2
product 11
investment 11
signboard 10.9
symbol 10.8
face 10.7
creation 10.7
male 10.6
old 10.5
statue 10.4
economy 10.2
note 10.1
closeup 10.1
people 10
market 9.8
states 9.7
antique 9.5
ancient 9.5
book 9.2
black 9
structure 9
success 8.9
economic 8.7
payment 8.7
figure 8.7
model 8.6
capital 8.5
commerce 8.4
human 8.3
historic 8.3
twenty 7.9
president 7.9
funds 7.8
adult 7.8
price 7.7
person 7.7
fine 7.6
united 7.6
famous 7.4
history 7.2
hair 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

human face 98
text 97.5
drawing 92.8
person 91.1
sketch 86.5
woman 85.9
handwriting 84.3
clothing 79.7
smile 78.1
letter 62.1
illustration 54.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Female, 94.6%
Sad 2.4%
Happy 1.8%
Angry 0.5%
Fear 0.2%
Surprised 1%
Calm 92.9%
Disgusted 0.2%
Confused 1.1%

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Painting 74.2%

Captions

Microsoft

an old photo of a person 75.8%
old photo of a person 71.3%
a photo of a person 71.2%

Text analysis

Amazon

ESTATE
Conte
il
dntonio
amalore
belle
dntonio hatin Smaolin, amalore oelle belle lorti
lorti
oelle
hatin
Smaolin,
Pon
w. .
SFole
Giormni SFole w. .
1 Pon Burllau il Lig Conte
Burllau
Giormni
Lig
1

Google

utti
Somanti,
ti
.
ine
e
mide
ntlenel
d
ESTAT
Gitlerani
Fole
nte
invene
-Antoni
amatose
in
edll
Cam e nte ine e mide in dme ntlenel invene d ESTAT E -Antoni utti Somanti, amatose edll lle ti Gitlerani Fole .
Cam
dme
E
lle