Human Generated Data

Title

Boy and Dog
Date

18th century
People

Artist: Nicolò Cavalli, Italian 1730 - 1822

Artist after: Antonio Marinetti, Italian 1719-1790
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R14056

Human Generated Data

Title

Boy and Dog

People

Artist: Nicolò Cavalli, Italian 1730 - 1822

Artist after: Antonio Marinetti, Italian 1719-1790

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-07-31

Person 97.4
Human 97.4
Apparel 95.9
Clothing 95.9
Art 95.6
Bonnet 94.1
Hat 94.1
Painting 78.2
Drawing 76.9
Text 75.2
Sketch 58.5

Clarifai
created on 2019-07-31

people 99.7
portrait 99.1
art 98.5
illustration 98
one 97.2
retro 96.2
print 95.8
vintage 95.5
adult 94
engraving 93.3
lid 91.4
man 91.4
old 91
paper 90.8
antique 90.6
leader 86.6
veil 85.3
visuals 85.2
child 83.5
nostalgia 81.5

Imagga
created on 2019-07-31

book jacket 37.6
money 32.3
jacket 29.2
currency 27.8
cash 26.6
portrait 26.5
dollar 24.1
bill 22.8
mug shot 22.8
wrapping 22.2
banking 22.1
paper 20.5
covering 20.4
bank 19
creation 18.9
finance 18.6
representation 18.4
close 18.3
photograph 17.7
business 16.4
face 16.3
people 16.2
wealth 16.2
financial 16
one 15.7
closeup 15.5
banknote 14.6
art 14.5
dollars 13.5
vintage 13.2
model 13.2
man 12.8
hair 12.7
religion 12.5
person 12.5
savings 12.1
economy 12.1
black 12
body 12
banknotes 11.7
us 11.6
exchange 11.5
human 11.3
product 11.2
rich 11.2
old 11.2
church 11.1
male 10.7
hundred 10.7
payment 10.6
pay 10.6
sexy 10.4
adult 10.3
sensual 10
franklin 9.8
fashion 9.8
bills 9.7
clothing 9.7
stamp 9.7
finances 9.6
bow tie 9.6
mail 9.6
museum 9.5
culture 9.4
sculpture 9.3
pretty 9.1
attractive 9.1
twenty 8.9
hat 8.9
envelope 8.6
loan 8.6
necktie 8.6
head 8.4
newspaper 8.3
note 8.3
makeup 8.2
success 8
market 8
masterpiece 7.9
cute 7.9
postmark 7.9
printed 7.9
president 7.9
figure 7.9
ancient 7.8
economic 7.8
states 7.7
notes 7.7
god 7.7
united 7.6
investment 7.3
lifestyle 7.2
history 7.2

Google
created on 2019-07-31

Photograph 95.6
Retro style 86
Vintage clothing 82
Portrait 81
Picture frame 73.8
Art 73.1
Painting 69.8
Illustration 60.2
Drawing 55.8
Visual arts 55
Vintage advertisement 52.7

Microsoft
created on 2019-07-31

text 99.8
human face 97.6
person 94.3
clothing 91.9
drawing 86.5
sketch 74
photograph 65.1
hat 56.4
portrait 54.7
old 44.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Male, 92.7%
Surprised 51.5%
Angry 3.1%
Confused 15.7%
Sad 11.9%
Happy 5.2%
Calm 9.8%
Disgusted 2.8%

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Painting 78.2%

Captions

Microsoft

a vintage photo of a book 58.5%
a vintage photo of a person holding a book 57%
a vintage photo of a person with a book 56.9%

Text analysis

Amazon

Justiniano
Bonarum
Cultori
Senatoris
Sebastiano
Cultori ct
Sebastiano Justiniano P Senatoris SenatoriAmplifsumo
ct
pignur
Eruditissimo
Cavall
perpetum
observantic
Artium
SenatoriAmplifsumo
P
Bonarum ut Artium observantic Eruditissimo 1117
1117
donte
Nvolan
uut arinam donte e Chietrom perpetum pignur Nvolan Cavall ader fculr
fculr
ut
ader
arinam
Chietrom
uut
e

Google

Sebastiano Justiniano 2ct Senatori Amplifsumo Bonarum Artium, Cultori Eruditissimo perpetuum observantie pgnus D.D. AutMari dete il Chiesen tp Mirelan avalls delot feuly 22
Senatori
Cultori
2ct
Artium,
Eruditissimo
dete
avalls
Bonarum
observantie
D.D.
tp
Justiniano
Amplifsumo
AutMari
delot
22
Sebastiano
perpetuum
pgnus
il
Chiesen
Mirelan
feuly