Human Generated Data

Title

Music

Date

18th century

People

Artist: Francesco del Pedro, Italian 1740-1806

Artist after: Giovanni Battista Piazzetta, Italian 1682 - 1754

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R9432

Human Generated Data

Title

Music

People

Artist: Francesco del Pedro, Italian 1740-1806

Artist after: Giovanni Battista Piazzetta, Italian 1682 - 1754

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Person 99.5
Human 99.5
Person 99.5
Art 93.4
Person 93.2
Painting 79.2
Drawing 73.6
Face 68.8
People 66.3
Photography 64.8
Photo 64.8
Portrait 64.8
Text 62.3

Clarifai
created on 2019-11-06

people 100
adult 98.9
portrait 98.6
art 98.2
print 97.7
man 96.9
two 96.4
group 96.1
engraving 95.9
retro 95.3
woman 95
illustration 94.8
one 93.1
child 91
wear 90.4
painting 90
three 89.1
veil 87.6
leader 85.5
music 85.5

Imagga
created on 2019-11-06

money 40.9
currency 36.8
cash 34.8
product 31.6
book jacket 31.4
dollar 29.7
creation 27.7
banking 27.6
bill 26.7
newspaper 26.6
finance 26.2
bank 26
paper 25.2
close 25.1
jacket 24.4
wealth 23.4
financial 22.3
business 21.3
dollars 21.3
one 19.4
banknote 19.4
wrapping 18.6
portrait 18.1
savings 17.7
vintage 17.4
exchange 17.2
economy 16.7
banknotes 16.6
bills 16.5
hundred 16.5
us 16.4
stamp 15.7
mail 15.3
closeup 14.8
postmark 14.8
culture 14.5
finances 14.5
face 14.2
covering 14.1
book 14
rich 14
franklin 13.8
printed 13.8
postage 13.8
letter 13.8
painter 13.6
art 13.5
pay 13.4
envelope 13.4
black 13.2
investment 12.8
postal 12.8
states 12.6
loan 12.5
symbol 12.1
man 12.1
note 12
old 11.9
shows 11.8
notes 11.5
comic book 11.1
market 10.7
people 10.6
payment 10.6
united 10.5
capital 10.4
male 9.9
masterpiece 9.9
bookmark 9.9
circa 9.9
representation 9.8
funds 9.8
economic 9.7
profit 9.6
post 9.5
fine 9.5
retro 9
museum 8.9
known 8.9
stamps 8.9
twenty 8.9
success 8.9
renaissance 8.8
paintings 8.8
sketch 8.8
hair 8.7
icon 8.7
painted 8.6
model 8.6
person 8.5
head 8.4
office 8
body 8
post mail 7.9
zigzag 7.9
fame 7.9
philately 7.9
phonograph record 7.8
wages 7.8
delivery 7.8
cutting 7.7
communications 7.7
unique 7.6
fashion 7.5
human 7.5
commerce 7.5
global 7.3
sexy 7.2
drawing 7.2
adult 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

drawing 98.7
text 97
sketch 96.8
human face 96.4
wall 95.2
old 91.3
person 89.7
painting 83.2
clothing 82.1
cartoon 74.4
woman 66.9
vintage 28.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 96.9%
Confused 0.1%
Sad 3.1%
Disgusted 0.1%
Happy 0.7%
Fear 0.3%
Angry 0.2%
Calm 95.2%
Surprised 0.3%

AWS Rekognition

Age 22-34
Gender Male, 88.2%
Disgusted 1.5%
Happy 0.2%
Angry 1.3%
Surprised 2.7%
Fear 5.4%
Confused 8%
Sad 69.4%
Calm 11.6%

AWS Rekognition

Age 38-56
Gender Male, 63.4%
Angry 0.2%
Confused 0.4%
Sad 15.5%
Disgusted 0.3%
Calm 83%
Fear 0.2%
Happy 0.1%
Surprised 0.3%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 79.2%

Captions

Microsoft

a vintage photo of a person 85.3%
a vintage photo of a person 82.7%
an old photo of a person 82.6%

Text analysis

Amazon

docta
Me
scien
Dulees docta
et
chesa
Dulees
Chloi
cithare,
Me nanc chesa Chloi regit
nanc
modas
regit
modas et cithare, scien Hool.., 3.
3.
Hool..,

Google

F.te .Cau Venelye Pizzzela pune. Me nan Chesa Chloi regit Dules docta modos et cithare sdens Hd 3. e Pelakark Gnt Marhert
F.te
Venelye
pune.
nan
Hd
3.
Marhert
Me
Chloi
cithare
.Cau
Chesa
regit
Dules
modos
sdens
Pelakark
Pizzzela
docta
et
Gnt
e