Human Generated Data

Title

Jacobo Gouters (Jacques Gaultier), French Lutenist in London
Date

17th century
People

Artist: Jan Lievens, Dutch 1607 - 1674
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2364

Human Generated Data

Title

Jacobo Gouters (Jacques Gaultier), French Lutenist in London

People

Artist: Jan Lievens, Dutch 1607 - 1674

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-07

Art 98.2
Human 95.9
Person 95.9
Painting 63.2
Musical Instrument 59.1
Lute 59.1

Clarifai
created on 2019-08-07

people 99.8
art 99.8
portrait 99.7
print 99.7
one 99.5
engraving 99.3
wear 98.4
adult 98.4
illustration 96.6
vintage 94.1
man 94.1
retro 93.8
antique 93.7
painting 92.6
old 90.2
woman 89.4
music 88.3
book bindings 87.8
weapon 86.9
outerwear 86

Imagga
created on 2019-08-07

newspaper 47.1
product 43
creation 37.4
book jacket 36.3
jacket 30.2
guitar 24.3
stringed instrument 23.7
man 22.2
person 22
wrapping 21.4
sitar 19.2
music 19
musical instrument 19
rock 17.4
money 16.2
male 14.9
covering 14.4
musician 13.9
statue 13.3
dollar 13
portrait 12.9
play 12.9
business 12.8
currency 12.6
silhouette 12.4
people 12.3
singer 12.2
electric 12.2
art 12.1
instrument 12.1
playing 11.8
power 11.7
musical 11.5
sound 11.2
banking 11
book 11
adult 11
guitarist 10.8
song 10.7
metal 10.5
hair 10.3
cash 10.1
religion 9.9
mug shot 9.8
fashion 9.8
old 9.8
stage 9.7
close 9.7
scholar 9.7
style 9.6
bill 9.5
player 9.4
symbol 9.4
culture 9.4
device 9.2
performer 9.1
sculpture 9
one 9
bank 9
rocker 8.9
success 8.9
concert 8.7
work 8.7
photograph 8.6
face 8.5
attractive 8.4
sky 8.3
hat 8.3
entertainment 8.3
human 8.2
sunset 8.1
sexy 8
black 7.8
architecture 7.8
ancient 7.8
model 7.8
band 7.8
intellectual 7.7
notes 7.7
finance 7.6
hand 7.6
guy 7.6
religious 7.5
city 7.5
closeup 7.4
computer 7.4
financial 7.1

Google
created on 2019-08-07

Painting 76.1
Art 67.7
Portrait 64.3
Self-portrait 50.9
Illustration 50.4

Microsoft
created on 2019-08-07

text 100
book 99.6
drawing 96.7
sketch 95.1
painting 91.9
person 90.4
clothing 67.8
photograph 51.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 88.6%
Angry 8%
Happy 3%
Confused 4.5%
Sad 20.4%
Calm 48.4%
Surprised 8.3%
Disgusted 7.3%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.9%
Painting 63.2%

Captions

Microsoft

Jacques Gaultier sitting on top of a book 38.4%
Jacques Gaultier sitting on a book 35.7%
Jacques Gaultier holding a book 35.6%

Text analysis

Amazon

MAGNE
INTER
GOVTERO
ORPHEOS
PRINCIPI
HANC
TESTVDINIS
AMPHIONES
TESTVDINIS FIDICINI ET MODVLATORVM PRINCIPI
PENIGILLI
ET
MODVLATORVM
FIDICINI
EFFIGIEM
DORLE
REGIOS
FIDA
TRANSSCRIPTAM
IOANNES
LYDIA
IACOBO GOVTERO INTER REGIOS MAGNE BRITANNIE ORPHEOS ET AMPHIONES
HANC E PENIGILLI SVI TABVLA IN ES TRANSSCRIPTAM EFFIGIEM IOANNES
TABVLA
IN
PHRYGLE
ES
E
LYDIA DORLE PHRYGLE LAEVINI
SVI
MONIMENTVM.L.M.CONSECRAVIT.
BRITANNIE
IACOBO
AMICITIE
FIDA AMICITIE MONT MONIMENTVM.L.M.CONSECRAVIT.
LAEVINI
fi
MONT
Liniss
Loanai Liniss fi
009100
Loanai

Google

IACOBO GOVTERO INTER REGIOS MAGNE BRITANNIE ORPHEOS ET AMPHIONES LYDIE DORIA PHRYGLE TESTVDINIS FIDICINI ET MODVLATORVM PRINCIPI HANC E PENICILLI SVI TABVLA IN ES TRANSSCRIPTAM EFFIGIEM IOANNES LAVINI FIDA AMICITIE MONIMENTVM.L.M.CONSECRAVIT. ecedi Ianais Liis fee
IACOBO
GOVTERO
INTER
REGIOS
MAGNE
BRITANNIE
ORPHEOS
ET
AMPHIONES
LYDIE
DORIA
PHRYGLE
TESTVDINIS
FIDICINI
MODVLATORVM
PRINCIPI
HANC
E
PENICILLI
SVI
TABVLA
IN
ES
TRANSSCRIPTAM
EFFIGIEM
IOANNES
LAVINI
FIDA
AMICITIE
MONIMENTVM.L.M.CONSECRAVIT.
ecedi
Ianais
Liis
fee