Human Generated Data

Title

Van Dyck and the Earl of Bristol
Date

18th century
People

Artist: Fernando Selma, Spanish active 1770-1800; actual dates unknown

Artist after: Anthony van Dyck, Flemish 1599 - 1641
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3652

Human Generated Data

Title

Van Dyck and the Earl of Bristol

People

Artist: Fernando Selma, Spanish active 1770-1800; actual dates unknown

Artist after: Anthony van Dyck, Flemish 1599 - 1641

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3652

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Human 99.7
Person 99.7
Person 99.3
Art 93.6
Face 82.5
Drawing 70.3
Text 66.8
Wood 65.4
Painting 64.5
Photo 64.5
Portrait 64.5
Photography 64.5

Clarifai
created on 2019-10-30

people 99.9
adult 99.2
portrait 97.7
print 96.8
one 96.3
woman 96.1
man 94.9
two 94.8
group 93.2
art 92.2
wear 91.3
music 84.9
painting 84.4
affection 84.1
baby 81.2
religion 80.2
child 79
veil 77.7
administration 77.4
lithograph 76.5

Imagga
created on 2019-10-30

book jacket 89.1
jacket 69.3
wrapping 52.7
money 50.2
currency 48.5
dollar 42.7
cash 40.3
covering 36.2
paper 35.3
finance 33.8
bill 33.3
wealth 33.2
bank 31.5
banking 31.3
business 29.8
financial 29.4
dollars 29
hundred 28.1
envelope 24.5
one 23.9
close 23.4
stamp 23.2
mail 23
savings 22.4
vintage 22.3
postmark 21.7
banknote 20.4
us 20.3
exchange 20.1
letter 18.3
old 18.1
franklin 17.7
rich 17.7
postage 17.7
note 17.5
finances 17.4
pay 17.3
postal 16.7
bills 16.5
investment 16.5
banknotes 15.7
loan 15.3
economy 14.8
states 14.5
profit 14.4
post 14.3
closeup 14.2
retro 13.9
philately 13.8
circa 13.8
portrait 13.6
symbol 13.5
funds 12.8
market 12.4
printed 11.8
payment 11.5
united 11.4
card 11.1
message 11
aged 10.9
shows 10.8
economic 10.7
face 10.7
notes 10.6
phonograph record 10.6
ancient 10.4
culture 10.3
sale 10.2
man 10.1
stamps 9.9
creation 9.8
art 9.7
rate 9.7
success 9.7
videodisk 9.5
capital 9.5
commerce 9.3
sign 9
masterpiece 8.9
concepts 8.9
office 8.8
wages 8.8
paying 8.7
value 8.7
price 8.7
fine 8.6
person 8.3
product 8.2
newspaper 8.2
representation 8.1
object 8.1
president 7.9
address 7.8
male 7.8
debt 7.7
buying 7.7
sales 7.7
serious 7.6
buy 7.5
number 7.5
alone 7.3
global 7.3
museum 7.2
collection 7.2
container 7.2
history 7.2

Google
created on 2019-10-30

Photograph 95
Art 77.2
Illustration 73.8
Picture frame 73.8
Painting 69.3
Visual arts 68.6
Vintage clothing 65.4
Stock photography 64
Photography 62.4
Drawing 55.8
Paper 54.3
Portrait 53.5

Microsoft
created on 2019-10-30

text 99.9
drawing 95
person 94.1
human face 92
clothing 91.6
sketch 82.1
man 59.9
old 51.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 78.8%
Happy 0.5%
Disgusted 0.2%
Fear 0.1%
Angry 0.7%
Calm 96.9%
Sad 0.5%
Surprised 0.6%
Confused 0.4%

AWS Rekognition

Age 22-34
Gender Male, 98.2%
Happy 5.1%
Sad 7.2%
Calm 76.5%
Disgusted 2.2%
Surprised 5%
Confused 1.3%
Angry 1.8%
Fear 0.9%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 64.5%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-10-30

a close up of a book 45.5%
close up of a book 40.2%
a close up of a book cover 40.1%

Text analysis

Amazon

de
Trene
d
lanisaal
alte
haalla
Wundk
linde
Antemo
otnmal
de Antemo Wundk d lanisaal linde de Jurina otnmal .V haalla int ratl Palatao de
Mladnd.
Palatao
anhe
Jurina
dde
rrulgahs
TI
Ogmatr
ahim
lemue d Ogmatr
int
.uiti
Mladnd. Trene de alte hrari f'is ry .uiti rrulgahs dde anhe ahim y ma. au
Rcoitty de vo
ry
Tn TI
vo
ma.
au
ratl
f'is
lemue
.V
Rcoitty
Tn
hrari
y

Google

Rebratcs de Antonie Wandik y dMarsval onde de urena aw ginnal e halla n d Ral Pala Madrid. Tene de alo trs pis de rey y mte pulgadas, y de anhe uite v h de
Rebratcs
de
Antonie
Wandik
y
dMarsval
onde
urena
aw
ginnal
e
halla
n
d
Ral
Pala
Madrid.
Tene
alo
trs
pis
rey
mte
pulgadas,
anhe
uite
v
h