Human Generated Data

Title

Charles I of England with the Duke of Hamilton
Date

1782
People

Artist: Robert Strange, British 1721 - 1792

Artist after: Anthony van Dyck, Flemish 1599 - 1641
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3768

Human Generated Data

Title

Charles I of England with the Duke of Hamilton

People

Artist: Robert Strange, British 1721 - 1792

Artist after: Anthony van Dyck, Flemish 1599 - 1641

Date

1782

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-09-26

Person 99.9
Human 99.9
Art 96.8
Person 95.6
Painting 82
Person 48.5

Clarifai
created on 2019-09-26

people 100
illustration 99.3
art 99.1
adult 98.9
group 98.9
print 98.7
man 97.2
child 96.6
engraving 95.7
military 95.3
woman 94.8
two 93.5
soldier 92.4
wear 91.1
administration 89.5
war 89.5
weapon 89.3
painting 89.2
three 88
veil 85.6

Imagga
created on 2019-09-26

statue 57.5
sculpture 42.3
sketch 32.8
art 29.1
ancient 28.6
religion 27.8
stone 27.2
architecture 26.6
history 26
old 25.1
culture 24.8
drawing 23.8
religious 21.6
monument 21.5
city 20
representation 19.8
travel 19.7
column 19.7
temple 19.1
tourism 19
decoration 18.8
historic 18.4
historical 17.9
building 17.5
god 17.2
cemetery 17.2
famous 16.8
antique 16.5
carving 14.9
marble 14.5
church 13.9
spiritual 13.4
vintage 12.4
figure 12.1
tourist 11.8
face 11.4
landmark 10.8
traditional 10.8
fountain 10.8
worship 10.6
structure 10.6
holy 10.6
spirituality 10.6
memorial 10.4
people 10
roman 9.8
catholic 9.7
pray 9.7
detail 9.7
astronaut 9.5
soldier 8.8
symbol 8.8
man 8.7
museum 8.7
heritage 8.7
capital 8.6
person 8.4
exterior 8.3
design 8.2
cadaver 8
artistic 7.8
army 7.8
world 7.8
portrait 7.8
golden 7.7
military 7.7
faith 7.7
classical 7.6
head 7.6
oriental 7.6
china 7.5
decorative 7.5
peace 7.3

Google
created on 2019-09-26

Painting 94.8
Art 84.7
Illustration 79.3
Visual arts 78.2
Picture frame 71.5
Stock photography 69.8
Artwork 56
Printmaking 55.7
Drawing 53.7

Microsoft
created on 2019-09-26

text 99.8
person 94.2
old 93.2
clothing 92.8
drawing 88.3
sketch 84.9
horse 78.6
posing 78.4
painting 77.2
black 67.1
vintage 66.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Male, 98.5%
Happy 1.1%
Angry 0.3%
Calm 74.8%
Surprised 15.3%
Fear 1.7%
Disgusted 0.4%
Sad 0.9%
Confused 5.6%

AWS Rekognition

Age 33-49
Gender Male, 80.6%
Disgusted 0.5%
Confused 5%
Surprised 12.7%
Calm 67.2%
Angry 0.9%
Sad 7.6%
Happy 3.8%
Fear 2.3%

AWS Rekognition

Age 26-40
Gender Female, 52%
Confused 45%
Calm 53.5%
Sad 46%
Happy 45.1%
Angry 45.2%
Disgusted 45%
Fear 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Painting 82%

Captions

Microsoft

a vintage photo of a person 90.9%
a vintage photo of a person 89.7%
a vintage photo of a group of people posing for the camera 77.2%

Text analysis

Amazon

BRITANNIA
MAGNE
Hamitlonius
Hamilton.
Marchio
Gemes.
ab
MAGNE BRITANNIA RUEGI, &e.
Jaoctus Hamitlonius Marchio ab Hamilton. Sacri Slabul Gemes. adbstat
Sacri
RUEGI,
CSaro!o?1
Slabul
ignitis
adbstat
&abathe
lala
&e.
Jaoctus
&abathe dwlomi andoil ignitis Slee lala
Slee
andoil
dwlomi

Google

Robertus Strange delin alye ulpit A. D. 782 nlonins andick yuas pinil (Sarolo I MA GNA BRI TA NNIE RE GI, Se. Jacobus Hamilonius Marchio ab amion, acriabu Comes, addat 8 Tabula Untenii landh quiti, Sped el g digitos ala, 6pades ot to diyite lala, in Pacothece Regis Christianisimi comervala
Robertus
Strange
delin
alye
ulpit
A.
D.
782
nlonins
andick
yuas
pinil
(Sarolo
I
MA
GNA
BRI
TA
NNIE
RE
GI,
Se.
Jacobus
Hamilonius
Marchio
ab
amion,
acriabu
Comes,
addat
8
Tabula
Untenii
landh
quiti,
Sped
el
g
digitos
ala,
6pades
ot
to
diyite
lala,
in
Pacothece
Regis
Christianisimi
comervala