Human Generated Data

Title

Giulio II
Date

19th century
People

Artist: Paolo Toschi, Italian 1788 - 1854

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7371

Human Generated Data

Title

Giulio II

People

Artist: Paolo Toschi, Italian 1788 - 1854

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 99
Person 99
Art 93.4
Text 79.6
Photo 62.5
Portrait 62.5
Photography 62.5
Face 62.5
Painting 52.9

Clarifai
created on 2019-10-29

people 99.7
adult 98.6
portrait 98.6
one 98.2
art 97.9
wear 95.5
print 95.2
woman 95
man 94.8
sit 91.2
painting 88.5
illustration 87.2
veil 86.6
facial hair 83.5
music 82.3
gown (clothing) 79.9
child 79.7
writer 79.4
engraving 77.6
leader 77.5

Imagga
created on 2019-10-29

book jacket 100
jacket 86.9
wrapping 65.3
covering 44.5
money 42.6
currency 39.5
cash 36.6
dollar 34.4
paper 31.4
product 30.1
bank 29.6
bill 29.5
creation 26.6
business 25.5
finance 25.4
banking 24.8
book 24.8
wealth 21.6
financial 21.4
dollars 20.3
one 20.2
vintage 19.9
savings 19.6
close 18.8
hundred 18.4
stamp 18.4
mail 18.2
newspaper 18.1
exchange 17.2
envelope 17
postmark 16.8
franklin 16.7
letter 16.5
banknote 16.5
us 16.4
postage 15.7
banknotes 14.7
pay 14.4
loan 14.4
post 14.3
old 13.9
economy 13.9
postal 13.7
bills 13.6
rich 13
note 12.9
closeup 12.8
symbol 12.8
states 12.6
finances 12.5
investment 11.9
printed 11.8
market 11.6
art 11.1
global 10.9
philately 10.9
circa 10.9
shows 10.8
retro 10.7
notes 10.6
united 10.5
office 10.4
portrait 10.4
man 10.1
funds 9.8
economic 9.7
payment 9.6
black 9.6
communications 9.6
fine 9.5
capital 9.5
culture 9.4
photograph 9.2
masterpiece 8.9
known 8.9
stamps 8.9
success 8.9
museum 8.8
paintings 8.8
delivery 8.8
cutting 8.7
antique 8.7
price 8.7
ancient 8.6
painted 8.6
unique 8.5
commerce 8.4
sign 8.3
painter 8.3
mug shot 8.1
icon 7.9
post mail 7.9
zigzag 7.9
fame 7.9
twenty 7.9
renaissance 7.9
wages 7.8
legal 7.8
face 7.8
value 7.8
sales 7.7
profit 7.7
object 7.3
people 7.3
person 7.2
history 7.2

Google
created on 2019-10-29

Photograph 95.8
Painting 76.1
Art 73.1
Picture frame 71.9
Stock photography 70.9
Illustration 60.2
Visual arts 55
Vintage clothing 54.7
Antique 51.7

Microsoft
created on 2019-10-29

gallery 97
clothing 96.5
drawing 96.1
human face 95.6
person 95.4
room 95.2
text 91.6
scene 90.5
man 89.4
sketch 87.1
painting 63.1
picture frame 45.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-58
Gender Female, 89.4%
Disgusted 0.3%
Fear 6.3%
Happy 0.3%
Calm 30.4%
Angry 5%
Sad 54.8%
Confused 2.2%
Surprised 0.6%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 52.9%

Captions

Microsoft

an old photo of a person 63.1%
a person sitting in a room 41.4%
a person in a room 41.3%

Text analysis

Amazon

GIULIO
en
YITALE
Owen
d
mer
niefrere
eytoe
Memsngner Cende en YITALE DSCH rrlate
GIULIO Il.
Memsngner
Cende
Herndina
DSCH
dh
Lua rartionra Herndina
pamonie al eytoe niefrere im mer
rartionra
bor av dh Seryee del Owen d ana
av
Seryee
Lua
ana
ado
rrlate
del
pamonie
Il.
uifi
im
OMimr uifi ado
al
OMimr
db
bor

Google

GIULIO Aua lonza evenda Mensgner Cente DonVITALE LOSCHIla mese d Apstente at oglentf nen enater nme e lleA Fi
GIULIO
Aua
lonza
evenda
Mensgner
Cente
DonVITALE
LOSCHIla
mese
d
Apstente
at
oglentf
nen
enater
nme
e
lleA
Fi