Human Generated Data

Title

Frederik de Vries

Date

1599

People

Artist: Raffaello Guidi, Italian 1540 - c. 1613

Artist after: Hendrick Goltzius, Dutch 1558 - 1617

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Fine Arts Department, Harvard University, FA32

Human Generated Data

Title

Frederik de Vries

People

Artist: Raffaello Guidi, Italian 1540 - c. 1613

Artist after: Hendrick Goltzius, Dutch 1558 - 1617

Date

1599

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Art 98.5
Human 83.2
Person 83.2
Painting 73.6
Dog 61.5
Animal 61.5
Canine 61.5
Mammal 61.5
Pet 61.5

Clarifai
created on 2019-11-10

art 99.7
print 99.7
illustration 99.7
vintage 99.6
antique 99.5
retro 99.3
old 99.3
engraving 98.6
people 98.4
painting 97.8
visuals 97.3
portrait 97
ancient 97
historic 94.2
paper 93
adult 92
man 91.7
collection 91.5
one 88.1
letter 85.4

Imagga
created on 2019-11-10

sculpture 39.4
art 36.4
religion 35
statue 30.9
ancient 30.3
temple 29
architecture 27.5
decoration 26.5
tattoo 26.4
stone 25
culture 24
god 23.9
design 23
sketch 22.1
carving 20.9
history 20.6
monument 20.6
old 20.2
religious 17.8
drawing 17.2
church 16.7
face 15.6
spirituality 14.4
travel 14.1
figure 14
representation 13.9
holy 13.5
currency 13.5
gold 13.2
money 12.8
carved 12.7
building 12
historic 11.9
cash 11.9
antique 11.9
head 11.8
spiritual 11.5
mosaic 11.5
detail 11.3
banking 11
vintage 10.8
tourism 10.7
style 10.4
historical 10.4
golden 10.3
close 10.3
museum 10.1
decorative 10
bill 9.5
east 9.3
famous 9.3
finance 9.3
dollar 9.3
artwork 9.2
traditional 9.2
banknote 8.7
worship 8.7
faith 8.6
wall 8.6
oriental 8.5
portrait 8.4
city 8.3
symbol 8.1
wealth 8.1
bank 8.1
icon 7.9
statues 7.9
century 7.8
heritage 7.7
us 7.7
meditation 7.7
cemetery 7.7
book jacket 7.6
man 7.6
one 7.5
tourist 7.3
landmark 7.2
decor 7.1

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 100
book 99.9
drawing 96.1
carnivore 91.1
animal 89.9
sketch 89.6
cartoon 86.5
dog 78.8
painting 76.3
illustration 74.1
mammal 71.7
posing 60.3
lion 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-54
Gender Female, 77.8%
Sad 2.8%
Disgusted 0.4%
Angry 1.2%
Calm 7.6%
Surprised 0.7%
Happy 86.8%
Confused 0.3%
Fear 0.3%

Microsoft Cognitive Services

Age 61
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 83.2%
Painting 73.6%
Dog 61.5%

Captions

Microsoft

a person and a dog posing for the camera 65.1%
a dog sitting on top of a book 30.2%
a dog is posing for a photo 30.1%

Text analysis

Amazon

K
Glinas,
yel
Seuar
capsat
cu
K yel acles amiate PAer Seuar
wertaiia
badarias
agregrs
amiate
Dene
Cuo
arhela cu fh
cre
arhela
fh
igdlulsnh
Aees9y badarias Srifs CBelon agregrs
schest.
Srifs
rmICAL
acles
CBelon
Cuo wertaiia I
PAer
puer
rlint
gfrr
ore schest. capsat P Dene rmICAL "Thel rlint a: puer 4 cre Glinas,
Aees9y
"Thel
4
I
P
ore
a:

Google

Ki
apu
dar
LalC
Carelum.oi.ta
carer
let
manu
Ki LalC Gryfe Paors carer apu let focramaig dar in cre manu Rma apud Carelum.oi.ta
Gryfe
in
cre
Rma
Paors
focramaig
apud