Human Generated Data

Title

Cosimo II de' Medici
Date

1630
People

Artist: Jacques Callot, French 1592 - 1635
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.103.3

Human Generated Data

Title

Cosimo II de' Medici

People

Artist: Jacques Callot, French 1592 - 1635

Date

1630

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Person 88.8
Human 88.8
Painting 82.5
Art 82.5
Money 74
Person 67.5

Clarifai
created on 2018-04-18

art 99.6
religion 99.3
illustration 98.7
people 97.9
painting 97.9
church 96.9
god 95.8
print 95.5
saint 95.3
visuals 94.9
symbol 91.7
old 90.9
spirituality 90.9
book 90.5
ancient 90.2
man 90.2
culture 89.5
holy 89.1
crown 88.1
antique 87.7

Imagga
created on 2018-04-18

art 35.9
arabesque 35.6
old 31.4
antique 27.2
pattern 26
texture 25
decoration 24.9
binding 24
design 23.8
vintage 23.2
ancient 22.5
paper 20.4
mosaic 20.3
traditional 19.1
religion 18.8
tile 18.1
gold 17.3
retro 16.4
frame 15.8
style 15.6
grunge 15.3
culture 14.5
detail 14.5
history 14.3
ornament 13.8
covering 13.8
stamp 13.7
wall 13.7
floral 13.6
ornate 12.8
collection 12.6
obsolete 12.5
craft 12.4
fabric 12.3
paisley 12
lace 12
money 11.9
drawing 11.9
prayer rug 11.8
currency 11.7
decor 11.5
mail 11.5
post 11.5
close 11.4
rug 11.4
artistic 11.3
finance 11
postmark 10.9
postage 10.8
flower 10.8
element 10.8
textured 10.5
oriental 10.4
east 10.3
banking 10.1
cash 10.1
wallpaper 10
wealth 9.9
parchment 9.6
religious 9.4
letter 9.2
painting 9
interior 8.9
postal 8.8
middle 8.7
used 8.6
golden 8.6
architecture 8.6
ornamental 8.6
textile 8.5
business 8.5
classic 8.4
dollar 8.4
decorative 8.4
historic 8.3
artwork 8.2
bank 8.1
surface 7.9
indoors 7.9
empire 7.9
color 7.8
handmade 7.8
mark 7.7
geometry 7.7
god 7.7
temple 7.6
document 7.4
backdrop 7.4
symbol 7.4
dirty 7.2
furnishing 7.2
material 7.2
colors 7.1

Google
created on 2018-04-18

art 83.8
black and white 76.4
history 72.7
currency 69
artwork 60.4
visual arts 59.7
drawing 55.4
stone carving 54.9
stock photography 53
illustration 52.1

Microsoft
created on 2018-04-18

text 100
book 99.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 53.6%
Sad 24.5%
Happy 15.2%
Confused 6%
Surprised 6.7%
Calm 7.6%
Angry 22.9%
Disgusted 17.3%

AWS Rekognition

Age 20-38
Gender Male, 79.2%
Confused 5%
Sad 10%
Surprised 2.5%
Happy 1.5%
Disgusted 62.6%
Angry 6.9%
Calm 11.5%

AWS Rekognition

Age 26-43
Gender Female, 56.7%
Disgusted 3.1%
Calm 11.3%
Sad 4.6%
Angry 11.6%
Surprised 18.7%
Confused 22.6%
Happy 27.9%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 66
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 88.8%
Painting 82.5%

Captions

Microsoft

a close up of a book 61.5%
close up of a book 56.8%
a close up of a book cover 56.7%

Text analysis

Amazon

MAGIST
DVX
ORD.
COSMVO
II.MAGNVS
STEPHANI
ETRVRIA
STEPHANI S II.MAGNVS
S
MAGVON