Human Generated Data

Title

Scene I
Date

15th century
People

Artist: Anonymous France (Paris) 1499, French 15th century
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M5666

Human Generated Data

Title

Scene I

People

Artist: Anonymous France (Paris) 1499, French 15th century

Date

15th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Art 90.4
Human 83.1
Person 83.1
Painting 81
Person 79.4
Drawing 78.1
Archaeology 70.7
Text 68.6
Soil 65.6
Person 54.3

Clarifai
created on 2019-11-07

illustration 98.6
art 98.6
chalk out 95.1
religion 94.6
ancient 94.6
people 94.3
retro 94.3
old 94.1
print 93.9
man 91.5
symbol 91.1
woodcut 90.6
god 90.4
painting 90.3
vintage 87.5
visuals 87.2
antique 86.3
engraving 86.2
paper 85.6
Gothic 83.9

Imagga
created on 2019-11-07

sketch 47.7
drawing 40.3
vintage 38.1
stamp 33.9
old 31.4
representation 30.6
mail 27.8
paper 26.7
postmark 26.7
retro 26.3
ancient 25.1
envelope 24.9
art 24.6
postage 24.6
letter 23.9
money 23
currency 22.5
postal 21.6
cash 20.2
antique 19.6
dollar 19.5
grunge 18.8
finance 18.6
post 18.2
bank 17.9
philately 16.8
tile 15.6
aged 15.4
history 15.2
financial 15.2
one 15
dollars 14.5
rich 14
banking 13.8
collection 13.5
printed 12.8
global 12.8
wealth 12.6
religion 12.6
decoration 12.3
business 12.2
close 12
binding 12
circa 11.9
shows 11.8
exchange 11.5
symbol 11.5
black 11.4
bill 11.4
arabesque 11.4
texture 11.1
mosaic 11.1
note 11
design 10.9
stamps 10.9
us 10.6
culture 10.3
savings 10.3
delft 9.9
bills 9.7
closeup 9.4
wall 9.4
church 9.3
historic 9.2
pattern 8.9
hundred 8.7
card 8.7
pay 8.6
painted 8.6
earthenware 8.4
message 8.2
book jacket 8.2
philatelic 7.9
frame 7.8
banknote 7.8
worn 7.6
communication 7.6
decorative 7.5
economy 7.4
investment 7.3
object 7.3
map 7.3
travel 7.1

Google
created on 2019-11-07

Art 72.1
Prophet 70.1
History 66.1
Miniature 62.9
Painting 51.9
Illustration 50.4

Microsoft
created on 2019-11-07

drawing 99.5
text 99.1
sketch 99
book 94.4
cartoon 87.5
illustration 84.2
person 76.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 60.6%
Angry 3.5%
Calm 27.9%
Fear 62%
Disgusted 1%
Surprised 1.2%
Confused 0.3%
Happy 0.9%
Sad 3.2%

AWS Rekognition

Age 24-38
Gender Male, 93.3%
Sad 0.8%
Happy 0%
Disgusted 0.1%
Surprised 1.2%
Calm 94.4%
Confused 0%
Angry 1.6%
Fear 1.9%

AWS Rekognition

Age 24-38
Gender Male, 75.4%
Disgusted 0.3%
Calm 62.6%
Angry 30.1%
Confused 0.1%
Happy 0.2%
Sad 2.7%
Surprised 1.4%
Fear 2.5%

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 83.1%

Captions

Microsoft

a close up of a book 58.7%
close up of a book 52.4%
a close up of text on a book 46.7%

Text analysis

Amazon

HOlLO