Human Generated Data

Title

Last Judgement

Date

15th century

People

Artist: Anonymous France (Paris) 1499, French 15th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M5638

Human Generated Data

Title

Last Judgement

People

Artist: Anonymous France (Paris) 1499, French 15th century

Date

15th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M5638

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 96.8
Drawing 95.6
Art 95.6
Doodle 95.6
Person 81
Animal 77.3
Tiger 77.3
Mammal 77.3
Wildlife 77.3
Poster 71.5
Advertisement 71.5
Sketch 67.1
Archaeology 57.7
Text 56
Soil 55.2
Person 50.3

Clarifai
created on 2019-11-07

art 97.9
symbol 95
old 93.5
decoration 93.1
retro 93
design 91.9
ancient 91.3
illustration 91.3
culture 91.2
religion 90.6
desktop 89.1
chalk out 88.4
vintage 87.4
collection 87.3
pattern 87.2
painting 85.6
people 82.8
antique 82.7
image 81.1
god 79.7

Imagga
created on 2019-11-07

sketch 100
drawing 100
representation 85.7
vintage 32.3
retro 24.6
old 24.4
art 22.7
paper 22
stamp 21.5
money 21.3
ancient 19.9
currency 18.9
antique 18.4
mail 18.2
grunge 17
finance 16.9
postmark 16.8
design 16
pattern 15.7
letter 15.6
dollar 14.9
postage 14.8
envelope 14
postal 13.8
texture 13.2
cash 12.8
history 12.5
decorative 12.5
financial 12.5
decoration 12
philately 11.9
aged 11.8
dollars 11.6
business 11.6
post 11.5
banking 11
frame 10.8
bank 10.8
close 10.3
traditional 10
collection 9.9
floral 9.4
global 9.1
black 9
religion 9
one 9
graphic 8.8
card 8.8
us 8.7
ink 8.7
united 8.6
culture 8.6
arabesque 8.4
note 8.3
investment 8.3
ornate 8.2
style 8.2
painting 8.1
symbol 8.1
wealth 8.1
man 8.1
circa 7.9
artistic 7.8
color 7.8
states 7.7
bill 7.6
number 7.5
savings 7.5
silhouette 7.5
shape 7.4
closeup 7.4
artwork 7.3
map 7.3
border 7.2
travel 7.1

Google
created on 2019-11-07

Art 86.5
Religious item 85.2
History 78.7
Prophet 69.6
Middle ages 68
Miniature 56.6

Microsoft
created on 2019-11-07

drawing 99.3
text 99
sketch 98.9
cartoon 98
illustration 93.3
book 90.5
comic 72.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-40
Gender Female, 50.4%
Surprised 45%
Sad 51.9%
Disgusted 45.1%
Confused 45%
Calm 45.1%
Happy 45%
Fear 45.7%
Angry 47.1%

AWS Rekognition

Age 22-34
Gender Male, 53.1%
Happy 45.1%
Fear 47.6%
Confused 45.1%
Calm 47.4%
Disgusted 46.3%
Angry 46.7%
Surprised 46.1%
Sad 45.6%

AWS Rekognition

Age 36-54
Gender Male, 54.5%
Fear 45%
Confused 45%
Angry 55%
Surprised 45%
Disgusted 45%
Calm 45%
Sad 45%
Happy 45%

AWS Rekognition

Age 19-31
Gender Male, 50.8%
Fear 53.1%
Happy 45%
Calm 45%
Disgusted 45%
Surprised 45%
Angry 45.1%
Sad 46.8%
Confused 45%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 81%
Tiger 77.3%
Poster 71.5%

Categories

Captions

Microsoft
created on 2019-11-07

a close up of a book 57.8%
close up of a book 51.3%
a close up of text on a book 45%

Text analysis

Amazon

IHIlDI
ILi
nm

Google

en
en