Human Generated Data

Title

The Request of the Mother of James and John

Date

c. 1529

People

Artist: Anonymous France (Paris) 1528, French 16th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gray Collection of Engravings Fund, G5328

Human Generated Data

Title

The Request of the Mother of James and John

People

Artist: Anonymous France (Paris) 1528, French 16th century

Date

c. 1529

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Art 93.7
Human 91.9
Drawing 87.3
Painting 85
Archaeology 83.5
Soil 67.2
Person 66.5
Person 65
Doodle 60.2
Advertisement 59.6
Poster 59.6

Clarifai
created on 2019-11-07

religion 97.2
art 96.9
ancient 96.4
old 94.8
god 93.6
culture 93
desktop 92.9
pattern 91.9
chalk out 90.9
illustration 90.8
architecture 90.3
sculpture 90.1
symbol 89.2
decoration 88.9
design 88.9
temple 86
print 84.4
antique 83.5
religious belief 83.4
people 81.3

Imagga
created on 2019-11-07

sketch 88.1
drawing 75.1
representation 61.5
map 28.2
art 23.8
money 23
dollar 22.3
currency 21.6
design 21.4
paper 21.2
vintage 19.1
retro 18.9
finance 17.8
arabesque 16.8
pattern 16.4
bank 16.2
dollars 15.5
graphic 15.4
business 15.2
sign 15.1
cash 14.7
black 14.5
decorative 14.2
element 14.1
antique 13.3
decoration 13.1
grunge 12.8
wealth 12.6
financial 12.5
symbol 12.1
savings 12.1
shape 11.9
hundred 11.6
us 11.6
loan 11.5
bill 11.4
number 11.2
old 11.2
banking 11.1
frame 10.2
investment 10.1
border 10
silhouette 10
cartoon 9.8
texture 9.8
relief 9.7
wallpaper 9.2
close 9.1
one 9
history 9
decor 8.9
icon 8.7
finances 8.7
ancient 8.7
capital 8.6
letter 8.3
style 8.2
painting 8.2
stamp 7.9
atlas 7.9
royal 7.7
culture 7.7
flower 7.7
floral 7.7
plan 7.6
traditional 7.5
rich 7.5
economy 7.4
note 7.4
template 7.4
ornate 7.3
travel 7.1
leaf 7
curve 7

Google
created on 2019-11-07

History 81.9
Art 72.1
Ancient history 67.2
Middle ages 65.7
Relief 62.3
Miniature 60.9
Artwork 56.7
Pattern 56.3

Microsoft
created on 2019-11-07

text 99.8
drawing 99.4
sketch 99.1
book 97.6
cartoon 90.5
illustration 86.2
person 53.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 91.6%
Happy 4.3%
Calm 59.8%
Angry 2.6%
Fear 8.2%
Disgusted 3%
Confused 1.3%
Surprised 17.8%
Sad 3.1%

AWS Rekognition

Age 18-30
Gender Female, 70.3%
Angry 6.2%
Confused 0.5%
Sad 9.1%
Happy 0.2%
Calm 4.2%
Fear 1.8%
Surprised 0.3%
Disgusted 77.6%

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 66.5%
Poster 59.6%

Captions

Microsoft

a close up of a book 64%
close up of a book 58.6%
a close up of text on a book 54.3%

Text analysis

Google

MAA
MAA