Human Generated Data

Title

Coat-of-Arms

Date

1650

People

Artist: Anonymous France (Heraldry) 1699, French 17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles Bain Hoyt, M8091

Human Generated Data

Title

Coat-of-Arms

People

Artist: Anonymous France (Heraldry) 1699, French 17th century

Date

1650

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles Bain Hoyt, M8091

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Human 97.9
Person 97.9
Person 96.5
Art 95.9
Painting 88.6
Drawing 69.7
Archaeology 59.6
Soil 56.3

Clarifai
created on 2019-11-09

people 99.9
adult 99.5
art 99.1
illustration 99
group 98.7
man 98.1
woman 97.6
veil 97.2
furniture 96.9
two 96.8
print 96.1
wear 96
one 95.8
seat 94.4
leader 94.4
gown (clothing) 94.2
religion 92.1
cape 91.9
god 90.7
kneeling 89.9

Imagga
created on 2019-11-09

sketch 100
drawing 100
representation 92.6
old 29.3
vintage 29
art 27.6
ancient 26.8
antique 26
grunge 24.7
retro 22.1
paper 18.8
design 16.2
decoration 16.2
pattern 15.7
stamp 15.2
religion 14.3
history 14.3
frame 14.2
texture 13.9
aged 12.7
carving 12.4
symbol 12.1
sculpture 12.1
letter 11.9
architecture 11.7
decorative 11.7
black 11.4
artistic 11.3
detail 10.5
border 10
spirituality 9.6
mail 9.6
statue 9.5
temple 9.5
wall 9.4
religious 9.4
money 9.4
floral 9.4
church 9.3
flower 9.2
artwork 9.2
currency 9
ornament 8.6
culture 8.6
finance 8.5
stone 8.4
historic 8.3
ornate 8.2
cash 8.2
style 8.2
postmark 7.9
postage 7.9
text 7.9
travel 7.7
god 7.7
old fashioned 7.6
banking 7.4
painting 7.2
creative 7.1
surface 7.1
textured 7

Google
created on 2019-11-09

Microsoft
created on 2019-11-09

text 100
book 99.7
drawing 99.4
sketch 98.8
cartoon 93.8
illustration 88.9
art 85.9
painting 84.9
person 80.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 54.1%
Disgusted 45%
Sad 45%
Happy 46.3%
Calm 53.7%
Fear 45%
Angry 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 19-31
Gender Male, 54.1%
Angry 45%
Surprised 45%
Fear 45%
Disgusted 45%
Calm 54.9%
Happy 45.1%
Sad 45%
Confused 45%

AWS Rekognition

Age 21-33
Gender Male, 54.7%
Confused 45%
Happy 45%
Calm 54.9%
Angry 45%
Sad 45%
Surprised 45%
Fear 45%
Disgusted 45%

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Painting 88.6%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-11-09

a close up of a book 55.7%
close up of a book 50.9%
a hand holding a book 50.8%

Text analysis

Amazon

Roumois
Cons
Conscils
u
Coupeawui
9ual
sensis u Akhar'g Cose-e Roumois 165O Coupeawui Jacues bal Cons SuRoy
bal
Jacues
lle
Laide
A6b9e
Conscils 9ual cn'es lle A6b9e Ja Laide
SuRoy
pzicie
sensis
victoive
cn'es
165O
Akhar'g
victoive pzicie cn _Let
cn
Cose-e
Ja
_Let

Google

val Coupcauville1Jacqueual Cons SuRoy cnes Con SeitsA6e 9e ctoiree sisie 9u Cese-Akhar cn Roumeis bso
val
Coupcauville1Jacqueual
Cons
SuRoy
sisie
9u
Cese-Akhar
cn
Roumeis
bso
cnes
Con
SeitsA6e
9e
ctoiree