Human Generated Data

Title

Equestrian Portrait
Date

18th century
People

Artist: Unidentified Artist,

Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Estate of Rev. Edward H. Hall, 1912.4

Human Generated Data

Title

Equestrian Portrait

People

Artist: Unidentified Artist,

Date

18th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Mammal 98.8
Horse 98.8
Animal 98.8
Human 96.8
Art 93.9
Drawing 88.6
Person 77.2
Sketch 68.4
Clothing 67.6
Apparel 67.6
Painting 58.6

Clarifai
created on 2020-05-02

cavalry 100
print 99.7
illustration 99.7
people 99.7
seated 99.6
art 99.6
mammal 99.1
sword 98
wear 97.3
weapon 96.4
engraving 96.3
one 94.6
military 94.3
painting 93.3
adult 93.1
man 92.1
two 91.4
vintage 90.7
equestrian 90.4
veil 88.5

Imagga
created on 2020-05-02

fountain 72.7
structure 48.8
sculpture 30.9
statue 29.4
architecture 20.3
old 19.5
art 19.1
ancient 19
building 17.4
history 17
decoration 17
city 16.6
travel 16.2
stone 16.1
monument 14.9
tourism 14.8
landmark 13.5
historic 12.8
historical 12.2
dirty 11.7
people 11.7
graffito 11.6
grunge 11.1
man 10.8
culture 10.3
lifestyle 10.1
tourist 10.1
figure 10
vintage 9.9
antique 9.6
black 9.6
body 9.6
famous 9.3
snow 9.2
dress 9
human 9
person 8.9
detail 8.8
wall 8.8
portrait 8.4
horse 8.3
sky 8.3
outdoors 8.2
religion 8.1
facade 8
roman 7.9
artistic 7.8
marble 7.7
palace 7.7
sketch 7.7
god 7.7
fashion 7.5
drawing 7.4
water 7.3
carving 7.2
posing 7.1

Google
created on 2020-05-02

Bridle 98.4
Rein 87.5
Horse 84.1
Horse tack 81.7
Headgear 69.2
Art 65.5
Recreation 64.3
Stock photography 64
Painting 63
Drawing 60.7
Pack animal 59.2
Dressage 58.4
Illustration 57.7
Horse harness 56.4
Visual arts 55
Saddle 50.7

Microsoft
created on 2020-05-02

horse 99
text 98.9
sketch 96.3
drawing 95.3
animal 92.3
outdoor 91.9
illustration 71.4
old 45.5
posing 38.8

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 14-26
Gender Male, 51%
Confused 45%
Surprised 45.1%
Happy 45%
Fear 45%
Sad 45%
Disgusted 48.6%
Calm 45.3%
Angry 50.9%

Microsoft Cognitive Services

Age 22
Gender Female

Feature analysis

Amazon

Horse 98.8%
Person 77.2%

Captions

Microsoft

a person riding a horse 88.1%
a black and white photo of a person riding a horse 81.3%
a man and a woman riding a horse 76.7%

Text analysis

Amazon

I5AVIZ