Human Generated Data

Title

Rubens' Family
Date

18th century
People

Artist: Jacob Matthias Schmutzer, German 1733 - 1811

Artist after: Peter Paul Rubens, Flemish 1577 - 1640
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3392

Human Generated Data

Title

Rubens' Family

People

Artist: Jacob Matthias Schmutzer, German 1733 - 1811

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Person 99.1
Human 99.1
Art 97.4
Person 95.1
Painting 90.7

Clarifai
created on 2019-08-10

people 99.8
art 99.3
portrait 99
adult 97.7
print 97.7
man 95.3
engraving 94.6
illustration 94.5
woman 94.4
painting 94.2
one 93.8
two 91.4
baby 90.7
child 89.3
leader 86.6
group 84.2
old 82.7
wear 82.7
antique 82.3
book bindings 80.8

Imagga
created on 2019-08-10

sketch 66.6
sculpture 65.7
statue 55.3
drawing 48.9
representation 42.4
art 38.5
carving 38
architecture 29.4
ancient 27.7
stone 26.7
religion 26
monument 25.3
history 23.3
figure 23.2
culture 23.1
old 22.3
god 19.2
temple 18.8
religious 18.8
marble 18
city 17.5
travel 16.9
column 16.8
historic 16.5
detail 16.1
famous 15.8
church 15.7
historical 15.1
tourism 14.9
decoration 14.8
catholic 14.6
landmark 14.5
building 14.3
plastic art 13.8
antique 13.2
spiritual 12.5
holy 11.6
memorial 11.5
symbol 11.5
cemetery 11.1
museum 11
vintage 10.8
heritage 10.6
palace 10.6
saint 10.6
spirituality 10.6
fountain 10.4
golden 10.3
structure 10.3
decorative 10
roman 10
face 10
carved 9.8
angel 9.8
worship 9.7
faith 9.6
design 9.2
tourist 9.1
relief 8.8
facade 8.7
capital 8.6
exterior 8.3
book jacket 8.3
cathedral 8
statues 7.9
artistic 7.8
traditional 7.5

Google
created on 2019-08-10

Painting 92.1
Art 82.9
Picture frame 72.4
Illustration 71.8
Visual arts 69.9
Stock photography 68.5
Vintage clothing 60
Drawing 55.8
Antique 51.7
Artwork 51.1

Microsoft
created on 2019-08-10

text 100
drawing 98.5
book 97.8
sketch 97
painting 96.3
person 89.5
clothing 87.1
art 75.3
human face 66.8
old 42

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-35
Gender Female, 64.7%
Surprised 30.9%
Angry 2.1%
Disgusted 1.2%
Fear 2.1%
Happy 1.7%
Sad 3.6%
Calm 55.6%
Confused 2.7%

AWS Rekognition

Age 2-8
Gender Female, 58.5%
Confused 0.6%
Happy 0.2%
Angry 1.3%
Sad 26.4%
Disgusted 0.1%
Calm 64.6%
Fear 4.9%
Surprised 1.7%

AWS Rekognition

Age 27-43
Gender Male, 52.2%
Happy 45.1%
Angry 45%
Surprised 45%
Fear 45%
Disgusted 45%
Sad 45.7%
Calm 54.1%
Confused 45%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Feature analysis

Amazon

Person 99.1%
Painting 90.7%

Captions

Microsoft

an old photo of a book 65.8%
an old photo of a person 65.7%
old photo of a book 62.5%

Text analysis

Amazon

FAMILLE
DE
RUBKNS
L.A FAMILLE DE RUBKNS Mhus Mor
L.A
350
om
Mor
Mhus
Pime
1:
Pime ansar 1:
ansar

Google

Maur Fiyd Mar gde DE RUBENS I.A FAMILLE &350
I.A
Maur
FAMILLE
Fiyd
&350
Mar
DE
RUBENS
gde