Human Generated Data

Title

Rubens and his first Wife
Date

18th-19th century
People

Artist: Carl Ernst Christoph Hess, German 1755 - 1828

Artist after: Peter Paul Rubens, Flemish 1577 - 1640
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1799

Human Generated Data

Title

Rubens and his first Wife

People

Artist: Carl Ernst Christoph Hess, German 1755 - 1828

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.5
Person 99.5
Person 98.1
Art 95.8
Apparel 94.8
Hat 94.8
Clothing 94.8
Painting 93.5
Hat 86
Bonnet 55.6

Clarifai
created on 2019-11-06

people 99.8
art 98.9
adult 98.8
two 98.5
print 98.5
one 98.2
woman 97.7
portrait 97.6
illustration 97.1
child 96.6
man 95.7
painting 95.3
group 94.8
wear 93.1
lid 91.1
retro 91
music 88.4
veil 88.2
baby 87.1
engraving 86.9

Imagga
created on 2019-11-06

sculpture 50.7
carving 39.4
art 35.2
religion 28.7
statue 27.7
god 22
architecture 20.3
history 19.7
religious 19.7
cowboy hat 19.3
ancient 19
culture 18.8
temple 18.7
hat 18.1
old 17.4
holy 17.3
plastic art 17.1
figure 17
church 15.7
headdress 14.8
spiritual 14.4
stone 14.3
antique 14
face 13.5
currency 13.5
close 13.1
famous 13
covering 12.8
money 12.8
spirituality 12.5
faith 12.4
historical 12.2
monument 12.1
man 12.1
travel 12
cash 11.9
decoration 11.9
pray 11.6
clothing 11.2
building 11.1
historic 11
finance 11
bank 10.7
prayer 10.6
bill 10.5
detail 10.5
one 10.4
dollar 10.2
design 9.9
wealth 9.9
catholic 9.7
worship 9.7
dollars 9.7
closeup 9.4
traditional 9.1
bible 8.8
carved 8.8
banknote 8.7
saint 8.7
cathedral 8.6
paper 8.5
city 8.3
peace 8.2
mask 8.1
financial 8
sacred 7.8
portrait 7.8
museum 7.8
head 7.6
sketch 7.5
decorative 7.5
human 7.5
east 7.5
symbol 7.4
gold 7.4
black 7.2
male 7.1
comic book 7.1
person 7

Google
created on 2019-11-06

Photograph 95
Painting 92.3
Picture frame 87
Art 82.2
Stock photography 74.1
Visual arts 73.1
Photography 62.4
Illustration 62.3
Still life 59.3
Vintage clothing 55.9
Antique 53
Artwork 52.3

Microsoft
created on 2019-11-06

text 99.9
clothing 98.4
wall 98
person 96.6
painting 94.7
book 94.4
human face 90.7
drawing 90.6
indoor 88.8
old 81.6
sketch 80.1
posing 70.3
woman 68
smile 51.2
vintage 44.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 93%
Happy 1.4%
Fear 4.9%
Angry 1.2%
Confused 7.6%
Disgusted 0.9%
Surprised 49.2%
Calm 32.9%
Sad 1.9%

AWS Rekognition

Age 19-31
Gender Female, 96.4%
Happy 1.8%
Sad 0.3%
Disgusted 0.3%
Angry 1.1%
Calm 95.5%
Fear 0.1%
Surprised 0.7%
Confused 0.3%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 94.8%
Painting 93.5%

Captions

Microsoft

a vintage photo of a man 92.8%
a vintage photo of a man holding a book 73.4%
a vintage photo of a man and woman posing for a picture 67.9%

Text analysis

Amazon

RUBENS
WIFE.
FURST
FEMME
AND
SA
PREMEIRE
RUBENS HIE FURST WIFE. Ot RUBENS ET SA PREMEIRE FEMME
ET
000CTO
HIE
Ot
i
oot

Google

PREMIRE
SA
RUBENS
AND
BIF1RST
WIFE
RUBENS T SA PREMIRE FEMNE RUBENS AND BIF1RST WIFE
T
FEMNE