Human Generated Data

Title

Return from Egypt

Date

17th century

People

Artist: Lucas Vorsterman, I, Flemish 1595 - 1675

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G4004

Human Generated Data

Title

Return from Egypt

People

Artist: Lucas Vorsterman, I, Flemish 1595 - 1675

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.2
Person 99.2
Painting 98.2
Art 98.2
Person 96.9
Person 96.8

Clarifai
created on 2019-11-16

people 99.8
illustration 98.6
print 98.5
art 98.3
man 97.7
adult 97.5
group 96.8
painting 93.5
engraving 92.1
woman 89.8
two 87.8
religion 86.8
one 86.6
pain 83.7
book 83
book bindings 82.1
portrait 81.6
leader 80.1
wear 79.5
veil 79

Imagga
created on 2019-11-16

sketch 80.4
drawing 60.6
representation 49.2
art 31.9
statue 27.3
sculpture 25.1
old 23
religion 21.5
ancient 20.8
book jacket 20.7
vintage 19
antique 18.5
history 17.9
church 17.6
jacket 16.1
architecture 15.8
saint 15.4
decoration 15.2
religious 15
comic book 14.2
figure 13.8
holy 13.5
monument 13.1
cemetery 12.9
detail 12.9
culture 12.8
symbol 12.8
retro 12.3
wrapping 12.3
man 12.1
grunge 11.9
stone 11.9
angel 11.7
city 11.6
tourism 11.6
spirituality 11.5
design 11.2
postmark 10.8
stamp 10.7
carving 10.6
mail 10.5
god 10.5
artistic 10.4
famous 10.2
travel 9.9
one 9.7
spiritual 9.6
faith 9.6
landmark 9
currency 9
postage 8.9
postal 8.8
catholic 8.8
temple 8.7
covering 8.7
paper 8.6
wall 8.6
historical 8.5
black 8.4
decorative 8.4
letter 8.3
historic 8.3
artwork 8.2
building 7.9
icon 7.9
envelope 7.9
marble 7.9
cathedral 7.8
money 7.7
capital 7.6
pattern 7.5
style 7.4
closeup 7.4
gold 7.4
painting 7.2
museum 7.2

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 100
book 99.1
drawing 89.4
person 87.7
sketch 85
old 78
horse 68.3
clothing 65.9
painting 64.4
statue 63.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Male, 52%
Calm 54.6%
Sad 45.3%
Happy 45%
Angry 45%
Fear 45%
Surprised 45.1%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 49-67
Gender Male, 98.2%
Fear 3.1%
Sad 6.7%
Surprised 3.2%
Angry 64.5%
Disgusted 0.3%
Confused 4.8%
Happy 0.4%
Calm 17.1%

AWS Rekognition

Age 3-9
Gender Female, 51.4%
Sad 45.2%
Disgusted 45%
Confused 45%
Surprised 45.1%
Happy 45.9%
Fear 45%
Angry 45.1%
Calm 53.7%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 98.2%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 80%
a vintage photo of a group of people posing for a picture 79.9%
a group of people posing for a photo 79.8%

Text analysis

Amazon

MARCHIONI
IN
EXCELLENTISSIMO
IOANNI
ITEMO.
A
FVGAM
SPINVLAF.
CAVSSA
BVRENS
INDIARVMO.
PETEVS PAVIVS BVRENS CAVSSA
PAVIVS
PETEVS
NoBrLr VIPo IOANNI VELASCO HISPANIARVM INDIARVMO. MONARCH.E, ITEMO. EXCELLENTISSIMO MARCHIONI SPINVLAF. A SECRETIB .
HISPANIARVM
VELASCO
MONARCH.E,
SECRETIB .
EOYPTVML.
DEt Er MATRIS PILU FVGAM IN EOYPTVML.
DEt
Chri/Naflini,
VIPo
MATRIS
PILU
NoBrLr
Er

Google

ET
SPINVLAE
BVBENS
Balasie
HISPANIARvM
INDIARVMQ.
MONARCHE,
ITEMQ.
EXCELLENTISSIMO
MARCHIONI
5ECRETIS
Belaarum,
a
ad.
T.T.Tah
piit
FIL
NOBILI
VIRO
PAVVS
BENIVOLENTIE
CAVSSA
7ruya
Chrn
Trisu
La
DEt ET MATRIS ET FIL FVGAM IN EGYPTVM NOBILI VIRO 1OANNI VEI.ASco HISPANIARvM INDIARVMQ. MONARCHE, ITEMQ. EXCELLENTISSIMO MARCHIONI SPINVLAE A 5ECRETIS PETEVS PAVVS BVBENS BENIVOLENTIE CAVSSA INSCTPSTT. Coe 7ruya Res Chrn Sanffii, Trisu Belaarum, Dnenon Balasie La a ad. T.T.Tah piit
MATRIS
FVGAM
1OANNI
VEI.ASco
A
INSCTPSTT.
Coe
Res
DEt
IN
EGYPTVM
PETEVS
Sanffii,
Dnenon