Human Generated Data

Title

Finding the Body of Saint Francis Xavier

Date

17th-18th century

People

Artist: Johann Jacob Frey, German 1681 - 1752

Artist after: Carlo Maratti, Italian 1625 - 1713

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3326

Human Generated Data

Title

Finding the Body of Saint Francis Xavier

People

Artist: Johann Jacob Frey, German 1681 - 1752

Artist after: Carlo Maratti, Italian 1625 - 1713

Date

17th-18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3326

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.2
Person 99.2
Art 97.1
Painting 97
Person 92.2
Person 92
Person 90.2
Person 89.3
Person 86.8
Person 86.3
Person 65.5
Person 63.1
Archangel 59.4
Angel 59.4

Clarifai
created on 2019-11-06

art 99.8
people 99.7
print 99.5
illustration 99.4
engraving 97.2
group 97.1
painting 96.9
religion 96.2
book 96.1
man 95.7
Renaissance 95.6
saint 95.2
adult 95.1
baroque 95.1
antique 93.9
visuals 92.7
god 89.6
book bindings 89.4
baby 89.3
old 88.5

Imagga
created on 2019-11-06

sculpture 61.1
art 43.5
carving 41.5
statue 35.9
temple 34
religion 32.3
ancient 32
history 31.3
culture 30.8
architecture 29.6
old 23.7
stone 23.1
god 23
carved 21.5
religious 20.6
monument 18.7
church 18.5
antique 18.1
historical 17
historic 16.5
holy 16.4
decoration 16
city 15
famous 14.9
gold 14.8
plastic art 14.8
detail 14.5
figure 14.5
stucco 14.4
travel 14.1
vintage 14.1
memorial 14
structure 14
sketch 13.9
palace 13.7
spirituality 12.5
column 12.5
cemetery 12.4
tourism 12.4
design 12
sculptures 11.9
traditional 11.7
marble 11.6
symbol 11.5
door 11.4
face 11.4
oriental 11.3
museum 11.2
building 11.2
tradition 11.1
drawing 11.1
tourist 10.9
landmark 10.8
century 10.8
spiritual 10.6
style 10.4
golden 10.3
wall 10.3
pattern 10.3
bangkok 9.8
relief 9.7
worship 9.7
east 9.4
holiday 9.3
representation 9.3
exterior 9.2
decorative 9.2
brass 9.1
painting 9
carvings 8.9
king 8.7
currency 8.1
southeast 7.9
paper 7.8
artistic 7.8
figures 7.7
heritage 7.7
meditation 7.7
bronze 7.5
retro 7.4
facade 7.2

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

text 100
book 100
drawing 93.3
person 90.5
sketch 81
human face 75.7
painting 73.8
clothing 67.9
posing 56.6
old 48.3
several 11.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 41-59
Gender Male, 54.8%
Fear 45.1%
Sad 45%
Confused 45.1%
Surprised 45.6%
Disgusted 45.3%
Calm 50.9%
Angry 46.1%
Happy 46.8%

AWS Rekognition

Age 34-50
Gender Male, 54.8%
Angry 45%
Confused 45%
Calm 54.9%
Surprised 45%
Disgusted 45%
Fear 45%
Happy 45%
Sad 45%

AWS Rekognition

Age 4-12
Gender Female, 52.3%
Happy 45%
Confused 45%
Surprised 45%
Disgusted 45%
Sad 49.7%
Calm 50.1%
Angry 45.2%
Fear 45%

AWS Rekognition

Age 38-56
Gender Male, 53.5%
Calm 45.1%
Sad 45%
Confused 45%
Disgusted 45%
Angry 54.9%
Fear 45%
Happy 45%
Surprised 45%

AWS Rekognition

Age 38-56
Gender Male, 53.8%
Happy 45.7%
Fear 45.5%
Angry 47.5%
Confused 45.1%
Disgusted 45.1%
Surprised 45%
Calm 45.4%
Sad 50.6%

AWS Rekognition

Age 12-22
Gender Male, 52.3%
Disgusted 45.2%
Angry 45.1%
Fear 45%
Calm 53.8%
Confused 45%
Happy 45.7%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 10-20
Gender Female, 53.6%
Confused 45%
Sad 45.4%
Angry 47.8%
Happy 48.1%
Disgusted 45.1%
Calm 48.1%
Surprised 45.1%
Fear 45.4%

AWS Rekognition

Age 21-33
Gender Male, 53%
Happy 45.1%
Angry 53.5%
Fear 45.1%
Disgusted 45.1%
Surprised 45.1%
Calm 45.7%
Sad 45.3%
Confused 45%

Feature analysis

Amazon

Person 99.2%
Painting 97%

Categories

Captions

Microsoft
created on 2019-11-06

a vintage photo of a group of stuffed animals 40.6%

Text analysis

Amazon

Praposito
enerali
Retz
Sanciano
Reverendilsimo
ANCISCUM
Roma
in
Sactu ANCISCUM XAVERIUM Sanciano Praposito
Patri.
Reverendilsimo Patri. Francisco cisco. Retz enerali Soe esu
Soe esu
Carolo
XAVERIUM
Francisco
rpertum,
FR
Domus
Carolo FR Maratti Roma in Tenpli Domus a-lwitanis rpertum,
pietun
Maratti
Tenpli
Sactu
cisco.
a-lwitanis

Google

Reverendifsimo Patri PFrancisco Retz Praposito Generali SocIesu Sanctum FRANCISCUM XAVERIUM in Sanciano nsula cxanimema.lultanis repertum, A Carolo Maratti pictun Rema in Sacelle Templi Domus Prfe ypie ca m ac hbet Froy
Reverendifsimo
Patri
PFrancisco
Retz
Praposito
Generali
SocIesu
Sanctum
FRANCISCUM
XAVERIUM
in
Sanciano
nsula
cxanimema.lultanis
repertum,
A
Carolo
Maratti
pictun
Rema
Sacelle
Templi
Domus
Prfe
ypie
ca
m
ac
hbet
Froy