Human Generated Data

Title

The Holy Family with Saints Elizabeth and John

Date

1634

People

Artist: Fra Bonaventura Bisi, Italian 1612 - 1659

Artist after: Giorgio Vasari, Italian 1511 - 1574

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, by exchange, S2.50

Human Generated Data

Title

The Holy Family with Saints Elizabeth and John

People

Artist: Fra Bonaventura Bisi, Italian 1612 - 1659

Artist after: Giorgio Vasari, Italian 1511 - 1574

Date

1634

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Art 98.6
Painting 93.9
Person 91.2
Human 91.2
Person 82
Person 58

Clarifai
created on 2018-04-19

people 100
art 99.9
print 99.7
group 99.6
illustration 99.5
adult 99.3
painting 99.1
man 98.6
engraving 97.8
one 96.4
kneeling 95.7
religion 95.2
leader 95.2
facial hair 94.8
Renaissance 94.4
woman 94.4
many 94
gown (clothing) 93.2
saint 93.2
royalty 93.1

Imagga
created on 2018-04-19

sketch 82.7
drawing 59.5
representation 50
art 37.9
sculpture 35.7
religion 30.5
statue 28.3
architecture 27.5
ancient 24.2
temple 24
culture 24
decoration 22.7
design 21.1
history 20.6
religious 19.7
church 19.4
god 19.2
carving 17.4
stone 17.1
old 16.7
carved 15.7
holy 15.4
pattern 15.1
antique 14.4
monument 14
tattoo 13.8
detail 12.9
decorative 12.5
artistic 12.2
column 12
historical 11.3
famous 11.2
figure 11.1
cash 11
traditional 10.8
tourism 10.7
travel 10.6
spiritual 10.6
spirituality 10.6
building 10.3
money 10.2
artwork 10.1
vintage 9.9
currency 9.9
gold 9.9
style 9.7
face 9.2
exterior 9.2
banking 9.2
historic 9.2
city 9.2
close 9.1
black 9
color 8.9
museum 8.9
decor 8.9
century 8.8
symbol 8.8
shape 8.7
meditation 8.6
faith 8.6
oriental 8.5
element 8.3
financial 8
marble 8
sculptures 7.9
holiday 7.9
worship 7.7
wall 7.7
texture 7.6
door 7.6
finance 7.6
tourist 7.3
painting 7.2

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

text 100
book 100

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 86.8%
Happy 0.3%
Disgusted 0.2%
Calm 30.1%
Surprised 0.5%
Angry 1.5%
Confused 0.7%
Sad 66.7%

AWS Rekognition

Age 26-43
Gender Male, 55%
Calm 48.2%
Sad 49.9%
Confused 45.5%
Disgusted 45.1%
Happy 45.2%
Surprised 45.2%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 45.3%
Happy 45%
Calm 52.5%
Surprised 45.3%
Angry 45.9%
Disgusted 45.6%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 63.8%
Sad 89.8%
Disgusted 0.7%
Angry 2.8%
Calm 5%
Confused 0.7%
Happy 0.3%
Surprised 0.7%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 93.9%
Person 91.2%

Captions

Microsoft

a cat sitting on top of a book 23.5%
a group of men sitting next to a book 23.4%
a person sitting on a book 23.3%

Text analysis

Amazon

gratitud
testim.
Bisius
humanitatis
Min.
Bonau Bisius Min. Conu. gratitud testim. D.D.
fontiperenni
munificentia
aPuteo
D.D.
I1L."OD.D. Equ.Cafsiano aPuteo humanitatis se munificentia fontiperenni
Equ.Cafsiano
EB.B.E
Bonau
Conu.
se
i63
I1L."OD.D.

Google

IDDEquCgsiano aPutero humaninatis or munifentia fonth peremi E.Bonau Bisius Min.Comu.gratitud. trdim. D.D
IDDEquCgsiano
Bisius
trdim.
humaninatis
aPutero
fonth
peremi
E.Bonau
Min.Comu.gratitud.
munifentia
D.D
or