Human Generated Data

Title

Great Holy Family

Date

16th-17th century

People

Artist: Pieter de Jode, the Elder, Flemish 1570 - 1634

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2025

Human Generated Data

Title

Great Holy Family

People

Artist: Pieter de Jode, the Elder, Flemish 1570 - 1634

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Date

16th-17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Person 99.4
Human 99.4
Person 99.1
Person 98.7
Person 98.6
Art 97.5
Painting 97.5
Person 96.6
Person 91.2
Person 91.2

Clarifai
created on 2019-10-30

people 100
illustration 99.9
print 99.9
engraving 99.6
art 99.6
adult 99.5
group 98.7
man 98.4
military 97.6
weapon 96.8
etching 96.6
soldier 96
war 95.8
woodcut 95.3
many 95
kneeling 94.9
army 94.6
sword 94.6
force 94.3
lithograph 93.9

Imagga
created on 2019-10-30

gymnosperm 60.2
spermatophyte 45.2
vascular plant 30.4
sand 27.9
desert 24.9
art 18.4
money 17.9
currency 16.1
old 16
paper 15.7
cash 15.6
plant 14.8
finance 14.4
bank 14.3
dollar 13.9
banking 13.8
retro 13.1
ancient 13
travel 12.7
financial 12.5
bill 12.4
note 11.9
sculpture 11.6
design 11.6
antique 11.5
sky 11.5
landscape 11.1
soil 11.1
drawing 11
vintage 10.7
decoration 10.7
detail 10.5
earth 9.9
history 9.8
close 9.7
exchange 9.5
beach 9.5
newspaper 9.4
symbol 9.4
stone 9.4
business 9.1
tourism 9.1
outdoors 9
statue 8.9
style 8.9
color 8.9
artistic 8.7
rock 8.7
pay 8.6
colorful 8.6
grunge 8.5
texture 8.3
product 8.3
vacation 8.2
national 8.2
brown 8.1
closeup 8.1
wealth 8.1
sea 7.7
us 7.7
sketch 7.7
ocean 7.6
pattern 7.5
water 7.3
letter 7.3
tree 7.2
mountain 7.1
architecture 7

Google
created on 2019-10-30

Microsoft
created on 2019-10-30

text 100
book 99.8
drawing 97.8
person 94.9
sketch 94.4
clothing 90
outdoor 87
old 85.5
painting 83.4
posing 69
man 64.9
cartoon 64.3
engraving 57.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-67
Gender Male, 54.9%
Angry 45%
Happy 45%
Fear 45%
Disgusted 45%
Surprised 45%
Calm 54.9%
Confused 45%
Sad 45.1%

AWS Rekognition

Age 21-33
Gender Female, 51.2%
Calm 54.9%
Disgusted 45%
Angry 45.1%
Surprised 45%
Fear 45%
Happy 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 26-42
Gender Female, 51.2%
Happy 46.3%
Confused 45%
Disgusted 45.1%
Sad 45.2%
Angry 48.2%
Fear 45%
Calm 50%
Surprised 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Sad 47.7%
Fear 45%
Calm 52.2%
Disgusted 45%
Happy 45%
Angry 45%
Surprised 45%
Confused 45%

AWS Rekognition

Age 25-39
Gender Female, 54.9%
Angry 45%
Fear 45%
Happy 45%
Disgusted 45%
Calm 54.9%
Confused 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 21-33
Gender Female, 52.2%
Calm 53.3%
Surprised 45%
Confused 45%
Angry 45.3%
Fear 45%
Disgusted 45.2%
Happy 45.2%
Sad 45.8%

AWS Rekognition

Age 58-76
Gender Male, 50.7%
Surprised 45%
Happy 45.4%
Fear 45%
Confused 45%
Sad 45.1%
Calm 54.3%
Angry 45.1%
Disgusted 45%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 97.5%

Captions

Microsoft

a vintage photo of a group of people sitting posing for the camera 84.3%
a vintage photo of a group of people posing for the camera 84.1%
a vintage photo of a group of people posing for a picture 84%

Text analysis

Amazon

viserat
infans
inde
st
adeo
Nontia
aluo
claufum
mutua
ante
hic
quoque
Materna
nout
ct
sic
vita
vel
Wnde nout quid zisit ct infans Materna claufum claufus viserat aluo Nontia inde adeo st hae mutua niutuls inde
quid
Deum.
hunc
lumina
Deus:
diem
noucrat
Aute
perpuerum
claufus
zisit
Iupitntem. t rensa gaudet vterque mam hunc Deus: hic vel sic noucrat ante Deum. Aute diem et vita lumina spirar amor
et
spirar
hae
gaudet
Wnde
niutuls
vterque
t rensa
mam
Iupitntem.
amor
Thar
Fefivit
Thar Fefivit cufurnt
cufurnt

Google

Notitia
inde
adeo
et
infans
Iufantem
vtergue
Marerna
Ante
nouerat
cst
mutua
puer
syeirat
kunc
Deum
muruus
puerum
prensa
claufus
aluo
Deus:
vel
sic
Notitia inde adeo cst hac mutua muruus inde Vnde puer puerum nouit quid int et infans Iufantem et prensa gandet vtergue mamu Marerna claufum claufus quoque viserat aluo Ante diem et vita lumina syeirat amor kunc Deus: hic vel sic nouerat ante Deum
Vnde
nouit
int
gandet
mamu
claufum
viserat
vita
lumina
amor
hac
quid
quoque
diem
hic
ante