Human Generated Data

Title

Madonna of Saint Jerome

Date

1586

People

Artist: Agostino Carracci, Italian 1557 - 1602

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Alpheus Hyatt Purchasing Fund, S1.10

Human Generated Data

Title

Madonna of Saint Jerome

People

Artist: Agostino Carracci, Italian 1557 - 1602

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Date

1586

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Art 98.5
Painting 98.5
Human 96.5
Person 96.5
Person 94.5
Person 93.6
Person 92
Person 90.8

Clarifai
created on 2018-04-19

people 100
group 99.5
adult 98.6
art 96.6
print 96.2
woman 95.8
illustration 95.6
engraving 95.5
man 95.2
child 95
many 94.1
painting 92.4
baby 91.9
religion 90.3
veil 90
family 88.8
wear 88.6
sit 88.5
kneeling 88.1
war 87.6

Imagga
created on 2018-04-19

sketch 52.4
drawing 39.7
art 35.9
representation 30
sculpture 22.5
religion 20.6
statue 20.5
design 19.9
detail 18.5
church 18.5
comic book 15.6
decoration 15.5
religious 15
old 14.6
ancient 13.8
artistic 13
holy 12.5
pattern 12.3
culture 12
catholic 11.7
black 11.5
figure 11.2
artwork 11
decorative 10.9
face 10.7
antique 10.6
god 10.5
style 10.4
architecture 10.2
covering 9.9
element 9.9
marble 9.8
tattoo 9.7
saint 9.6
faith 9.6
stone 9.6
light 9.4
money 9.4
colorful 9.3
cash 9.2
vintage 9.1
dress 9
currency 9
history 8.9
color 8.9
graphic 8.8
cathedral 8.6
grunge 8.5
traditional 8.3
banking 8.3
effect 8.2
retro 8.2
fantasy 8.1
man 8.1
shape 7.9
ornament 7.8
spiritual 7.7
spirituality 7.7
texture 7.6
window 7.6
column 7.5
famous 7.4
symbol 7.4
person 7.4
painting 7.2
portrait 7.1
glass 7.1
travel 7
textured 7

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

text 100
book 100
old 57.6
posing 41

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 83.8%
Angry 3.2%
Calm 1.8%
Happy 37.7%
Disgusted 4.4%
Surprised 2.8%
Sad 46.7%
Confused 3.4%

AWS Rekognition

Age 26-43
Gender Female, 97.5%
Angry 3%
Sad 8.7%
Calm 79.6%
Happy 1.8%
Surprised 1.6%
Disgusted 3.1%
Confused 2.2%

AWS Rekognition

Age 35-52
Gender Female, 67.6%
Calm 42.7%
Happy 1.5%
Surprised 2.6%
Sad 33.5%
Disgusted 1.6%
Angry 6%
Confused 12.1%

AWS Rekognition

Age 23-38
Gender Female, 52.7%
Confused 45.3%
Calm 45.2%
Happy 45.1%
Sad 51.4%
Disgusted 45.9%
Surprised 45.2%
Angry 47%

AWS Rekognition

Age 10-15
Gender Female, 51.5%
Angry 45.3%
Sad 51.2%
Calm 46%
Happy 46.9%
Surprised 45.3%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 4-7
Gender Female, 52.6%
Happy 46.1%
Surprised 45.3%
Calm 46.3%
Confused 45.1%
Sad 51.8%
Angry 45.2%
Disgusted 45.1%

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.5%
Person 96.5%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 80.1%
a vintage photo of a group of people posing for a picture 80%
a group of people posing for a photo 79.9%

Text analysis

Amazon

PERITISET
DELPHINO
DICAT
GRATI
ERGO
INVENTIONE
ANIMI
T'YBERIO DELPHINO PHISICR PERITISET C.
PHISICR
INVENTIONE OPTIME MERITO ANIMI
PICTORIS
C.
MERITO
EMHANC EXIMII PICTORIS GRATI ERGO DICAT SACRATQ-
EMHANC
OPTIME
T'YBERIO
SACRATQ-
EXIMII
Rarriconi
Rarriconi frmis
frmis

Google

MERITO
DIGAT
TYBERIO
DELPHINO
HANC
PICTORIS
SACRATQ.
ERGO
TYBERIO DELPHINO PHISICR. PERITISS ET C OPTIME MERITO INVENTIONEM HANC EXIMII PICTORIS ANTONII CORRIGIENSTS GRATI ANIMI ERGO DIGAT SACRATQ.
PERITISS
ET
C
ANTONII
CORRIGIENSTS
PHISICR.
OPTIME
INVENTIONEM
EXIMII
GRATI
ANIMI