Human Generated Data

Title

Virgin Mary, Infant Jesus, and Elizabeth
Date

1776
People

Artist: Robert Menageot, French 18th-19th centuries

Artist after: Guido Reni, Italian 1575 - 1642
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R10425

Human Generated Data

Title

Virgin Mary, Infant Jesus, and Elizabeth

People

Artist: Robert Menageot, French 18th-19th centuries

Artist after: Guido Reni, Italian 1575 - 1642

Date

1776

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Person 99.4
Human 99.4
Person 97.8
Art 97
Painting 97
Person 94.4

Clarifai
created on 2019-11-09

people 99.9
adult 99.5
one 98.9
art 98.5
print 97.6
man 97.4
portrait 97.3
religion 97.2
reclining 94.5
Renaissance 92.2
painting 92.1
veil 92
woman 91.3
two 90
gown (clothing) 88.3
group 87.5
furniture 86.9
illustration 85.3
saint 84.6
aura 84.1

Imagga
created on 2019-11-09

money 63.8
currency 59.3
cash 54
dollar 53.9
wealth 47.6
finance 47.3
bank 39.2
financial 37.4
business 37.1
banking 36.8
dollars 35.8
paper 35.3
hundred 34.9
bill 33.3
brass 33.1
one 29.9
close 28
us 28
savings 27.1
memorial 26.6
franklin 24.6
pay 24
loan 24
exchange 23.9
finances 22.2
rich 21.4
bills 21.4
banknote 19.4
structure 19
economy 18.6
banknotes 17.6
investment 17.4
states 17.4
funds 16.7
closeup 16.2
number 15.9
president 15.7
comic book 14.7
coin 14.3
capital 14.2
market 14.2
phonograph record 13.9
note 13.8
depository 13.4
united 13.3
art 13.1
commerce 13.1
success 12.9
sign 12.8
old 12.5
debt 12.5
profit 12.5
concepts 12.4
museum 12
sculpture 11.8
wages 11.8
object 11.7
vintage 11.7
payment 11.6
change 11.5
symbol 11.4
bust 11
treasury 10.7
facility 10.3
stamp 10.1
monetary 9.8
portrait 9.7
value 9.7
price 9.6
mail 9.6
post 9.5
buy 9.4
stock 9.4
face 9.2
greenback 8.9
postmark 8.9
spend 8.8
paying 8.7
coins 8.7
notes 8.6
culture 8.5
pile 8.4
retro 8.2
backgrounds 8.1
metal 8
economics 7.8
rate 7.8
fine 7.6
heap 7.5
ideas 7.5
gold 7.4
single 7.4
icon 7.1
book jacket 7.1
china 7

Google
created on 2019-11-09

Painting 90.5
Art 82
Visual arts 74.6
Stock photography 68.5
Illustration 64
Prophet 62.1
Picture frame 53.9
Drawing 51.1

Microsoft
created on 2019-11-09

text 100
book 100
drawing 96.3
sketch 92.3
human face 90.4
person 75.2
old 52
painting 51.9
posing 37.8
vintage 35

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 93.3%
Fear 0%
Disgusted 0.1%
Calm 93.1%
Happy 5.4%
Surprised 0.1%
Sad 1%
Angry 0%
Confused 0.2%

AWS Rekognition

Age 2-8
Gender Female, 88.1%
Calm 84.5%
Sad 3.3%
Fear 2.3%
Disgusted 0.3%
Angry 0.9%
Happy 6.1%
Surprised 1.9%
Confused 0.6%

AWS Rekognition

Age 23-37
Gender Female, 55.5%
Confused 0.3%
Angry 0.1%
Calm 3.5%
Surprised 0%
Happy 0.9%
Disgusted 0%
Fear 0.3%
Sad 94.7%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 97%

Captions

Microsoft

a vintage photo of a person holding a book 53.4%
a vintage photo of a book 53.3%
a vintage photo of a person holding a book 53.1%

Text analysis

Amazon

JESUS,
MARY,
INFANT
AND
VIRGI
ELIZABETH.
Guido,
Reniz
ofe
Duane
Collection
The MARY, AND Mathen Duane Ser.
Mathen
The
gnitn Reniz Piarit. VIRGI INFANT JESUS, ELIZABETH. aris 19748 dnpoucle
Piarit.
Irm
the
Chaypridte
Lonton.
gnitn
LPiilare
Irm the Onginl LPiilare lby Guido, m the Collection ofe y.
padi:
19748
aris
Memageet,
Plihetalan iszo Chaypridte Lonton.
Plihetalan
Onginl
m
.Rol:
.Rol: Memageet, delanit padi:
Ser.
dnpoucle
lby
iszo
delanit
y.

Google

Robs
d
INFANT
AND
rm
Mathen
Cugnver
Chopoide
London
Pinit
BPari
honch
VIR
ELIZABETH
OriganlPiare
the
Publched
Boydall
174
JESUS,
Cletion
March
oly
Guider
delinia
GIN
MARY,
y
Guudo
in
ohm
Guider Reni Pinit Robs Menaget delinia d BPari 174 honch THE VIR GIN MARY, INFANT JESUS, AND ELIZABETH rm the OriganlPiare y Guudo in the Cletion of Mathen uane Publched March oly ohm Boydall Cugnver in Chopoide London derManast
Reni
Menaget
THE
of
uane
derManast