Human Generated Data

Title

Nativity

Date

19th century

People

Artist: Carlo Rampoldi, Italian c. 1775 - 1845

Artist after: Bernardino Luini, Italian c. 1480 - c. 1532

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3179

Human Generated Data

Title

Nativity

People

Artist: Carlo Rampoldi, Italian c. 1775 - 1845

Artist after: Bernardino Luini, Italian c. 1480 - c. 1532

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 99.6
Human 99.6
Painting 98.7
Art 98.7
Person 97.9
Apparel 57.8
Clothing 57.8

Clarifai
created on 2019-10-29

people 99.9
adult 99.3
group 98.6
woman 98.3
art 98.3
two 97.9
man 97.3
book series 96.9
one 96.4
illustration 96.3
print 95.7
book 95.5
furniture 93.8
leader 93.4
painting 91.2
seat 90.3
veil 89.7
administration 89.7
kneeling 89.5
book bindings 89.3

Imagga
created on 2019-10-29

newspaper 53.3
brass 46.7
product 42.1
memorial 40.4
creation 33.8
money 30.6
structure 30.4
dollar 26.9
sculpture 23.5
cash 22.9
currency 22.4
paper 21.9
banking 21.1
wealth 20.6
bank 20.6
business 20
savings 19.6
old 19.5
finance 19.4
statue 19.3
financial 18.7
art 18.4
dollars 18.3
close 18.3
bill 18.1
ancient 17.3
one 17.2
sketch 16.2
history 15.2
closeup 14.8
hundred 14.5
drawing 14.5
franklin 13.8
us 13.5
pay 13.4
loan 13.4
god 13.4
vintage 13.2
detail 12.9
religion 12.5
architecture 12.5
bills 11.7
antique 11.5
exchange 11.5
rich 11.2
culture 11.1
church 11.1
representation 10.7
states 10.6
sign 10.5
building 10.4
religious 10.3
monument 10.3
note 10.1
man 10.1
daily 9.8
decoration 9.7
catholic 9.7
banknote 9.7
debt 9.6
symbol 9.4
carving 9.3
face 9.2
historic 9.2
investment 9.2
marble 9.1
landmark 9
funds 8.8
banknotes 8.8
finances 8.7
cathedral 8.6
capital 8.5
stone 8.5
famous 8.4
letter 8.2
design 8
sales 7.7
united 7.6
portrait 7.1

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

text 98
drawing 94
person 89.7
clothing 86
sketch 83.1
painting 76.1
old 74
posing 68.8
gallery 61.7
museum 50.1
vintage 37.7
picture frame 10.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Female, 54.8%
Happy 45.2%
Disgusted 45%
Confused 45%
Calm 54.6%
Sad 45.1%
Fear 45%
Surprised 45%
Angry 45%

AWS Rekognition

Age 47-65
Gender Female, 52.7%
Happy 45%
Fear 45.1%
Disgusted 45%
Angry 45%
Sad 54.8%
Surprised 45%
Confused 45%
Calm 45.1%

AWS Rekognition

Age 13-25
Gender Female, 51.6%
Confused 45.1%
Fear 45.4%
Surprised 45%
Angry 45.1%
Happy 45.1%
Sad 52.9%
Disgusted 45.1%
Calm 46.4%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 98.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 85.7%
a vintage photo of a group of people posing for a picture 85.6%
a vintage photo of a group of people posing for a photo 83.6%

Text analysis

Amazon

DATUS
NOBIS
Efisnbietta
FILILTS
FILILTS DATUS FST NOBIS Ia IV.V
FST
(argpuam
lrrrdiuhefin
/./'/.r.ermfirmar lrrrdiuhefin P1arin Efisnbietta Thney efur thi rLareym (argpuam
P1arin
thi
IV.V
hepina
/./'/.r.ermfirmar
rLareym
efur
Ia
Limhumhe
emelo
hepina dlei': Rame Limhumhe emelo
Rame
dlei':
Thney
6.90

Google

IXV
FILIUS
e
Ree
m
del
d
NOBIS
DATUS
NOBIS l IXV EST DATUS FILIUS fienlieffa aria imband en e Regina del Ree m d
l
EST
fienlieffa
aria
imband
en
Regina