Human Generated Data

Title

Madonna and Child
Date

18th-19th century
People

Artist: João Caetano Rivara, Portuguese actual dates unknown; active 1788-1803

Artist after: Andrea del Sarto, Italian 1486 - 1530
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R895NA

Human Generated Data

Title

Madonna and Child

People

Artist: João Caetano Rivara, Portuguese actual dates unknown; active 1788-1803

Artist after: Andrea del Sarto, Italian 1486 - 1530

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Art 97.9
Human 94.8
Person 94.8
Drawing 83.2
Painting 77.6
Sketch 66.1

Clarifai
created on 2019-10-30

people 99.7
art 99.6
portrait 98.6
painting 98.6
adult 98.5
one 96.6
illustration 96
print 95.8
man 94.5
museum 93.8
picture frame 93.6
woman 91.5
baroque 88.6
group 87.1
music 85.6
nude 84.6
retro 81.4
leader 81
wear 78.9
exhibition 77.7

Imagga
created on 2019-10-30

newspaper 44.3
creation 35.7
product 35.6
money 28.9
cash 27.4
currency 26.9
dollar 22.3
bill 21.9
paper 21.2
vintage 20.7
business 18.8
bank 18.8
financial 18.7
one 18.7
finance 18.6
banking 18.4
close 17.7
old 16.7
dollars 16.4
representation 16.1
brass 16
memorial 15.6
art 15.6
symbol 15.5
exchange 15.3
wealth 14.4
web site 13.7
culture 13.7
stamp 13.5
us 13.5
man 13.4
mail 13.4
rich 13
portrait 12.9
letter 12.8
postmark 12.8
postage 12.8
sculpture 12.5
statue 12.5
savings 12.1
ancient 12.1
postal 11.8
banknotes 11.7
hundred 11.6
antique 11.5
pay 11.5
unique 11.4
envelope 11
museum 10.9
history 10.7
structure 10.7
banknote 10.7
face 10.6
states 10.6
finances 10.6
post 10.5
fine 10.5
closeup 10.1
investment 10.1
people 10
daily 9.9
printed 9.8
cutting 9.7
loan 9.6
communications 9.6
united 9.5
photograph 9.5
mug shot 9.4
drawing 9.4
economy 9.3
kin 9.3
male 9.2
mother 9.2
global 9.1
reflection 9.1
black 9
masterpiece 8.9
known 8.9
market 8.9
shows 8.9
office 8.8
funds 8.8
paintings 8.8
bills 8.7
architecture 8.6
painted 8.6
historical 8.5
head 8.4
retro 8.2
religion 8.1
picture 8
design 8
sketch 8
icon 7.9
post mail 7.9
zigzag 7.9
fame 7.9
circa 7.9
painter 7.8
delivery 7.8
notes 7.7
profit 7.6
person 7.6
capital 7.6
sign 7.5
note 7.3
travel 7

Google
created on 2019-10-30

Picture frame 89.5
Painting 86.2
Art 78.9
Illustration 66.9
Stock photography 65.4
Drawing 63.2
Visual arts 62.5
Antique 56.3
Modern art 55.4

Microsoft
created on 2019-10-30

room 99.9
scene 99.8
gallery 99.5
drawing 98.6
art 97.2
sketch 96.3
person 91.9
painting 91
clothing 86.2
museum 82
woman 80.4
text 59.2
picture frame 53.6
old 45.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 5-15
Gender Female, 55%
Happy 45.2%
Surprised 45.2%
Sad 45%
Disgusted 45%
Angry 45%
Calm 54.5%
Confused 45%
Fear 45%

AWS Rekognition

Age 16-28
Gender Female, 54.6%
Calm 45.2%
Confused 45%
Sad 45.2%
Angry 45.3%
Surprised 45%
Disgusted 45%
Happy 54.1%
Fear 45%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.8%
Painting 77.6%

Captions

Microsoft

an old photo of a person 64.5%
an old photo of a person in a room 64.4%
old photo of a person 59.4%

Text analysis

Amazon

ENPANHA
PRINCENA
D.CARLOTA
NENHORA
MAGNANIMA
INFANTA DE
PRINCENA DO BRASIL INFANTA DE ENPANHA
ASERENISSIMA NENHORA D.CARLOTA IOAOUIYA
BRASIL
DO
PLA MAGNANIMA ATGUNTA
ASERENISSIMA
ATGUNTA
PLA
IOAOUIYA
Crhan
Crhan )Ohinphe
)Ohinphe
Gyelir
e Gyelir
e

Google

SERENISSIMA SENHORA D.CARLOTA 10A QUINA PRINCESA DO BRASIL. INFANTA DE ESPANHA PIA MAGNAN1MA AUGUSTA
SERENISSIMA
SENHORA
D.CARLOTA
10A
QUINA
PRINCESA
DO
BRASIL.
INFANTA
DE
ESPANHA
PIA
MAGNAN1MA
AUGUSTA