Human Generated Data

Title

Marriage of the Virgin
Date

19th century
People

Artist: Carlo Rampoldi, Italian c. 1775 - 1845

Artist after: Bernardino Luini, Italian c. 1480 - c. 1532
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3568

Human Generated Data

Title

Marriage of the Virgin

People

Artist: Carlo Rampoldi, Italian c. 1775 - 1845

Artist after: Bernardino Luini, Italian c. 1480 - c. 1532

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99.3
Person 99.3
Person 99
Person 98.9
Person 97.8
Person 97.6
Person 97.6
Art 94.4
Person 93.6
Painting 93.4
Person 78.4
Person 61.7
Person 54.6

Clarifai
created on 2019-11-07

people 100
group 99.5
art 99.4
adult 99.1
man 97.7
illustration 97.7
leader 97.5
print 97.3
portrait 97
woman 96.6
painting 95.2
engraving 92.1
furniture 90.9
music 90.9
two 90.7
administration 89.2
museum 89
wear 87.2
three 86.8
four 85.2

Imagga
created on 2019-11-07

sculpture 42.5
statue 41
art 33.6
old 29.9
sketch 26.2
religion 26
ancient 23.3
drawing 23.2
history 21.5
religious 20.6
god 20.1
antique 19.9
monument 19.6
architecture 18.7
marble 18.3
vintage 18.2
stone 17.7
representation 17.7
catholic 17.5
faith 17.2
church 16.6
building 15.3
detail 15.3
culture 14.5
landmark 14.4
holy 14.4
spiritual 14.4
daily 14.3
historical 14.1
tourism 14
carving 14
famous 14
symbol 12.8
saint 12.5
altar 12.5
cathedral 12.5
spirituality 12.5
structure 12.1
travel 12
pray 11.6
prayer 11.6
figure 11.3
column 10.4
theater curtain 10.2
black 10.2
city 10
decoration 9.9
statues 9.8
temple 9.8
artistic 9.5
museum 9.4
historic 9.2
dress 9
postmark 8.9
fountain 8.8
stamp 8.7
scene 8.6
mail 8.6
face 8.5
letter 8.2
curtain 8.1
closeup 8.1
interior 8
postage 7.9
postal 7.8
angel 7.8
roman 7.8
sacred 7.8
king 7.8
traditional 7.5
style 7.4
retro 7.4
peace 7.3
tourist 7.2
aged 7.2
color 7.2
person 7.1

Google
created on 2019-11-07

Picture frame 85.9
Art 84.4
Painting 77.5
Antique 59.8
Visual arts 55
History 54.1
Illustration 50.4
Collection 50

Microsoft
created on 2019-11-07

gallery 99.8
wall 98.9
room 98.9
scene 97.6
posing 95.6
old 95.4
person 95.3
clothing 94.4
indoor 91.2
drawing 90.5
black 83.7
text 80.6
sketch 80.5
woman 77.5
white 77
group 59.8
vintage 53.2
museum 52
clothes 16.5

Face analysis

Amazon

AWS Rekognition

Age 13-23
Gender Female, 53.3%
Happy 45.8%
Sad 45.2%
Fear 45.3%
Angry 45.4%
Calm 53.1%
Disgusted 45.1%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 29-45
Gender Male, 52.2%
Fear 45%
Calm 54.5%
Angry 45.1%
Confused 45%
Sad 45.3%
Happy 45%
Surprised 45%
Disgusted 45.1%

AWS Rekognition

Age 13-25
Gender Male, 52.6%
Fear 45.1%
Sad 45.3%
Surprised 45.1%
Calm 52.9%
Happy 45.3%
Disgusted 45.3%
Confused 45.1%
Angry 46%

AWS Rekognition

Age 13-23
Gender Female, 53.7%
Sad 45%
Angry 45%
Surprised 45%
Happy 45.1%
Fear 45%
Calm 54.8%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 17-29
Gender Female, 50.3%
Calm 50.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%
Confused 49.5%
Surprised 49.5%
Sad 49.5%
Disgusted 49.5%

AWS Rekognition

Age 36-52
Gender Female, 51.4%
Surprised 45%
Disgusted 45%
Fear 45%
Sad 45.2%
Calm 54.6%
Angry 45.1%
Confused 45%
Happy 45.1%

AWS Rekognition

Age 13-25
Gender Male, 51.8%
Fear 54%
Calm 45.1%
Happy 45.2%
Disgusted 45%
Confused 45%
Surprised 45.4%
Angry 45.1%
Sad 45.1%

AWS Rekognition

Age 18-30
Gender Male, 50.4%
Calm 50.3%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Sad 49.6%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 24-38
Gender Female, 50.5%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Sad 49.5%
Surprised 49.5%
Calm 50.5%
Disgusted 49.5%
Fear 49.5%

AWS Rekognition

Age 38-56
Gender Male, 54.6%
Angry 45.8%
Disgusted 45.1%
Happy 45.1%
Surprised 45.1%
Fear 45%
Calm 53.2%
Sad 45.6%
Confused 45.1%

AWS Rekognition

Age 22-34
Gender Female, 53.7%
Sad 45.6%
Calm 53.4%
Surprised 45.1%
Happy 45.4%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Fear 45.1%

AWS Rekognition

Age 20-32
Gender Female, 50.2%
Fear 49.5%
Sad 49.5%
Disgusted 49.5%
Angry 49.7%
Surprised 49.5%
Confused 49.5%
Happy 49.5%
Calm 50.2%

AWS Rekognition

Age 13-23
Gender Female, 51.1%
Happy 47.1%
Fear 45.1%
Confused 45.1%
Sad 45.3%
Calm 51.8%
Angry 45.3%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50.5%
Fear 49.5%
Sad 49.5%
Surprised 49.5%
Calm 50.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.4%
Confused 49.5%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.5%
Fear 49.5%
Calm 50.4%

AWS Rekognition

Age 23-35
Gender Male, 50.4%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Angry 49.5%
Calm 50.5%
Confused 49.5%
Surprised 49.5%
Sad 49.5%

Feature analysis

Amazon

Person 99.3%
Painting 93.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 87.7%
a vintage photo of a group of people posing for a picture 87.6%
a vintage photo of a group of people posing for a photo 86.3%

Text analysis

Amazon

ANNUIT
TIBI
HOC
REX.
SEPERUN
ANNUIT HOC UNI SEPERUN TIBI CONNIBIIM REX.
CONNIBIIM
UNI

Google

TIBI
REN
CONNUBIUM
I1OC
UNI
SUPERUM
ANNITT
ANNITT I1OC UNI SUPERUM TIBI CONNUBIUM REN