Human Generated Data

Title

Madonna and Child in Blue Robes

Date

People
Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Friends of the Fogg Art Museum Fund, 1924.145

Human Generated Data

Title

Madonna and Child in Blue Robes

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 97.6
Drawing 95
Human 95
Painting 86.9
Sketch 73.4
Person 67.7
Archaeology 58.3
Photo 56
Photography 56

Clarifai
created on 2020-04-24

people 98.9
art 98.5
print 98.4
illustration 98
one 97.7
engraving 97.1
adult 96.8
veil 96.4
old 96.3
painting 96.2
ancient 95.6
antique 95
religion 94.4
portrait 93.1
retro 92.8
vintage 91.8
man 91.3
wear 88.3
facial hair 87.6
leader 86.5

Imagga
created on 2020-04-24

sketch 38.6
memorial 34.7
art 31
stone 29.5
ancient 29.4
drawing 28.9
sculpture 28.8
architecture 26.9
structure 25.4
old 25.1
culture 24.8
gravestone 24.6
temple 23.5
representation 23.3
history 23.3
religion 20.6
statue 18.4
vintage 17.4
god 17.2
paper 16.6
currency 16.2
monument 15.9
cash 15.6
travel 15.5
money 15.3
historical 14.1
carving 14.1
antique 14
church 13.9
brass 13.9
decoration 13.7
bank 13.4
cemetery 13.4
city 13.3
texture 13.2
close 13.1
religious 13.1
famous 13
historic 12.8
carved 12.7
wall 12.2
building 12
banking 12
financial 11.6
detail 11.3
one 11.2
stucco 11.1
finance 11
wealth 10.8
museum 10.7
rich 10.2
design 10.2
dollar 10.2
symbol 10.1
landmark 9.9
dollars 9.7
holy 9.6
pattern 9.6
figure 9.6
bill 9.5
grunge 9.4
stamp 9.2
tourism 9.1
retro 9
mosaic 8.9
spirituality 8.6
ornament 8.6
business 8.5
savings 8.4
economy 8.4
note 8.3
letter 8.3
aged 8.1
column 8.1
icon 7.9
masterpiece 7.9
postmark 7.9
postage 7.9
postal 7.9
banknotes 7.8
face 7.8
painter 7.8
banknote 7.8
golden 7.7
pay 7.7
mail 7.7
exchange 7.6
east 7.5
closeup 7.4
man 7.4
exterior 7.4
fountain 7.2

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

sketch 99.9
drawing 99.8
window 98.6
text 98.1
old 94.8
child art 91.9
art 75.6
white 64.3
cartoon 61.3
painting 52.2
painted 25.4
picture frame 7
stone 3.9

Face analysis

Amazon

AWS Rekognition

Age 30-46
Gender Male, 63.1%
Confused 1.5%
Happy 14.9%
Disgusted 0.7%
Fear 2.2%
Surprised 1.5%
Angry 5.9%
Sad 64.4%
Calm 9%

AWS Rekognition

Age 15-27
Gender Female, 63.3%
Fear 2.1%
Confused 1.3%
Happy 16.6%
Calm 46.3%
Sad 5.4%
Surprised 1.6%
Disgusted 1.2%
Angry 25.3%

Feature analysis

Amazon

Painting 86.9%
Person 67.7%

Captions

Microsoft

a painting of an old building 78%
an old photo of a painting 77.7%
a painting of a book 63.6%