Human Generated Data

Title

Saint Andrew and Scenes from his Life
Date
People
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1917.215.B

Human Generated Data

Title

Saint Andrew and Scenes from his Life

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Painting 97.5
Art 97.5
Human 87.5
Person 87.5
Person 85.8
Person 85.8
Person 82.1
Person 81.2
Person 80.2
Person 71.6
Mural 65.7
Person 63.5
Person 60.8
Advertisement 55.2

Clarifai
created on 2019-11-09

painting 99.8
art 99.3
people 98.3
illustration 97
religion 95.4
Mary 92.4
wear 89.8
no person 88.3
coat of arms 87
group 85.2
church 84.8
saint 83
adult 82.1
print 81.9
woman 80.6
gown (clothing) 79.7
veil 79.5
manuscript 78.3
decoration 76.5
symbol 75.1

Imagga
created on 2019-11-09

altar 55.8
church 47.2
art 44.5
structure 41.9
religion 38.5
window 29.3
cathedral 26.8
religious 25.3
comic book 25.3
god 23.9
book jacket 23.3
vintage 23.2
old 22.3
stained 22.1
faith 22
culture 21.4
holy 21.2
saint 21.2
detail 20.1
glass 19.5
icon 18.2
jacket 18.1
architecture 18
masterpiece 16.8
catholic 16.5
decoration 16.4
prayer 15.5
postmark 14.8
postage 14.7
postal 14.7
ancient 14.7
bible 14.7
letter 14.7
design 14.6
museum 14.5
pray 14.5
stamp 14.5
mail 14.4
colorful 14.3
painted 14.3
painter 14.1
antique 14
wrapping 13.8
pattern 13.7
symbol 13.5
post 13.4
interior 13.3
covering 13.1
golden 12.9
wall 12.8
shows 12.8
mosaic 12.8
printed 12.8
renaissance 12.8
black 12.6
temple 12.6
history 12.5
spiritual 12.5
spirituality 12.5
retro 12.3
artistic 12.2
artwork 11.9
style 11.9
global 11.8
texture 11.8
chapel 11.8
paintings 11.7
envelope 11.7
delivery 11.7
cutting 11.6
communications 11.5
fine 11.4
unique 11.4
travel 11.3
historic 11
post mail 10.9
stained glass 10.9
zigzag 10.9
fame 10.9
known 10.9
catholicism 10.8
sacred 10.7
historical 10.3
print media 10.1
color 10
traditional 10
gold 9.9
stamps 9.9
pinball machine 9.7
door 9.7
office 9.6
artist 9.6
building 9.5
famous 9.3
peace 9.1
paint 9.1
landmark 9
sculpture 8.9
st 8.7
letters 8.7
east 8.4
one 8.2
painting 8.1
man 8.1
canceled 7.9
game equipment 7.8
decorative 7.5
indoor 7.3
love 7.1

Google
created on 2019-11-09

Painting 95.3
Art 93.2
Modern art 84.5
Visual arts 83.2
Textile 65.6
Collection 62.9
Picture frame 61.1
History 54.1
Artwork 52.3
Still life 51.2

Microsoft
created on 2019-11-09

text 99.7
painting 99.6
drawing 86.9
person 73
cartoon 57.8
art 57.6
painted 43.6
colorful 38.7

Face analysis

Amazon

AWS Rekognition

Age 18-30
Gender Female, 50.2%
Fear 50.5%
Disgusted 49.5%
Happy 49.5%
Calm 49.5%
Angry 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 13-25
Gender Male, 50.2%
Sad 50%
Confused 49.6%
Disgusted 49.5%
Angry 49.5%
Fear 49.8%
Surprised 49.5%
Calm 49.5%
Happy 49.5%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Angry 49.5%
Sad 49.8%
Disgusted 49.5%
Fear 49.6%
Calm 49.6%
Happy 49.5%
Confused 49.8%
Surprised 49.6%

AWS Rekognition

Age 32-48
Gender Female, 50.4%
Angry 48.4%
Happy 45.2%
Confused 45.1%
Calm 47.3%
Disgusted 45%
Surprised 45.1%
Sad 48.6%
Fear 45.3%

AWS Rekognition

Age 23-35
Gender Female, 50%
Surprised 49.5%
Sad 49.6%
Happy 49.5%
Calm 49.9%
Disgusted 49.7%
Fear 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 37-55
Gender Female, 50%
Calm 50.1%
Surprised 49.5%
Sad 49.9%
Angry 49.5%
Confused 49.5%
Happy 49.5%
Fear 49.5%
Disgusted 49.5%

AWS Rekognition

Age 17-29
Gender Male, 50.3%
Calm 49.9%
Surprised 49.6%
Angry 49.6%
Sad 49.6%
Happy 49.6%
Fear 49.7%
Confused 49.5%
Disgusted 49.6%

AWS Rekognition

Age 24-38
Gender Female, 53.7%
Sad 50.8%
Angry 47.3%
Surprised 45.1%
Confused 45.1%
Disgusted 45%
Fear 45.5%
Happy 45%
Calm 46.1%

AWS Rekognition

Age 36-54
Gender Male, 50%
Angry 49.6%
Sad 50.3%
Disgusted 49.5%
Fear 49.6%
Calm 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%

Feature analysis

Amazon

Painting 97.5%
Person 87.5%

Captions

Microsoft

a graffiti covered wall 58%
a bunch of graffiti on a wall 47.3%
graffiti on a wall 47.2%