Human Generated Data

Title

Virgin and Child
Date

15th-16th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1969.187

Human Generated Data

Title

Virgin and Child

People

Artist: Unidentified Artist,

Date

15th-16th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Painting 99.2
Art 99.2
Human 98.1
Person 98.1
Person 84.6
Architecture 77.7
Building 77.7
Person 60
Crypt 57.2

Clarifai
created on 2019-11-09

art 99.7
people 99.4
religion 98.8
painting 98.8
illustration 98.1
one 96.7
church 96.6
saint 96.5
man 96.1
god 94.3
veil 94.2
portrait 93.9
book 93.5
aura 93.3
Mary 92.6
adult 92.2
baby 92
Gothic 91.5
old 90.7
holy 90

Imagga
created on 2019-11-09

religion 47.5
church 41.6
art 41.2
temple 29.7
religious 28.1
holy 27
god 26.8
culture 25.6
sculpture 25.3
painter 23.1
elevator 22.7
old 22.3
spirituality 22.1
architecture 21.9
device 21.6
faith 21.1
prayer 20.3
ancient 19.9
icon 19
bible 18.6
book jacket 18.5
lifting device 18.2
mosaic 17.5
pray 17.5
saint 17.3
statue 17.3
masterpiece 16.8
sacred 16.6
historic 16.5
gold 16.4
golden 16.3
history 16.1
historical 16
antique 15.7
museum 15.5
spiritual 15.4
artist 14.5
jacket 14.4
one 14.2
vintage 14.1
cathedral 14
worship 13.5
altar 13.3
interior 13.3
detail 12.9
symbol 12.8
face 12.8
travel 12.7
building 12.3
famous 12.1
catholic 11.7
currency 11.7
painted 11.4
decoration 11.2
carving 11.1
wrapping 11
throne 10.9
landmark 10.8
renaissance 10.8
orthodox 10.8
heritage 10.6
window 10.6
design 10.4
dollar 10.2
letter 10.1
tourism 9.9
prophet 9.9
known 9.9
covering 9.8
belief 9.7
close 9.7
door 9.5
money 9.4
east 9.3
colorful 9.3
banking 9.2
cash 9.2
financial 8.9
postmark 8.9
postage 8.8
postal 8.8
structure 8.8
paintings 8.8
envelope 8.8
stamp 8.7
meditation 8.6
mail 8.6
post 8.6
fine 8.6
figure 8.5
finance 8.4
monument 8.4
monastery 8.2
chair of state 7.9
post mail 7.9
zigzag 7.9
byzantine 7.9
fame 7.9
gilded 7.9
shows 7.9
printed 7.9
praying 7.8
delivery 7.8
banknote 7.8
cutting 7.7
communications 7.7
bill 7.6
unique 7.6
cross 7.5
office 7.4
peace 7.3
global 7.3
black 7.2
portrait 7.1

Google
created on 2019-11-09

Painting 97.8
Art 92.1
Picture frame 92
Visual arts 85.8
Modern art 71.7
Stock photography 69.2
Still life 66.5
Artwork 56

Microsoft
created on 2019-11-09

book 96.9
text 96.9
human face 92.9
person 90.1
indoor 87.2
drawing 69.2
art 68.6
clothing 66.1
statue 56.7
mythology 50.7
painting 33.4

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Female, 88.3%
Happy 3.3%
Confused 1.5%
Fear 5.9%
Disgusted 0.7%
Sad 24.9%
Angry 46.6%
Calm 14.9%
Surprised 2.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.2%
Person 98.1%

Captions

Microsoft

a painting of a person 86.5%
a painting of a person 82.2%
a painting of a person holding a book 51.2%

Text analysis

Amazon

ay4c

Google

MAKP01
MAKP01