Human Generated Data

Title

Madonna and Child
Date

16th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Clifford A. Kaye, 1965.562

Human Generated Data

Title

Madonna and Child

People

Artist: Unidentified Artist,

Date

16th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Clifford A. Kaye, 1965.562

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 95.9
Person 95.9
Art 95.5
Person 87.5
Drawing 79.3
Apparel 73.4
Clothing 73.4
Painting 69.7
Helmet 68.3
Face 63.3
Portrait 63.3
Photography 63.3
Photo 63.3
Advertisement 59.7
Poster 59.7
Collage 57.1

Clarifai
created on 2020-04-24

people 99.7
art 99.1
religion 98.9
adult 97.4
man 97.3
portrait 97
saint 96.5
facial hair 96
illustration 95.2
veil 92.9
old 92.7
god 92.7
painting 91.1
aura 90.7
Gothic 90.6
print 90.5
holy 89.5
one 88.4
Renaissance 88.3
wear 88

Imagga
created on 2020-04-24

sculpture 58.3
temple 53.2
statue 52
religion 49.4
art 44.4
architecture 37.3
culture 36.8
ancient 36.4
god 30.7
history 28.7
carving 26.9
religious 25.3
church 25
old 23.7
monument 23.4
sketch 22.9
travel 22.6
stone 22.6
spirituality 22.1
famous 20.5
tourism 19.8
holy 19.3
decoration 18.6
antique 17.5
tourist 17.2
face 17.1
drawing 16.7
figure 16.5
historic 16.5
golden 16.4
throne 16.1
oriental 16.1
historical 16
column 15.5
landmark 15.4
building 15.3
faith 15.3
city 15
worship 14.5
spiritual 14.4
traditional 14.2
east 14
representation 14
sacred 13.7
belief 13.7
heritage 13.5
gold 13.2
chair of state 12.9
carved 12.7
plastic art 12.6
bust 12.5
structure 12.1
palace 12
museum 11.8
prayer 11.6
meditation 11.5
detail 11.3
cathedral 10.4
symbol 10.1
window 10
southeast 9.9
pray 9.7
chair 9.3
tradition 9.3
head 9.2
mosaic 9.1
sculptures 8.9
statues 8.9
design 8.9
century 8.8
memorial 8.8
marble 8.7
artistic 8.7
holiday 8.6
painter 8.6
mask 8.5
roman 8.3
icon 7.9
bangkok 7.9
mythology 7.9
bible 7.9
visit 7.8
portrait 7.8
sitting 7.7
construction 7.7
comic book 7.7
relief 7.6
decorative 7.5
china 7.5
place 7.5
protection 7.3
monastery 7.3
arch 7.1
bronze 7.1

Google
created on 2020-04-24

Stock photography 78.9
Art 75.5
History 71.8
Prophet 63.3
Photography 62.4
Illustration 60.2
Black-and-white 56.4
Painting 54.7
Middle ages 53.1

Microsoft
created on 2020-04-24

text 100
book 99.9
sketch 99.5
drawing 99.3
painting 94
person 92.3
human face 91.9
clothing 89.9
old 89.1
man 74.8
cartoon 67.7
illustration 65.9
black and white 63.3
vintage 31.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 50.5%
Disgusted 0.1%
Fear 54.7%
Surprised 0.6%
Angry 0.7%
Happy 0.1%
Calm 0.6%
Confused 1%
Sad 42.1%

AWS Rekognition

Age 23-35
Gender Male, 98.2%
Disgusted 1.5%
Calm 44.8%
Sad 1.6%
Happy 0.7%
Surprised 42.1%
Confused 2.2%
Angry 5.9%
Fear 1.2%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.9%
Painting 69.7%
Helmet 68.3%

Categories

Imagga

paintings art 60.6%
people portraits 25.7%
streetview architecture 11.8%
events parties 1.2%

Captions

Microsoft
created on 2020-04-24

a vintage photo of a person 91.9%
an old photo of a person 91.8%
a vintage photo of a person holding a book 61.2%