Human Generated Data

Title

Panel of an Altarpiece: Saints Thomas Aquinas, John the Evangelist, Paul, and Dominic

Date

14th century

People

Artist: Paolo Veneziano, Italian 1333 - 1362

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Eliot Hubbard, Jr., Class of 1915, 1937.33

Human Generated Data

Title

Panel of an Altarpiece: Saints Thomas Aquinas, John the Evangelist, Paul, and Dominic

People

Artist: Paolo Veneziano, Italian 1333 - 1362

Date

14th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.3
Human 98.3
Person 98
Art 97.8
Person 95.6
Painting 95
Statue 92.6
Sculpture 92.6
Drawing 85.1
Architecture 82.9
Building 82.9
Person 82.4
Photography 59.5
Portrait 59.5
Photo 59.5
Face 59.5
Archangel 58.8
Angel 58.8

Clarifai
created on 2020-04-24

people 100
group 99.7
adult 99.7
art 98.6
man 98.1
leader 97.4
religion 95.7
gown (clothing) 95.7
one 92.4
many 92.3
veil 91.9
several 91.5
administration 91.5
woman 91.4
monarch 91.2
three 90.8
wear 88.4
print 88.2
sculpture 87.9
five 87.8

Imagga
created on 2020-04-24

architecture 43.8
sculpture 39.7
monument 38.3
statue 34.6
landmark 32.5
building 32.4
ruler 32
marble 31.1
history 30.4
vestment 29.3
art 28.9
famous 27.9
old 27.9
column 27.4
altar 26.7
historic 24.8
historical 24.5
ancient 24.2
tourism 23.9
structure 23.3
gown 23.2
church 23.1
stone 22.9
arch 22.9
cathedral 21.8
city 21.7
god 21.1
religion 20.6
travel 20.4
outerwear 17.7
culture 17.1
catholic 17.1
tourist 14.5
fountain 14.4
antique 14.4
detail 13.7
facade 13.6
roman 13.1
temple 12.6
vintage 11.6
holy 11.6
saint 11.6
medieval 11.5
memorial 11.5
attraction 11.5
symbol 11.5
destination 11.2
metropolitan 10.8
baroque 10.7
clothing 10.7
covering 10.5
prayer rug 10.4
statues 9.9
catholicism 9.8
spirituality 9.6
faith 9.6
palace 9.5
cross 9.4
carving 9.2
traditional 9.1
decoration 8.7
buildings 8.5
religious 8.4
exterior 8.3
rug 8.3
ornate 8.2
house 8.1
tower 8.1
mythology 7.9
chapel 7.8
artistic 7.8
heritage 7.7
architectural 7.7
ornamental 7.6
capital 7.6
treasury 7.6
museum 7.2

Google
created on 2020-04-24

Architecture 76.3
History 72.6
Religious institute 68.3
Statue 66
Cope 59.2
Prophet 58.3
Art 50.2

Microsoft
created on 2020-04-24

old 92.9
posing 92.5
clothing 89.6
person 88.1
indoor 88
painting 84.8
standing 84
black 80.8
altar 77.3
white 74.8
drawing 73.3
text 58
woman 57.3
sketch 54.4
statue 53.9
church 50.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-69
Gender Male, 54.2%
Surprised 45.1%
Fear 45%
Angry 45.2%
Sad 48.7%
Disgusted 45%
Confused 45.1%
Calm 50.8%
Happy 45%

AWS Rekognition

Age 23-35
Gender Male, 53.6%
Sad 45.7%
Happy 45.1%
Confused 45.4%
Angry 45.2%
Calm 48.6%
Surprised 46.6%
Fear 48.3%
Disgusted 45.1%

AWS Rekognition

Age 48-66
Gender Male, 54.9%
Happy 45.1%
Disgusted 45.3%
Confused 45.4%
Surprised 46.1%
Calm 48.8%
Fear 46.7%
Angry 46%
Sad 46.6%

AWS Rekognition

Age 44-62
Gender Male, 54.1%
Happy 45.1%
Calm 46.6%
Disgusted 45.2%
Surprised 45.4%
Confused 45.3%
Angry 50.5%
Fear 46.7%
Sad 45.2%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Painting 95%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 85.5%
a vintage photo of a group of people posing for a picture 85.4%
a group of people posing for a photo 85.3%