Human Generated Data

Title

Virgin and Child with Saints John the Baptist and Anthony Abbot
Date

1400-1425
People

Artist: Jacopo da Firenze, Italian active 1410
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Lucy Wallace Porter, 1962.287

Human Generated Data

Title

Virgin and Child with Saints John the Baptist and Anthony Abbot

People

Artist: Jacopo da Firenze, Italian active 1410

Date

1400-1425

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Lucy Wallace Porter, 1962.287

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 98.7
Painting 98.7
Person 97.7
Human 97.7
Person 82.4
Architecture 79.2
Building 79.2
Person 78.8
Person 64.8
Archangel 55.1
Angel 55.1

Clarifai
created on 2018-03-16

art 99.5
religion 99.1
saint 99
church 97.1
illustration 97
painting 96.8
book 96.6
god 96.6
holy 96.1
cross 96
Mary 95.6
people 94.3
spirituality 93.8
virgin 92.5
sacred 91
print 90.1
aura 89.9
gown (clothing) 89.2
chapel 89.1
Madonna 88.8

Imagga
created on 2018-03-16

vestment 44.4
religion 40.3
throne 39.3
gown 35.1
chair of state 31.4
art 30.6
religious 29
church 28.7
sculpture 28.6
outerwear 26.6
culture 26.5
statue 24
architecture 22.7
chair 22.6
holy 22.2
temple 22.1
clothing 21.5
gold 21.4
antique 21.2
spirituality 21.1
spiritual 21.1
faith 21.1
god 21
old 20.9
costume 20.7
worship 20.3
traditional 20
ancient 19.9
covering 18.9
face 18.5
pray 18.4
saint 18.3
seat 18.1
sacred 17.5
prayer 17.4
mask 17.2
historic 16.5
metropolitan 16.2
tourism 14.8
colorful 14.3
history 14.3
golden 13.8
travel 13.4
carving 13.2
decoration 13
tradition 12.9
building 12.9
belief 12.7
disguise 11.8
portrait 11.6
historical 11.3
detail 11.3
famous 11.2
landmark 10.8
catholic 10.7
color 10.6
cathedral 10.6
monument 10.3
east 10.3
consumer goods 10.1
ornate 10.1
figure 9.9
oriental 9.9
bible 9.8
meditation 9.6
festival 9.6
people 9.5
decorative 9.2
makeup 9.2
person 9.1
fan 8.9
virgin 8.9
interior 8.9
symbol 8.8
icon 8.7
medieval 8.6
furniture 8.6
percussion instrument 8.2
holiday 7.9
masquerade 7.9
chapel 7.8
praying 7.8
palace 7.8
carnival 7.8
mysterious 7.8
st 7.8
stone 7.6
head 7.6
mother 7.4
man 7.4
window 7.3
tourist 7.3
fantasy 7.2
celebration 7.2

Google
created on 2018-03-16

middle ages 72.2
history 70.2
statue 68.4
place of worship 67.5
religion 64.2
carving 63.5
shrine 61.7
art 59.9
stock photography 53.2
religious institute 51.1
sculpture 50.2

Microsoft
created on 2018-03-16

old 56

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Surprised 45.7%
Disgusted 45.5%
Confused 45.6%
Sad 46.5%
Angry 45.9%
Happy 45.6%
Calm 50.1%

AWS Rekognition

Age 45-63
Gender Male, 54.3%
Surprised 45.3%
Disgusted 45.2%
Calm 46.9%
Confused 45.3%
Angry 46.1%
Happy 45.8%
Sad 50.5%

AWS Rekognition

Age 26-43
Gender Female, 94.6%
Surprised 7.7%
Disgusted 33.2%
Confused 11.1%
Sad 14.7%
Angry 14%
Happy 7.7%
Calm 11.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.7%
Person 97.7%

Captions

Microsoft
created on 2018-03-16

an old photo of a person 69.3%
an old photo of a person 64.9%
old photo of a person 64.8%

Text analysis

Amazon

GRACIA
-AUA-MRTA-GRACIAPUERH
-AUA-MRTA-GRACIAPUERH AUA GRACIA
AUA