Human Generated Data

Title

Saint Roch and Saint Anthony Abbot with a Donor
Date

16th century
People

Artist: Master of the Life of Saint Agnes, Italian

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.1

Human Generated Data

Title

Saint Roch and Saint Anthony Abbot with a Donor

People

Artist: Master of the Life of Saint Agnes, Italian

Date

16th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Art 100
Painting 100
Person 99.5
Person 99
Adult 99
Female 99
Woman 99
Face 80.7
Head 80.7
Animal 71.8
Bear 71.8
Mammal 71.8
Wildlife 71.8
Clothing 67.7
Footwear 67.7
Shoe 67.7
Shoe 55.8
Photography 55.4
Portrait 55.4

Imagga
created on 2018-12-18

carving 84.6
sculpture 74.6
plastic art 49
art 33.8
furniture 21.6
door 20.7
old 20.2
home 19.9
figure 17.7
religion 17
interior 15.9
wood 15.8
china cabinet 15.7
cabinet 15.7
brown 14.7
architecture 14
religious 14
ancient 13.8
building 13.8
furnishing 13.6
house 13.4
faith 12.4
temple 12.3
adult 12.3
antique 12.2
church 12
dog 11.9
people 11.7
entrance 11.6
person 10.7
saint 10.6
culture 10.2
man 10.1
face 9.9
vintage 9.9
gold 9.9
lady 9.7
catholic 9.7
hunting dog 9.7
prayer 9.7
style 9.6
holy 9.6
design 9.6
statue 9.5
construction 9.4
wall 9.4
happiness 9.4
happy 9.4
historic 9.2
travel 9.1
traditional 9.1
portrait 9.1
wooden 8.8
pray 8.7
decoration 8.7
smiling 8.7
spirituality 8.6
spiritual 8.6
alone 8.2
one 8.2
cheerful 8.1
history 8
detail 8
close 8
indoors 7.9
cute 7.9
window 7.9
wardrobe 7.8
male 7.8
belief 7.8
god 7.7
head 7.6
joy 7.5
human 7.5
hound 7.5
emotion 7.4
indoor 7.3
work 7.2
smile 7.1

Google
created on 2018-12-18

art 94.6
painting 90.7
modern art 75.2
art gallery 69.6
tourist attraction 67
collection 65.9
middle ages 64
artwork 64
window 62.3
picture frame 61.9
visual arts 60.2
wood 59.7
paint 57.4
stock photography 50.2

Microsoft
created on 2018-12-18

book 96.6
text 91.6
indoor 90.6
person 87.7
painting 16.2
art 16.2
clothing 5.8
museum 5.6
voyage 5.4
anime 3.6
cowboy 3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.7%
Calm 62%
Sad 14.3%
Fear 12.4%
Surprised 6.8%
Confused 5.5%
Happy 2.5%
Angry 1.7%
Disgusted 0.8%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Calm 77.7%
Sad 11.2%
Surprised 7%
Fear 6.4%
Happy 2.2%
Confused 2.1%
Angry 1.7%
Disgusted 1.3%

AWS Rekognition

Age 27-37
Gender Male, 99.6%
Calm 98.6%
Surprised 6.4%
Fear 6.3%
Sad 2.2%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Adult 99%
Female 99%
Woman 99%
Bear 71.8%
Shoe 67.7%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 67.4%
a person standing in front of a mirror posing for the camera 67.3%
a man and a woman standing in front of a mirror 58.4%