Human Generated Data

Title

Madonna and Child with Saint John the Baptist and Saint Roch

Date

16th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Paul J. Sachs, 1927.27

Human Generated Data

Title

Madonna and Child with Saint John the Baptist and Saint Roch

People

Artist: Unidentified Artist,

Date

16th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Paul J. Sachs, 1927.27

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 97.3
Human 97.2
Person 97.2
Person 94.5
Person 92.2
Drawing 91.3
Painting 86.2
Apparel 85.9
Helmet 85.9
Clothing 85.9
Person 83.7
Sketch 72.1
Face 71.1
Photo 64.6
Photography 64.6
Portrait 64.6

Clarifai
created on 2020-04-24

people 99.9
adult 98.7
man 97.4
illustration 97.3
wear 97.2
one 97.1
portrait 96.4
engraving 96
two 95.8
print 95.6
art 95.2
veil 93.6
group 91.9
painting 91.4
three 90.4
military 90.3
leader 88.7
soldier 83.8
administration 80.8
uniform 79.9

Imagga
created on 2020-04-24

man 26.9
male 24.8
mask 23.1
portrait 22
person 21.8
face 21.3
adult 18.8
men 18
black 17.5
people 16.7
covering 15.9
old 15.3
statue 14.9
hat 14.6
head 11.8
one 11.2
device 11
god 10.5
human 10.5
protective covering 10.3
clothing 10.2
closeup 10.1
art 10.1
sculpture 9.5
industry 9.4
money 9.4
hand 9.1
music 9
worker 8.9
looking 8.8
serious 8.6
smoke 8.4
dark 8.4
protection 8.2
industrial 8.2
currency 8.1
close 8
conceptual 7.9
work 7.9
military 7.7
musical instrument 7.4
vintage 7.4
mustache 7.4
retro 7.4
safety 7.4
occupation 7.3
cash 7.3
danger 7.3
beard 7.2
religion 7.2

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

drawing 98.8
sketch 97.6
human face 91.4
text 88.4
clothing 87.7
person 84.1
painting 80
cartoon 69
man 68.9
black and white 68
old 51
hat 50.9
stone 9.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-46
Gender Female, 70.3%
Fear 23.3%
Disgusted 0.9%
Sad 55.4%
Confused 1.7%
Calm 13.5%
Happy 1.2%
Surprised 1.5%
Angry 2.4%

AWS Rekognition

Age 23-37
Gender Female, 51.5%
Disgusted 0.6%
Angry 2.5%
Fear 1.6%
Surprised 1.4%
Sad 23.2%
Calm 65.5%
Happy 4.5%
Confused 0.7%

AWS Rekognition

Age 6-16
Gender Female, 63.4%
Fear 0%
Disgusted 0%
Confused 0%
Sad 0.2%
Happy 28.5%
Surprised 0.1%
Angry 0%
Calm 71%

Feature analysis

Amazon

Person 97.2%
Painting 86.2%
Helmet 85.9%

Captions

Microsoft
created on 2020-04-24

an old photo of a man 75.6%
old photo of a man 72.7%
a black and white photo of a man 60.5%