Human Generated Data

Title

Madonna and Child

Date

15th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Irina Korotyukov, 2002.325.A-D

Human Generated Data

Title

Madonna and Child

People

Artist: Unidentified Artist,

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Irina Korotyukov, 2002.325.A-D

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Painting 99.3
Art 99.3
Person 89.7
Human 89.7

Clarifai
created on 2020-04-24

painting 99.7
art 99.5
religion 97.1
wear 96.3
illustration 95.2
people 94.8
texture 94.2
old 93.4
decoration 92.8
print 92.2
picture frame 92.1
vintage 92
wall 91.9
abstract 91.7
retro 88.9
no person 88.1
god 87.6
pattern 87.1
one 87
ancient 86.5

Imagga
created on 2020-04-24

old 44.6
antique 31.8
ancient 31.1
art 28.3
vintage 28.1
texture 26.4
grunge 25.5
aged 23.5
religion 21.5
design 21.4
architecture 21.1
dirty 19.9
fire screen 18.7
wallpaper 18.4
protective covering 18.2
covering 18.1
brown 17.7
gold 17.3
rusty 17.1
style 17.1
wall 16.5
history 16.1
detail 16.1
pattern 15.7
structure 15.6
rough 15.5
metal 15.3
wood 15
prayer rug 15
travel 14.8
sculpture 14.6
golden 14.6
stone 14.4
binding 14.3
screen 14.3
textured 14
culture 13.7
material 13.4
decoration 13.4
color 13.3
frame 13.3
grungy 13.3
retro 13.1
fireplace 12.9
decorative 12.5
rust 12.5
traditional 12.5
rustic 12.5
box 12.3
artistic 12.2
east 12.1
face 12.1
rug 11.9
building 11.9
temple 11.4
container 11.2
paint 10.9
surface 10.6
stain 10.6
wooden 10.5
worn 10.5
statue 10.5
weathered 10.4
ornament 10.3
furnishing 10.3
breastplate 10
backgrounds 9.7
memorial 9.7
chest 9.7
door 9.5
graphic 9.5
blank 9.4
paper 9.4
religious 9.4
iron 9.3
floor cover 9.2
tourism 9.1
messy 8.7
entrance 8.7
light 8.7
stained 8.6
spirituality 8.6
parchment 8.6
god 8.6
book 8.4
dark 8.4
grain 8.3
historic 8.2
ornate 8.2
border 8.1
symbol 8.1
armor plate 8
black 7.8
torn 7.7
empty 7.7
prayer 7.7
plate 7.7
faith 7.6
age 7.6
house 7.5
city 7.5
cover 7.4
creative 7.1

Google
created on 2020-04-24

Brown 89.8
Art 62.5
Square 54.5
Antique 53
Metal 51.1

Microsoft
created on 2020-04-24

painting 99.8
text 98.5
art 96.2
drawing 92.5
old 91.2
human face 90.4
person 81.7
visual arts 52.5
dirty 16.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 95.6%
Angry 0.9%
Happy 0.5%
Surprised 86.3%
Sad 0.2%
Fear 6.5%
Confused 1.9%
Disgusted 0.9%
Calm 2.8%

AWS Rekognition

Age 22-34
Gender Male, 64.1%
Surprised 0.3%
Disgusted 0.5%
Confused 0.5%
Calm 5.2%
Sad 88.4%
Happy 1.9%
Fear 1.1%
Angry 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.3%
Person 89.7%

Captions

Microsoft
created on 2020-04-24

an old photo of a sign 40.8%
a dirty old room 40.7%
a close up of a sign 40.6%