Human Generated Data

Title

Procession of Penitents (I Sacconi)
Date

19th century
People

Artist: Unidentified Artist,

Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3563

Human Generated Data

Title

Procession of Penitents (I Sacconi)

People

Artist: Unidentified Artist,

Date

19th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3563

Machine Generated Data

Tags

Amazon
created on 2020-04-30

Art 99.7
Painting 99.7
Person 91.6
Human 91.6
Person 87.6
Person 85.4
Person 79.1
Person 76.7
Person 73.5
Person 71.5
Person 65.7
Person 61.2

Clarifai
created on 2020-04-30

people 99.6
art 99.4
print 99.1
adult 98.4
wear 98
painting 98
woman 97.5
group 97.4
man 96.7
furniture 95.8
veil 94.9
no person 94.4
Renaissance 94.3
lithograph 94.2
room 94
illustration 93.8
seat 93.6
two 93
architecture 88.9
position 85.9

Imagga
created on 2020-04-30

old 42.5
graffito 39.5
architecture 38
building 34.7
wall 32.7
decoration 31.1
ancient 26
door 24.7
antique 24.2
art 22.6
sculpture 22.2
structure 21.4
house 21.2
stone 20.8
tourism 20.6
travel 20.4
facade 19.2
history 18.8
altar 18
culture 18
monument 17.8
vintage 17.4
column 17.1
temple 16.4
grunge 16.2
historical 16
city 15.8
aged 15.4
texture 14.6
window 14.2
statue 14.1
exterior 13.8
arch 13.6
detail 12.9
brown 12.5
retro 12.3
historic 11.9
style 11.9
landmark 11.7
wood 11.7
religion 11.7
entrance 11.6
brick 11.5
buildings 11.3
town 11.1
color 11.1
frame 10.8
traditional 10.8
weathered 10.5
construction 10.3
famous 10.2
dirty 9.9
palace 9.8
wooden 9.7
textured 9.6
home 9.6
carving 9.5
paint 9.1
marble 9
design 9
device 8.9
ruin 8.8
architectural 8.7
fastener 8.6
paper 8.6
worn 8.6
clothespin 8.3
metal 8
columns 7.8
empty 7.7
grungy 7.6
decorative 7.5
place 7.4
tourist 7.3
figure 7

Google
created on 2020-04-30

Painting 89.7
Art 85.5
Visual arts 64.9
Prophet 56.8
Artwork 55.2
History 54.1

Microsoft
created on 2020-04-30

drawing 96.4
wall 95.7
text 81.9
clothing 80.3
sketch 78.7
person 77.6
old 41
different 35.8
painting 24.9
painted 24.3
stone 17.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-16
Gender Female, 52.3%
Sad 45%
Fear 45%
Calm 49.6%
Surprised 50.1%
Happy 45.1%
Disgusted 45%
Angry 45%
Confused 45.1%

AWS Rekognition

Age 40-58
Gender Male, 50.5%
Disgusted 45.1%
Calm 46%
Happy 45.2%
Fear 45.2%
Confused 45.1%
Sad 45.1%
Angry 52.9%
Surprised 45.5%

AWS Rekognition

Age 16-28
Gender Female, 50.2%
Surprised 49.5%
Angry 50.5%
Happy 49.5%
Calm 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 15-27
Gender Female, 53.6%
Fear 45.4%
Confused 45.1%
Angry 53.6%
Disgusted 45.1%
Surprised 45.5%
Happy 45.2%
Sad 45%
Calm 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50.3%
Confused 49.5%
Disgusted 49.6%
Calm 49.6%
Angry 49.8%
Happy 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.9%

AWS Rekognition

Age 22-34
Gender Female, 50.1%
Confused 49.5%
Angry 49.5%
Happy 49.5%
Calm 50.4%
Disgusted 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.6%

Feature analysis

Amazon

Painting 99.7%
Person 91.6%

Captions

Microsoft
created on 2020-04-30

a painting on the wall 67.1%
a painting on a wall 66.9%
a painting hanging on a wall 66.8%