Human Generated Data

Title

Saint Paul in Prison (after Raphael)

Date

19th century

People

Artist: Unidentified Artist,

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Ann Blake Smith in honor of Agnes Mongan, 1970.117

Human Generated Data

Title

Saint Paul in Prison (after Raphael)

People

Artist: Unidentified Artist,

Date

19th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Ann Blake Smith in honor of Agnes Mongan, 1970.117

Machine Generated Data

Tags

Amazon
created on 2020-05-01

Person 98.5
Human 98.5
Art 87.1
Drawing 83.2
Architecture 69.3
Building 69.3
Person 68.7
Archaeology 64.3
Sketch 62.8
Text 62.7

Clarifai
created on 2020-05-01

people 99.9
one 99.3
art 96.8
two 96.5
man 95.7
retro 95.7
sepia pigment 95.3
wear 95.2
adult 94.9
woman 93.6
antique 92.8
military 92
old 91.9
ancient 90.7
monochrome 89.7
portrait 87.4
administration 87.1
sepia 87.1
war 85.4
no person 85.1

Imagga
created on 2020-05-01

wall 48.7
old 44
stone 38.3
brick 36.9
architecture 34
building 33.5
stucco 31.1
ancient 27.7
structure 23.5
window 22.3
texture 22.3
door 21.9
antique 21.7
grunge 21.3
cell 20.1
city 19.2
sill 18.4
vintage 18.2
construction 18
history 17.9
house 17.9
aged 16.3
urban 15.8
travel 15.5
medieval 15.4
support 15.2
structural member 14.8
retro 14.8
exterior 14.8
art 14.5
decoration 14.1
tourism 14
arch 14
sculpture 13.8
building material 13.6
town 13
historic 12.9
brown 12.5
frame 12.5
surface 12.4
textured 12.3
monument 12.2
memorial 12.1
street 12
facade 11.9
graffito 11.7
entrance 11.6
concrete 11.5
weathered 11.4
culture 11.1
pattern 11
dirty 10.9
cement 10.7
aging 10.6
style 10.4
historical 10.4
famous 10.2
religion 9.9
material 9.8
device 9.8
detail 9.7
architectural 9.6
tile 9.6
church 9.3
tourist 9.2
rough 9.1
landmark 9
wooden 8.8
paper 8.8
gravestone 8.7
empty 8.6
damaged 8.6
stones 8.5
design 8.5
metal 8.1
palace 8
home 8
bricks 7.8
abandoned 7.8
gate 7.8
broken 7.7
built 7.7
rust 7.7
windows 7.7
rusty 7.6
close 7.4
carving 7.3
prison 7.3
column 7.3
paint 7.3

Google
created on 2020-05-01

Microsoft
created on 2020-05-01

drawing 98
text 96.9
sketch 94.6
art 91.2
white 87.2
black 87
old 82.5
black and white 65.3
vintage 26.8
concrete 25.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 28-44
Gender Male, 52.9%
Happy 45%
Angry 45%
Disgusted 45%
Confused 45%
Calm 54.6%
Fear 45%
Surprised 45%
Sad 45.4%

AWS Rekognition

Age 34-50
Gender Male, 51.6%
Surprised 45.5%
Angry 49%
Happy 45.2%
Calm 45.3%
Fear 49.5%
Disgusted 45.4%
Sad 45%
Confused 45.1%

AWS Rekognition

Age 19-31
Gender Male, 53.4%
Confused 45.1%
Happy 47.2%
Fear 45.1%
Surprised 45.3%
Angry 45.5%
Sad 48.3%
Disgusted 45%
Calm 48.4%

Feature analysis

Amazon

Person 98.5%

Categories