Human Generated Data

Title

Saints John the Baptist and Andrew
Date

c. 1375
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Lillian Malcove, 1961.88

Human Generated Data

Title

Saints John the Baptist and Andrew

People

Artist: Unidentified Artist,

Date

c. 1375

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Lillian Malcove, 1961.88

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.2
Human 98.2
Art 96.6
Person 94.3
Drawing 87.6
Text 78.3
Painting 78.3
Sketch 70.8
Archaeology 59.5

Clarifai
created on 2020-04-24

art 98.8
people 98.6
one 97.9
painting 96.9
print 95.2
old 93.4
wear 93.3
religion 92.9
antique 92.2
ancient 91.8
adult 91.8
illustration 91.3
retro 91
engraving 91
man 90.5
vintage 90.1
no person 85.9
portrait 85
paper 84.7
veil 83.8

Imagga
created on 2020-04-24

old 40.4
stone 39.8
ancient 36.3
architecture 32.2
cemetery 30.9
structure 28.9
memorial 28.5
wall 28.2
gravestone 27.6
antique 26.8
grunge 24.7
vintage 24
texture 23.6
building 23
art 21.1
door 19
aged 19
carving 17.7
sculpture 17.1
detail 16.9
device 16.3
temple 16.3
dirty 16.3
history 16.1
pattern 15.7
religion 15.2
design 14.6
rough 14.6
grungy 14.2
culture 13.7
entrance 13.5
travel 13.4
close 13.1
paper 12.5
decoration 12.1
brass 12
historic 11.9
knocker 11.3
empty 11.2
city 10.8
retro 10.7
textured 10.5
damaged 10.5
rusty 10.5
weathered 10.4
jamb 10.4
style 10.4
construction 10.3
support 10.2
material 9.8
statue 9.7
gate 9.7
surface 9.7
metal 9.7
artistic 9.6
dark 9.2
backgrounds 8.9
brown 8.8
carved 8.8
stained 8.7
architectural 8.7
ornament 8.6
god 8.6
canvas 8.5
wallpaper 8.4
black 8.4
monument 8.4
structural member 8.4
frame 8.3
church 8.3
exterior 8.3
upright 7.9
arch 7.8
decay 7.7
concrete 7.7
house 7.5
sheet 7.5
wood 7.5
traditional 7.5
east 7.5
backdrop 7.4
stucco 7.4
paint 7.2

Google
created on 2020-04-24

Photograph 95.3
Art 73.1
Stock photography 70.4
Drawing 65.2
Photography 62.4
Illustration 57.7
Black-and-white 56.4
Painting 51.9

Microsoft
created on 2020-04-24

text 99.2
drawing 98.6
painting 96
book 95.2
sketch 94.6
old 68.3
art 60

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 39-57
Gender Female, 51.3%
Angry 45.7%
Sad 51.2%
Happy 45%
Surprised 45.3%
Confused 46.1%
Disgusted 45.1%
Calm 45.4%
Fear 46.1%

AWS Rekognition

Age 51-69
Gender Female, 58.6%
Calm 68.9%
Happy 2.7%
Fear 3.6%
Sad 5.9%
Angry 4.1%
Confused 2.5%
Disgusted 0.5%
Surprised 11.9%

Feature analysis

Amazon

Person 98.2%
Painting 78.3%

Categories

Imagga

streetview architecture 96.3%
paintings art 2.6%
nature landscape 1%

Captions

Microsoft
created on 2020-04-24

an old photo of a person 69.5%
a graffiti covered wall 62.3%
old photo of a person 62.2%

Text analysis

Amazon

Der.
eote
ovI
Der. AGVS
AGVS
ooe

Google

TOL I Pa KTH HORO
TOL
I
Pa
KTH
HORO