Human Generated Data

Title

Saint Sebastian

Date

17th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Reverend Gerald F. Gilmore, 1976.87

Human Generated Data

Title

Saint Sebastian

People

Artist: Unidentified Artist,

Date

17th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.2
Person 97.2
Art 95.6
Painting 84.1
Advertisement 81.4
Poster 78.8
Text 76.4
Sculpture 66.6
Collage 57.9
Drawing 56.9

Clarifai
created on 2020-04-24

art 99.9
nude 99.5
people 99.5
print 98.6
illustration 98.6
painting 98.1
portrait 97.7
adult 97.2
man 95.5
one 94.6
visuals 92.7
vintage 92.3
artistic 91.7
religion 89.1
old 88.6
black and white 88.6
god 88.2
wear 87.9
narrative 86.5
veil 83.8

Imagga
created on 2020-04-24

fountain 100
structure 92.2
brass 27.2
memorial 26.2
statue 24.9
sculpture 22.2
art 18.4
old 18.1
vintage 15.7
ancient 14.7
culture 14.5
architecture 14.1
money 13.6
stone 13.6
one 13.4
portrait 12.3
people 12.3
male 12.1
black 12
religion 11.6
man 11.4
face 11.4
antique 11.2
religious 11.2
body 11.2
grunge 11.1
banking 11
sketch 11
cash 11
currency 10.8
person 10.5
dollar 10.2
figure 10
drawing 9.7
building 9.5
decoration 9.2
city 9.1
design 9
marble 8.9
us 8.7
close 8.6
travel 8.4
famous 8.4
historic 8.2
closeup 8.1
symbol 8.1
history 8
banknotes 7.8
sepia 7.8
head 7.6
historical 7.5
tourism 7.4
paint 7.2
dirty 7.2
bank 7.2
representation 7.2
financial 7.1
adult 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 95.6
drawing 94.8
sketch 94.3
painting 87.3
window 87.1
black and white 81.7
human face 80.6
nude 75.9
gallery 73.7
person 55.4
door 55.4
picture frame 50.3
old 44.8
doorway 31.8

Face analysis

Amazon

AWS Rekognition

Age 13-25
Gender Male, 85%
Fear 0.1%
Happy 0.1%
Confused 0.4%
Sad 98.3%
Angry 0.7%
Surprised 0%
Disgusted 0.1%
Calm 0.3%

Feature analysis

Amazon

Person 97.2%
Painting 84.1%

Captions

Microsoft

a person standing in front of a window 69%
a person standing in front of a door 68.9%
a person that is standing in front of a window 64.7%

Text analysis

Amazon

FOGG
HARVARD
MUSEUM
ART
XLISHSAINN
w
ES

Google

UNIVERSITY
HARVARD
1976.87
FOGG ART MUSEUM. HARVARD UNIVERSITY 1976.87
FOGG
ART
MUSEUM.