Human Generated Data

Title

Death of Victor Hugo (Haymarket Series)

Date

1934-1935

People

Artist: Mitchell Siporin, American 1910 - 1976

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miriam, Rachel, and Judith Siporin, 1997.21

Human Generated Data

Title

Death of Victor Hugo (Haymarket Series)

People

Artist: Mitchell Siporin, American 1910 - 1976

Date

1934-1935

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-04-25

Human 97.2
Person 97.2
Person 91.4
Person 90.6
Art 86.9
Soil 75.2
Drawing 69
Advertisement 58.1
Painting 57.6
Poster 56
Book 55.6

Clarifai
created on 2020-04-25

people 99.9
adult 99.3
monochrome 99.2
illustration 99.1
art 98.5
print 97.8
man 97.8
portrait 96.6
engraving 95.8
one 92.6
vintage 90.2
woodcut 90
wear 89.6
veil 89.2
black and white 89
lithograph 87
sepia pigment 85.6
lid 85
book bindings 84.4
woman 83.9

Imagga
created on 2020-04-25

comic book 70.4
sculpture 32.9
art 28.4
statue 28.2
print media 28.2
religion 25.1
ancient 25.1
religious 23.4
history 22.4
architecture 21.9
old 21.6
decoration 20.7
monument 20.6
temple 19
money 18.7
stone 18.7
cash 18.3
currency 18
church 17.6
tattoo 17
culture 16.2
dollar 15.8
travel 15.5
god 15.3
figure 15.3
bank 14.5
finance 14.4
banking 13.8
design 13.5
carving 13.4
financial 13.4
famous 13
historic 12.8
landmark 12.6
wealth 12.6
spirituality 12.5
faith 12.4
tourism 12.4
detail 12.1
city 11.6
holy 11.6
spiritual 11.5
close 11.4
savings 11.2
paper 11
artwork 11
symbol 10.8
dollars 10.6
heritage 10.6
us 10.6
bill 10.5
one 10.5
book jacket 10.5
business 10.3
rich 10.2
face 9.9
carved 9.8
catholic 9.7
sketch 9.6
antique 9.5
capital 9.5
historical 9.4
tourist 9.1
museum 8.9
closeup 8.8
building 8.7
artistic 8.7
loan 8.6
wall 8.6
jacket 8.4
economy 8.3
traditional 8.3
vintage 8.3
note 8.3
investment 8.3
drawing 8
funds 7.8
bible 7.8
angel 7.8
exchange 7.6
man 7.5
gold 7.4
letter 7.3
stamp 7.3

Google
created on 2020-04-25

Art 72.1
Illustration 70.1
History 62.6
Stock photography 59.4
Relief 57.3

Microsoft
created on 2020-04-25

text 99.4
cartoon 97.3
drawing 93
poster 91.8
sketch 85.6
person 84.2
clothing 81.5
book 68.4
clothes 16.4

Face analysis

Amazon

AWS Rekognition

Age 42-60
Gender Male, 97.9%
Surprised 0.1%
Calm 31.6%
Angry 1.6%
Sad 64.8%
Happy 0.2%
Confused 0.9%
Disgusted 0.1%
Fear 0.6%

AWS Rekognition

Age 24-38
Gender Male, 88.4%
Surprised 0.1%
Angry 5.9%
Disgusted 0.1%
Calm 0.8%
Happy 0.1%
Fear 1%
Confused 0.1%
Sad 91.9%

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a person holding a book 48.5%
a person sitting on top of a book 34.3%
a person sitting on a book 32.8%

Text analysis

Amazon

Slave
and
Dare
Do!"
(s to Dare and
to
bea
Not to bea
Not to
(s
(Vic.Hugo)

Google

to
be
Dare
Nat to be a Slave (s to Dare and Do!" (Vic. Hugo
a
and
Nat
(s
Do!"
Hugo
Slave
(Vic.