Human Generated Data

Title

Esterhazy (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24101.12

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Esterhazy (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 92.5
Human 92.5
Art 84.8
Clothing 78
Apparel 78
Painting 71.4

Clarifai
created on 2019-10-29

illustration 96.1
man 95.8
wear 93.1
art 92.7
people 91.4
portrait 89.7
retro 89.3
costume 88.2
lid 87
human 86.5
adult 86
chalk out 85.2
one 84.7
woman 84.1
traditional 83.9
person 83.5
vintage 81.8
desktop 81.6
mask 80.4
fashion 80.3

Imagga
created on 2019-10-29

shrine 76.4
place of worship 53.2
building 38.8
religion 38.5
temple 37.8
culture 32.4
sculpture 28.5
statue 26.8
art 23.7
man 22.2
religious 21.5
ruler 21.4
gold 21.4
ancient 19.9
god 19.1
male 18.4
travel 18.3
face 17.7
vestment 17.6
worship 17.4
architecture 17.2
old 16.7
structure 16.6
east 15.9
traditional 15.8
pray 15.5
prayer 15.4
spiritual 15.3
faith 15.3
spirituality 14.4
gown 13.9
history 13.4
monument 13.1
golden 12.9
clothing 12.9
mask 12.6
meditation 12.5
tourism 12.4
oriental 11.8
hat 11.7
covering 11.2
historic 11
protection 10.9
bangkok 10.8
warrior 10.7
outerwear 10.5
colorful 10
soldier 9.8
belief 9.7
guard 9.7
grand 9.7
palace 9.6
antique 9.5
sitting 9.4
decoration 9.4
church 9.2
peace 9.1
sacred 8.8
heritage 8.7
holiday 8.6
construction 8.5
black 8.4
head 8.4
famous 8.4
color 8.3
bust 8.3
helmet 8.3
landmark 8.1
symbol 8.1
person 8
worker 8
uniform 7.9
cultural 7.8
fighter 7.8
portrait 7.8
eastern 7.7
tradition 7.4
guy 7.3
people 7.2
detail 7.2
costume 7.1
job 7.1
interior 7.1

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

text 99.4
book 98.1
sketch 90.6
drawing 87.9
clothing 85.9
painting 70.1
person 70.1
fashion accessory 67.9
human face 54.8
hat 54.1
different 37.3

Face analysis

Amazon

AWS Rekognition

Age 6-16
Gender Female, 59.5%
Fear 12.5%
Happy 55.5%
Surprised 9.4%
Angry 3.4%
Confused 0.7%
Disgusted 0.5%
Calm 14.2%
Sad 3.8%

Feature analysis

Amazon

Person 92.5%
Painting 71.4%

Captions

Microsoft

a person holding a book 25.8%
a person wearing a uniform 25.7%
a person wearing a costume 25.6%

Text analysis

Amazon

Eslerhazy
Eslerhazy bum
shhne
bum

Google

74
74 Esterhazy
Esterhazy