Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.12

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 97.5
Human 97.5
Art 93.9
Painting 85.8
Advertisement 69
Poster 69
Text 68.1
Leisure Activities 63.2
Drawing 58.8
Collage 57.9

Clarifai
created on 2019-10-29

people 99.6
print 99
illustration 98.9
adult 98.8
man 98.3
portrait 98.3
art 97.9
one 97.5
wear 96
facial hair 95.7
leader 92.7
painting 91.9
vintage 91.4
old 91.2
engraving 88.8
lid 88
mustache 87.3
retro 84.8
antique 82.9
military 82.9

Imagga
created on 2019-10-29

covering 63.7
mask 53.3
disguise 43
religion 37.7
sculpture 35.7
statue 35.3
art 30.5
book jacket 30.2
attire 30.2
ancient 26.8
culture 24.8
god 23.9
jacket 23.5
decoration 22.7
old 22.3
religious 21.6
stone 20.5
church 19.4
clothing 19.2
graffito 18.9
architecture 18.8
temple 18
wrapping 17.9
face 17.8
antique 17.3
history 15.2
travel 14.8
golden 14.6
painter 14.6
faith 14.4
vintage 14.1
monument 14
ruler 14
pray 13.6
worship 13.5
holy 13.5
spirituality 13.4
historic 12.8
icon 12.7
cemetery 12.5
head 11.8
tourism 11.6
saint 11.5
detail 11.3
portrait 11
museum 10.8
currency 10.8
carving 10.7
gold 10.7
prayer 10.6
spiritual 10.6
comic book 10.4
historical 10.4
close 10.3
symbol 10.1
consumer goods 10
one 9.7
man 9.4
money 9.4
famous 9.3
bust 9.1
figure 8.9
sacred 8.8
catholic 8.8
meditation 8.6
shield 8.4
black 8.4
artwork 8.2
masterpiece 7.9
male 7.8
roman 7.8
belief 7.8
heritage 7.7
armor 7.6
oriental 7.6
traditional 7.5
east 7.5
banking 7.4
cash 7.3
tourist 7.3
costume 7.2
building 7.1

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

text 100
book 99.9
drawing 99.7
sketch 99.2
cartoon 95.2
art 92.9
painting 92
human face 85.1
illustration 83.2
man 80.6
person 78.4
child art 78.2
handwriting 77.5
clothing 64.7
old 59

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 94%
Sad 0.1%
Surprised 1.3%
Fear 0%
Calm 97.8%
Disgusted 0.1%
Confused 0.1%
Happy 0%
Angry 0.5%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Poster 69%

Captions

Microsoft

a person holding a book 54%
an old photo of a person 53.9%
a close up of a person holding a book 43.9%

Text analysis

Amazon

OR/
LA B OR/
LA B
2so
d

Google

LABORI
LABORI