Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.10

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 98.1
Person 98.1
Art 90.2
Text 82.6
Painting 80.7
Advertisement 71.7
Poster 66
Paper 55.2

Clarifai
created on 2019-10-29

people 99.3
man 98.8
adult 98.2
lid 98
one 97.8
portrait 97.2
wear 96.3
mustache 95.6
facial hair 94.1
print 93.3
cap 92
veil 91.2
outfit 90
illustration 88.5
retro 85.4
painting 85
leader 84.6
art 83.2
vintage 79.4
lithograph 79.3

Imagga
created on 2019-10-29

covering 51.6
mask 51
disguise 38.8
clothing 34.1
portrait 31.1
person 30
man 29.6
face 27.7
attire 27.6
male 26.9
black 19.3
people 19
hat 18
model 17.1
adult 16.8
suit 16.8
guy 16.7
costume 16.2
handsome 16
consumer goods 16
head 15.9
uniform 15.4
serious 15.3
religion 15.2
art 15.2
dark 15
performer 14.6
comedian 14.4
attractive 13.3
fashion 12.1
human 12
culture 12
jacket 11.8
mystery 11.5
god 11.5
military uniform 11.4
looking 11.2
eyes 11.2
style 11.1
professional 11
mysterious 10.7
businessman 10.6
old 10.4
sexy 10.4
church 10.2
dress 9.9
coat 9.8
business 9.7
office 9.6
look 9.6
standing 9.6
ancient 9.5
statue 9.5
entertainer 9.5
close 9.1
alone 9.1
studio 9.1
vintage 9.1
one 9
hand 8.9
carnival 8.8
artist 8.7
golden 8.6
painter 8.5
pretty 8.4
mortarboard 8.4
famous 8.4
sculpture 8.2
lady 8.1
icon 7.9
smile 7.8
architecture 7.8
evil 7.8
antique 7.8
men 7.7
military 7.7
expression 7.7
casual 7.6
tie 7.6
child 7.5
shirt 7.5
holding 7.4
cap 7.4
confident 7.3
pose 7.2
lifestyle 7.2
hair 7.1
posing 7.1

Google
created on 2019-10-29

Illustration 84.4
Art 80
Gentleman 76.6
Moustache 61.3
Drawing 59.3
Jaw 57.4
Gesture 51.7
Portrait 51.6

Microsoft
created on 2019-10-29

drawing 99.7
text 99.6
sketch 99.1
book 99
cartoon 98.9
art 94.1
painting 90.2
illustration 86.5
human face 85.8
child art 74.9
man 73.5
old 70.6
person 64.7
clothing 63.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 96.5%
Confused 0.1%
Fear 0%
Calm 98.2%
Angry 0.1%
Surprised 0%
Sad 1.5%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a man holding a book 33.6%
a man wearing a hat 33.5%
a man wearing a hat and holding a book 31.7%

Text analysis

Amazon

OR/
LAB OR/
LAB

Google

LABORI
LABORI