Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.4

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.4
Human 98.4
Art 87.6
Text 75.6
Painting 75.4
Advertisement 73.1
Poster 71.6
Jar 56.3
Vase 56.3
Pottery 56.3
Plant 55.4
Potted Plant 55.4

Clarifai
created on 2019-10-29

people 99.4
man 98.7
one 98.5
lid 98.5
portrait 98.4
adult 98.3
wear 97.3
mustache 96.5
facial hair 95.3
cap 94.3
veil 92.6
print 92
outfit 90.6
retro 90.1
illustration 84
leader 83.8
painting 82.4
lithograph 80.3
military 79.9
vintage 79

Imagga
created on 2019-10-29

man 43.7
male 43.3
person 37.5
clothing 33.7
portrait 33.7
covering 32.6
suit 32.2
handsome 30.3
mask 28.8
businessman 24.7
face 24.2
adult 23.3
guy 21.5
disguise 20.8
people 20.6
business 19.4
jacket 19.2
hat 17.7
model 16.3
serious 16.2
professional 16.2
attire 15.8
attractive 15.4
studio 15.2
looking 15.2
executive 14.7
garment 14.6
confident 14.6
black 14.5
office 14.5
uniform 14.3
modern 14
one 13.4
necktie 13.4
tie 13.3
consumer goods 13.2
smile 12.8
fashion 12.8
casual 12.7
comedian 12.5
performer 12.5
job 12.4
costume 12.3
look 12.3
standing 12.2
youth 11.9
happy 11.3
human 11.2
shirt 11.2
men 11.2
glasses 11.1
expression 11.1
head 10.9
smiling 10.9
corporate 10.3
occupation 10.1
coat 9.7
success 9.7
style 9.6
lifestyle 9.4
manager 9.3
dark 9.2
academic gown 9.2
worker 9.1
old 9.1
religion 9
cool 8.9
sexy 8.8
military uniform 8.8
work 8.6
entertainer 8.6
beard 8.5
vintage 8.3
alone 8.2
pose 8.2
boy 8
hair 7.9
art 7.9
hand 7.8
mysterious 7.8
culture 7.7
mystery 7.7
bow tie 7.5
senior 7.5
holding 7.4
gown 7.4
friendly 7.3
mustache 7.2

Google
created on 2019-10-29

Illustration 84.4
Cartoon 83.1
Gentleman 76.1
Art 75.5
Moustache 70.3
Drawing 55.8

Microsoft
created on 2019-10-29

drawing 99.7
text 99.2
sketch 99
cartoon 98.6
book 98.6
art 89.9
wearing 89.6
human face 87.9
hat 84.1
illustration 84.1
man 76.2
child art 72
person 71.8
old 71.2
clothing 65.8
painting 15.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 90%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Sad 4.2%
Angry 1.3%
Fear 0.1%
Calm 94.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a man wearing a hat 83.4%
a man wearing a hat and holding a book 51.2%
an old photo of a man wearing a hat 51.1%

Text analysis

Amazon

B
M. B OR/
OR/
M.

Google

ORI LAB
LAB
ORI