Human Generated Data

Title

Me. Labori (The Dreyfus Affair)
Date

1984
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.4
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.6
Human 98.6
Face 82
Poster 75.3
Advertisement 75.3
Text 75
Potted Plant 68.3
Vase 68.3
Pottery 68.3
Jar 68.3
Plant 68.3
Finger 61.3
Art 56.7
Planter 56.5
Priest 56.3

Clarifai
created on 2019-10-29

man 98.8
portrait 98.7
people 98.5
lid 98.5
mustache 97.5
adult 97.3
one 96.9
cap 95
retro 94.9
facial hair 93.7
wear 93.2
outfit 87.1
veil 85
beard 85
military 83.5
vintage 83.2
person 82.7
illustration 81.6
eyeglasses 78.9
uniform 78.9

Imagga
created on 2019-10-29

male 42.6
man 41.7
person 35.2
portrait 31.7
suit 31
mask 30.6
clothing 29.9
face 29.1
covering 28.1
adult 25.2
handsome 24.1
disguise 22.2
people 20.6
guy 19.6
businessman 19.4
model 17.9
professional 17.9
black 17
attire 17
attractive 16.8
business 16.4
costume 16.3
serious 16.2
expression 16.2
one 15.7
studio 15.2
human 15
head 14.3
smile 14.3
garment 14.2
glasses 13.9
looking 13.6
executive 12.9
success 12.9
religion 12.5
coat 12.4
fashion 12.1
men 12
art 11.9
confident 11.8
necktie 11.8
smiling 11.6
look 11.4
trench coat 11.4
jacket 11.3
modern 11.2
hat 10.7
hand 10.5
sexy 10.4
tie 10.4
standing 10.4
uniform 10.4
eyes 10.3
corporate 10.3
close 10.3
shirt 10.3
youth 10.2
alone 10
holding 9.9
consumer goods 9.8
old 9.8
office 9.6
closeup 9.4
casual 9.3
manager 9.3
occupation 9.2
style 8.9
happy 8.8
mysterious 8.7
work 8.6
god 8.6
boss 8.6
culture 8.5
ruler 8.5
raincoat 8.3
successful 8.2
friendly 8.2
beard 8
posing 8
cool 8
job 8
lifestyle 8
macho 7.7
statue 7.6
power 7.6
dark 7.5
religious 7.5
church 7.4
military uniform 7.3
pose 7.2
stylish 7.2
hair 7.1
happiness 7.1
boy 7

Google
created on 2019-10-29

Illustration 84.3
Cartoon 82.7
Gentleman 75.5
Moustache 72.3
Poster 70.4
Art 69.5
Jaw 57.4
Drawing 51.1

Microsoft
created on 2019-10-29

drawing 99.4
cartoon 99.1
sketch 99
text 96.8
book 93.6
art 93.3
illustration 92.3
human face 69.6
man 56.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 90.7%
Calm 96.1%
Angry 0.7%
Fear 0.1%
Confused 0.1%
Sad 2.9%
Disgusted 0%
Happy 0%
Surprised 0.1%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a man wearing a hat 71.7%
a man holding a book 37.6%
a man wearing a hat and holding a book 35.8%

Text analysis

Amazon

Me
LAB
Me LAB ORI
ORI

Google

LABORI
LABORI