Human Generated Data

Title

Me. Labori (The Dreyfus Affair)
Date

1984
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.7
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 96.9
Human 96.9
Art 77.1
Chef 67.3
Animal 66.6
Bird 66.6
Painting 59.8

Clarifai
created on 2019-10-29

man 98.8
adult 98.5
people 98.5
lid 97.4
mustache 97.3
wear 97.3
one 97.1
portrait 97.1
facial hair 94.5
retro 94
veil 91.3
outfit 88.8
illustration 86.9
art 85
business 84.9
print 84.7
humor 84.4
cap 83.2
painting 82.4
vintage 80.1

Imagga
created on 2019-10-29

person 37.7
man 37
male 36.9
portrait 33
suit 31.7
covering 28
comedian 27.7
clothing 27
face 27
adult 23.9
performer 23.6
people 22.9
hat 22.4
mask 22.3
handsome 20.5
businessman 20.3
jacket 20.1
guy 19
business 18.2
black 18.1
entertainer 17.8
attractive 16.8
model 16.3
disguise 15.2
garment 14.5
men 13.7
confident 12.7
religion 12.5
mystery 12.5
tie 12.3
consumer goods 12.1
executive 12.1
professional 12.1
fashion 12.1
sexy 12
one 11.9
expression 11.9
pretty 11.9
hand 11.9
casual 11.9
smiling 11.6
serious 11.4
necktie 11.4
smile 11.4
happy 11.3
office 11.2
costume 11
dark 10.9
attire 10.7
mysterious 10.7
studio 10.6
look 10.5
book jacket 10.5
standing 10.4
shirt 10.3
academic gown 9.7
bow tie 9.7
success 9.7
looking 9.6
work 9.4
manager 9.3
vintage 9.1
style 8.9
posing 8.9
carnival 8.8
hair 8.7
lifestyle 8.7
mortarboard 8.6
happiness 8.6
eyes 8.6
head 8.4
human 8.2
successful 8.2
job 8
beard 7.9
art 7.9
gown 7.8
god 7.7
painter 7.6
fun 7.5
holding 7.4
church 7.4
alone 7.3
worker 7.3
pose 7.2
dress 7.2
currency 7.2
headdress 7.1
love 7.1

Google
created on 2019-10-29

Cartoon 87.8
Illustration 87
Moustache 84.9
Art 76.7
Gentleman 76.1
Drawing 53.7
Gesture 51.7

Microsoft
created on 2019-10-29

text 99.5
drawing 99.3
cartoon 98.9
book 98.6
sketch 98.6
art 98.5
illustration 95.5
human face 87.3
painting 77.9
man 72.8
person 68.7
clothing 57.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Male, 97.6%
Fear 0.2%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Sad 1.4%
Calm 98%
Confused 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Bird 66.6%

Captions

Microsoft

a close up of a person holding a book 29.7%
a person wearing a hat 29.6%
a person holding a book 29.5%

Text analysis

Amazon

OR/
LA OR/
LA

Google

LABOR
LABOR