Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.5

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 97.8
Person 97.8
Art 89.4
Advertisement 82.6
Poster 79.9
Painting 79.4
Text 78.2
Paper 57.3

Clarifai
created on 2019-10-29

people 99.5
portrait 98.9
lid 98.9
man 98.6
adult 98
one 97.4
mustache 97
cap 94.6
wear 94.6
print 94.1
retro 93.4
facial hair 92.6
illustration 89.7
outfit 89.2
vintage 88.5
veil 87.1
art 85.8
leader 84.8
uniform 83.8
military 81.9

Imagga
created on 2019-10-29

mask 44.1
covering 40.5
portrait 38.2
person 36.7
man 33.6
male 32.6
disguise 31.3
clothing 31
face 28.4
comedian 27.7
performer 24.3
suit 23
hat 22.7
model 22.6
attire 22.3
adult 22
black 21.8
guy 21.7
handsome 21.4
people 20.6
attractive 20.3
entertainer 17.6
studio 17.5
fashion 17.3
costume 16.7
dark 15.9
businessman 15
looking 14.4
business 14
standing 13.9
jacket 13.8
sexy 13.7
mysterious 13.6
head 13.4
serious 13.3
look 13.1
smile 12.8
consumer goods 12.8
professional 12.7
necktie 12.2
uniform 12
human 12
style 11.9
garment 11.9
confident 11.8
art 11.8
mystery 11.5
tie 11.4
office 11.2
one 11.2
pretty 11.2
glasses 11.1
youth 11.1
lady 10.5
modern 10.5
hair 10.3
coat 10.1
happy 10
religion 9.9
cool 9.8
carnival 9.7
military uniform 9.5
men 9.4
beard 9.4
culture 9.4
expression 9.4
casual 9.3
executive 9.2
old 9.1
dress 9
fun 9
posing 8.9
masquerade 8.9
bow tie 8.7
brunette 8.7
god 8.6
eyes 8.6
trench coat 8.4
vintage 8.3
holding 8.3
pose 8.2
close 8
smiling 8
cute 7.9
sunglasses 7.5
shirt 7.5
church 7.4
funny 7.3
makeup 7.3
friendly 7.3
alone 7.3
success 7.2
stylish 7.2
eye 7.1
hand 7

Google
created on 2019-10-29

Illustration 81.8
Gentleman 78.4
Art 74.8
Moustache 70.3
Jaw 57.4
Drawing 51.1

Microsoft
created on 2019-10-29

text 99.8
drawing 99.7
book 99.3
sketch 99.2
cartoon 97.9
illustration 91
art 89.9
human face 83.4
man 81.5
painting 78.6
old 70.7
person 69.3
clothing 68.2
child art 67.1
handwriting 58.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-38
Gender Male, 93.9%
Happy 0%
Disgusted 0%
Fear 0.1%
Angry 0.3%
Calm 96%
Sad 3.1%
Surprised 0.1%
Confused 0.3%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%

Captions

Microsoft

a man wearing a hat 78.8%
a man wearing a hat and holding a book 48.6%
an old photo of a man wearing a hat 48.5%

Text analysis

Amazon

LAB
ORI
Me LAB ORI
Me

Google

LAB
ORI LAB
ORI