Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.5

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 98.6
Person 98.6
Face 82.3
Poster 75.8
Advertisement 75.8
Potted Plant 74.5
Plant 74.5
Vase 74.5
Pottery 74.5
Jar 74.5
Text 72.6
Art 72
Apparel 60.4
Clothing 60.4
Planter 58
Finger 55.6

Clarifai
created on 2019-10-29

man 99
portrait 98.6
people 97.8
lid 97.5
one 97.2
adult 97
mustache 96.5
retro 95.1
facial hair 93.4
cap 93.2
wear 92.6
veil 86.4
outfit 85.7
business 84.8
beard 82.3
sunglasses 81.8
actor 81.4
paper 80.6
eyeglasses 80.6
tie 78.7

Imagga
created on 2019-10-29

mask 45.8
covering 41.2
male 39.7
man 39.7
suit 35.4
portrait 35
clothing 34.8
person 34.8
disguise 33.2
face 30.6
adult 27.2
handsome 25.9
guy 24.2
businessman 23.8
attire 23.5
black 21.3
studio 20.5
attractive 20.3
people 19.5
model 19.5
business 19.4
professional 18.7
human 18
expression 17.9
smile 17.1
costume 17
fashion 16.6
head 16
garment 15.6
one 14.9
glasses 14.8
executive 14.7
confident 14.6
trench coat 14.5
serious 14.3
look 14
corporate 13.8
jacket 13.7
office 13.7
sexy 13.7
looking 13.6
coat 13.3
men 12.9
consumer goods 12.7
success 12.1
modern 11.9
religion 11.7
smiling 11.6
tie 11.4
alone 11
raincoat 10.8
mysterious 10.7
style 10.4
eyes 10.3
shirt 10.3
necktie 10.3
manager 10.2
youth 10.2
casual 10.2
friendly 10.1
dark 10
art 10
hand 9.8
close 9.7
standing 9.6
work 9.4
happy 9.4
performer 9.2
funny 9.2
successful 9.2
stylish 9
lady 8.9
uniform 8.9
comedian 8.8
old 8.4
holding 8.3
occupation 8.3
dress 8.1
cool 8
job 8
happiness 7.8
masculine 7.8
mystery 7.7
god 7.7
boss 7.7
religious 7.5
closeup 7.4
single 7.4
pose 7.3
lifestyle 7.2
posing 7.1

Google
created on 2019-10-29

Illustration 85.1
Gentleman 76.6
Art 74.8
Moustache 69.6
Poster 66.1
Jaw 57.4
Drawing 55.8
Style 51

Microsoft
created on 2019-10-29

drawing 99.2
cartoon 98.6
sketch 98.6
text 96.4
book 92.7
art 92.5
illustration 88.5
human face 82.8
person 58.9
man 56.7
clothing 52.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 87.9%
Disgusted 0%
Surprised 0.1%
Happy 0%
Confused 0.1%
Calm 92.7%
Angry 0.6%
Fear 0.1%
Sad 6.3%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a man wearing a hat 67%
a man holding a book 36.1%
a man wearing a hat and holding a book 31.2%

Text analysis

Amazon

LAB
LAB ORI
ORI

Google

Hah
LAPORI Hah IN
LAPORI
IN