Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.11

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.9
Human 98.9
Art 81.5
Text 76.6
Advertisement 75.3
Poster 74.9
Face 71.1
Vase 65
Potted Plant 65
Plant 65
Pottery 65
Jar 65
Painting 58

Clarifai
created on 2019-10-29

man 99
adult 97.5
portrait 97.1
lid 96.9
people 96.9
mustache 96.8
one 96.3
retro 91.9
cap 90.2
business 89.2
wear 89.1
humor 87.3
facial hair 86.2
person 85.3
tie 84.9
beard 82.7
actor 82
eyeglasses 81
veil 79.9
funny 78.7

Imagga
created on 2019-10-29

clothing 47.8
suit 45.7
male 44.7
man 43.7
portrait 36.3
covering 35.3
person 35.1
handsome 31.2
face 30.6
adult 27.2
businessman 26.5
guy 26.1
academic gown 25.4
garment 25
mask 22.9
studio 22
model 21.8
black 21.5
business 21.3
gown 21
consumer goods 21
mortarboard 20.2
people 20.1
professional 19.6
looking 18.4
human 18
disguise 17.8
attractive 17.5
cap 16.7
one 16.4
smile 16.4
confident 15.5
men 15.5
expression 15.4
necktie 15.3
outerwear 15.2
jacket 15.2
head 15.1
executive 14.8
success 14.5
smiling 14.5
hat 14.1
look 14
standing 13.9
costume 13.8
happy 13.2
corporate 12.9
fashion 12.8
casual 12.7
serious 12.4
attire 12.4
tie 12.3
shirt 12.1
bow tie 12.1
office 12.1
eyes 12.1
sexy 12.1
modern 11.9
hand 11.9
headdress 11.9
alone 11.9
dark 11.7
job 11.5
manager 11.2
youth 11.1
occupation 11
work 11
coat 10.9
happiness 10.2
glasses 10.2
successful 10.1
single 9.9
style 9.6
lifestyle 9.4
boy 9.3
friendly 9.2
religion 9
cool 8.9
funny 8.3
pose 8.2
stylish 8.1
dress 8.1
posing 8
close 8
trench coat 7.9
evil 7.8
mysterious 7.8
uniform 7.7
elegant 7.7
mystery 7.7
employee 7.7
formal 7.6
businesspeople 7.6
thinking 7.6
art 7.5
holding 7.4
closeup 7.4
color 7.2

Google
created on 2019-10-29

Illustration 87.7
Cartoon 83.7
Art 74.8
Moustache 73.4
Gentleman 72.7
Poster 70.4
Gesture 51.7

Microsoft
created on 2019-10-29

cartoon 98.7
drawing 98.7
text 96.4
sketch 96.2
man 92.4
art 91
person 90.5
human face 85.3
wearing 81.1
illustration 75.2
painting 67.8
old 58.8
clothing 52
dressed 43.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 86.7%
Confused 0.1%
Calm 95.3%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0.2%
Sad 4.3%
Surprised 0%

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a man wearing a hat 78.1%
a man wearing a suit and tie 78%
a man wearing a suit and hat 77.9%

Text analysis

Amazon

ORI
LAB ORI
LAB

Google

SLABOR
SLABOR