Human Generated Data

Title

Me. Labori (The Dreyfus Affair)
Date

1984
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.13
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 98.6
Person 98.6
Text 78.4
Art 78
Advertisement 76.9
Vase 76.8
Plant 76.8
Jar 76.8
Pottery 76.8
Potted Plant 76.8
Poster 76
Face 62.2
Clothing 58.2
Apparel 58.2
Planter 58.1
Herbal 57.7
Herbs 57.7
Beverage 56.3
Drink 56.3
Alcohol 56.3
Liquor 56.3

Clarifai
created on 2019-10-29

man 98.7
lid 97.5
adult 97
portrait 96.9
mustache 95.6
people 95.3
one 94.4
cap 91.3
retro 91.1
business 90.8
person 90.3
humor 88.6
tie 86.9
actor 86.6
suit 85.4
funny 82.7
sunglasses 81.9
amusing 81.8
eyeglasses 78.8
wear 78

Imagga
created on 2019-10-29

man 47.7
male 46.8
suit 43.2
clothing 36.7
person 36.6
portrait 35.6
face 32
covering 31.5
handsome 30.3
adult 28.5
businessman 28.3
mask 26.7
guy 26.1
garment 24.7
business 21.9
black 21.4
disguise 21.3
people 20.6
studio 20.5
model 20.2
professional 18.7
attractive 18.2
smile 17.8
looking 17.6
costume 17.1
necktie 16.9
head 16.8
human 16.5
one 15.7
executive 15.7
standing 15.7
consumer goods 15.5
confident 15.5
tie 15.2
performer 15
comedian 14.9
corporate 14.6
men 14.6
attire 14.6
success 14.5
smiling 14.5
hat 14.5
happy 14.4
serious 14.3
look 14
expression 13.7
youth 12.8
shirt 12.1
office 12.1
modern 11.9
bow tie 11.9
casual 11.9
fashion 11.3
eyes 11.2
glasses 11.1
work 11
successful 11
alone 11
jacket 10.8
cool 10.7
entertainer 10.5
sexy 10.4
hand 10.4
manager 10.2
happiness 10.2
occupation 10.1
single 9.9
funny 9.2
friendly 9.2
stylish 9
religion 9
job 8.9
coat 8.8
closeup 8.8
mysterious 8.7
mystery 8.7
businesspeople 8.5
dark 8.4
style 8.2
posing 8
close 8
mustache 7.9
mortarboard 7.9
employee 7.7
gown 7.6
fun 7.5
boy 7.5
beard 7.4
pose 7.3
lifestyle 7.2
cap 7.2
academic gown 7.2
worker 7.2
trench coat 7.2

Google
created on 2019-10-29

Illustration 87.5
Art 72.1
Poster 70
Gentleman 67.8
Moustache 57.4
Jaw 57.4
Gesture 55.8

Microsoft
created on 2019-10-29

drawing 98.7
text 98.7
cartoon 98.6
sketch 96.4
person 92.2
art 89.7
human face 82.4
painting 79.9
man 63.2
illustration 62.6
old 53.1
clothing 52.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 87.2%
Confused 0.1%
Fear 0.1%
Disgusted 0%
Angry 0.2%
Happy 0%
Surprised 0%
Calm 93.6%
Sad 5.9%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a man wearing a hat 73.5%
a man holding a book 47.4%
a man wearing a suit and tie 47.3%

Text analysis

Amazon

OR/
LAB OR/
LAB

Google

LABORI
LABORI