Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.15

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.8
Human 98.8
Text 76.7
Face 73.9
Art 72.3
Plant 70.4
Pottery 70.4
Jar 70.4
Vase 70.4
Potted Plant 70.4
Advertisement 68.8
Poster 67.1
Clothing 60
Apparel 60
Planter 55.8

Clarifai
created on 2019-10-29

man 98.5
adult 96.2
portrait 95.9
people 95.8
retro 94.9
one 94.1
mustache 94
lid 93.8
business 88.9
cap 88.2
actor 85.1
person 84.7
humor 84
sunglasses 84
wear 83.2
tie 80.7
eyeglasses 77.8
funny 76
sign 75.6
facial hair 75

Imagga
created on 2019-10-29

suit 62.6
man 53.1
male 52.5
clothing 44.3
handsome 40.1
portrait 39.5
garment 38.9
businessman 38.9
person 37.1
covering 35.6
adult 33
guy 32.4
face 29.1
business 28
looking 24.8
mask 23
tie 22.8
model 21.8
studio 21.3
people 21.2
confident 20.9
consumer goods 20.5
necktie 20.5
executive 19.4
black 18.8
one 18.7
smile 18.5
human 18
professional 17.9
shirt 17.7
attractive 17.5
corporate 17.2
disguise 16.6
serious 16.2
casual 16.1
head 16
smiling 15.9
jacket 15.8
look 15.8
standing 15.7
men 15.5
modern 15.4
success 15.3
expression 14.5
youth 14.5
bow tie 14.4
hand 14.3
fashion 14.3
manager 14
glasses 13.9
happy 13.8
office 13.7
attire 13
mustache 12.7
work 12.6
cool 12.4
sexy 12.1
friendly 11.9
eyes 11.2
hair 11.1
successful 11
style 10.4
close 10.3
boy 10.2
funny 10.1
alone 10
single 9.9
posing 9.8
coat 9.6
happiness 9.4
trench coat 9.4
occupation 9.2
stylish 9
beard 8.9
job 8.9
masculine 8.8
boss 8.6
hat 8.6
businesspeople 8.5
performer 8.3
pose 8.2
closeup 8.1
lifestyle 8
silly 7.9
costume 7.8
thinking 7.6
dark 7.5
comedian 7.5
positive 7.4
color 7.2
religion 7.2
worker 7.2

Google
created on 2019-10-29

Illustration 88.3
Art 77.2
Poster 67.4
Gentleman 66.5
Moustache 62.5
Jaw 57.4
Gesture 55.8
Drawing 51.1

Microsoft
created on 2019-10-29

cartoon 99.1
drawing 98.9
text 97.7
sketch 96.7
man 93.8
person 92.6
art 88.9
human face 86.9
painting 80.7
old 56
clothing 54.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Male, 86.9%
Sad 13.1%
Happy 0%
Angry 0.3%
Confused 0.2%
Disgusted 0%
Calm 86.1%
Surprised 0%
Fear 0.1%

Microsoft Cognitive Services

Age 53
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a man wearing a suit and tie 91.7%
a man wearing a hat 76.2%
a man wearing a suit and hat 76.1%

Text analysis

Amazon

OR/
LAB OR/
LAB

Google

Hah
ORI ILABON Hah
ORI
ILABON