Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.7

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 99
Person 99
Advertisement 81.5
Poster 81.5
Text 81.3
Plant 76.3
Jar 76.3
Vase 76.3
Potted Plant 76.3
Pottery 76.3
Face 74.5
Art 72.6
Collage 62.8
Finger 59.4
Planter 59.2
Apparel 57.8
Clothing 57.8

Clarifai
created on 2019-10-29

man 98.8
portrait 98.3
lid 98
adult 97
mustache 96.8
people 96.7
retro 96.5
one 95.6
cap 92.3
wear 89.7
actor 86.4
person 86.2
facial hair 85.3
humor 85.2
paper 84.2
business 83.9
vintage 83.6
veil 82.8
beard 81.9
outfit 79.5

Imagga
created on 2019-10-29

mask 56.6
covering 51.8
male 41.2
man 41
disguise 40.6
clothing 36.1
portrait 35
person 33.9
face 32
suit 29.7
attire 29.6
handsome 26.8
adult 25.9
guy 23.2
businessman 22.1
professional 20.3
black 20
studio 19
attractive 18.9
head 18.5
business 17.6
people 17.3
human 17.2
smile 16.4
confident 16.4
model 16.3
costume 16.2
expression 15.4
consumer goods 14.5
office 14.5
serious 14.3
look 14
glasses 13.9
executive 13.8
corporate 13.8
looking 13.6
fashion 12.8
garment 12.7
tie 12.3
sexy 12
friendly 11.9
uniform 11.7
religion 11.7
standing 11.3
eyes 11.2
youth 11.1
funny 11
work 11
smiling 10.9
close 10.8
closeup 10.8
art 10.7
job 10.6
modern 10.5
one 10.5
men 10.3
happy 10
dark 10
mustache 9.9
mysterious 9.7
coat 9.6
jacket 9.6
casual 9.3
hand 9.3
occupation 9.2
necktie 9.1
performer 9
style 8.9
cool 8.9
comedian 8.7
god 8.6
beard 8.6
hat 8.4
manager 8.4
alone 8.2
success 8.1
worker 8
masculine 7.8
expressive 7.8
mystery 7.7
boy 7.6
shirt 7.6
pose 7.2
stylish 7.2
hair 7.1
trench coat 7

Google
created on 2019-10-29

Illustration 87.9
Art 74.8
Gentleman 70.1
Poster 66.1
Moustache 63.5
Drawing 59.3
Gesture 51.7
Style 51

Microsoft
created on 2019-10-29

drawing 99.2
cartoon 99
text 98.8
sketch 98.2
book 98.1
art 91.2
illustration 90.3
wearing 86.9
human face 81.4
hat 68.8
clothing 61.6
person 60.4
painting 52.6
man 51.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 88.5%
Confused 0.1%
Disgusted 0%
Calm 97.5%
Angry 0.2%
Happy 0%
Sad 2.1%
Surprised 0%
Fear 0%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a man wearing a hat 82.3%
a man wearing a hat and holding a book 49.4%
a man wearing a hat holding a book 48.3%

Text analysis

Amazon

LAB
LAB ORI
ORI

Google

ORI LAB
LAB
ORI