Human Generated Data

Title

Me. Labori (The Dreyfus Affair)
Date

1984
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.9
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 97.5
Human 97.5
Art 87.2
Painting 79.5
Text 77.5
Advertisement 76.1
Poster 74.9
Sunglasses 67.7
Accessories 67.7
Accessory 67.7

Clarifai
created on 2019-10-29

people 99
lid 98.5
man 98
portrait 97.3
adult 97.2
one 97.1
mustache 96.5
wear 95
cap 92.8
retro 88.1
print 87.7
outfit 86.6
facial hair 85
painting 84.3
art 83
illustration 81.4
veil 80.6
person 79.3
leader 78.2
vintage 77.7

Imagga
created on 2019-10-29

clothing 38.5
covering 37.8
person 36.1
portrait 34.9
man 34.9
male 33.3
mask 31.5
face 29.8
hat 23.6
disguise 23.3
suit 22.7
adult 22
people 21.7
model 21
guy 19.6
black 19.4
head 18.5
uniform 17.9
handsome 17.8
attractive 17.5
mortarboard 17.5
consumer goods 17.4
academic gown 17.3
professional 16.9
attire 16.8
costume 16.7
human 15.7
cap 15.6
fashion 15.1
businessman 15
gown 14.8
studio 14.4
serious 14.3
dark 14.2
business 14
looking 13.6
military uniform 13.4
style 12.6
standing 12.2
smile 12.1
sexy 12
art 11.8
comedian 11.5
mystery 11.5
jacket 11.4
performer 11.4
look 11.4
one 11.2
confident 10.9
religion 10.8
mysterious 10.7
headdress 10.6
outerwear 10.5
eyes 10.3
men 10.3
expression 10.2
casual 10.2
vintage 9.9
pretty 9.8
old 9.8
job 9.7
office 9.6
god 9.6
hair 9.5
tie 9.5
smiling 9.4
culture 9.4
happy 9.4
occupation 9.2
alone 9.1
close 9.1
garment 9.1
dress 9
coat 9
success 8.9
work 8.6
hand 8.6
youth 8.5
shirt 8.4
manager 8.4
glasses 8.3
executive 8.3
holding 8.3
friendly 8.2
necktie 8.2
lady 8.1
eye 8
trench coat 8
cool 8
lifestyle 7.9
entertainer 7.8
evil 7.8
carnival 7.8
corporate 7.7
military 7.7
modern 7.7
statue 7.6
closeup 7.4
pose 7.2
helmet 7.1
posing 7.1
boy 7.1
happiness 7

Google
created on 2019-10-29

Illustration 85.9
Art 78.9
Gentleman 71
Moustache 69.6
Drawing 60.7
Gesture 51.7

Microsoft
created on 2019-10-29

drawing 99.7
sketch 99.2
text 99
cartoon 98.4
book 98
art 94.1
illustration 89.2
painting 88.7
human face 87.1
person 86.8
wearing 81.6
man 73.8
child art 70.8
old 68.2
hat 63.2
clothing 61.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 95.1%
Happy 0%
Confused 0.3%
Fear 0%
Sad 2.8%
Angry 0.3%
Calm 96.5%
Surprised 0%
Disgusted 0%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Sunglasses 67.7%

Captions

Microsoft

a man wearing a hat 77.6%
a man wearing a hat and holding a book 42.9%
a man wearing a black hat 42.8%

Text analysis

Amazon

OR/
M: LA B OR/
M:
LA B

Google

ORI
ORI LAB SIN
LAB
SIN