Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

Date

1984

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24099.13

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 97.6
Human 97.6
Text 88.5
Advertisement 84.2
Poster 84.2
Art 83.4
Painting 60.4
Collage 59.3
Paper 58.8
Brochure 56.9
Flyer 56.9

Clarifai
created on 2019-10-29

people 99.3
man 98.7
adult 97.8
mustache 96.7
one 96.3
portrait 96.2
lid 95.1
facial hair 94.8
wear 91.7
person 89.4
veil 86.6
outfit 86.1
retro 82
cap 79.9
painting 79.8
leader 79.6
eyewear 79
print 77.8
humor 77.7
actor 77.4

Imagga
created on 2019-10-29

mask 100
covering 94.1
disguise 78
attire 56.3
clothing 40.2
face 29.8
portrait 29.8
man 29.6
male 27.7
person 25.3
ruler 21.5
black 19.8
adult 19.4
consumer goods 19.2
religion 18.8
suit 18.6
businessman 18.5
costume 17.1
handsome 16.9
art 13.9
guy 13.8
expression 13.6
professional 13.5
head 13.4
studio 12.9
hat 12.8
business 12.1
eyes 12.1
attractive 11.9
carnival 11.7
mysterious 11.7
jacket 11.4
model 10.9
masquerade 10.8
people 10.6
mystery 10.6
god 10.5
look 10.5
serious 10.5
culture 10.3
church 10.2
old 9.8
office 9.6
looking 9.6
shirt 9.3
dark 9.2
vintage 9.1
dress 9
venetian 8.9
mustache 8.9
uniform 8.7
golden 8.6
decoration 8.6
smile 8.6
tie 8.5
hand 8.5
glasses 8.3
executive 8.3
fashion 8.3
funny 8.3
gold 8.2
one 8.2
protection 8.2
style 8.2
sexy 8
evil 7.8
antique 7.8
ancient 7.8
horror 7.8
party 7.7
corporate 7.7
military 7.7
humor 7.7
book jacket 7.5
human 7.5
manager 7.4
retro 7.4
makeup 7.3
lady 7.3
confident 7.3
make 7.3
fantasy 7.2
celebration 7.2
coat 7.1
work 7.1

Google
created on 2019-10-29

Illustration 86.6
Art 80
Gentleman 63.5
Drawing 59.3
Jaw 57.4
Fictional character 52.8
Gesture 51.7

Microsoft
created on 2019-10-29

text 99.5
drawing 99.2
cartoon 98.5
book 98.4
sketch 96.6
art 94.9
painting 88.4
person 86.1
illustration 84.3
human face 83.7
man 66.1
child art 64.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Male, 80.2%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0.1%
Surprised 0%
Sad 0.9%
Calm 98.9%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Captions

Microsoft

a man holding a book 43.1%
a close up of a man holding a book 32.2%
a man wearing a suit and tie holding a book 32.1%

Text analysis

Amazon

RI
LAB RI
LAB

Google

M
レABOR/M
ABOR
/