Human Generated Data

Title

Me. Labori
Date

1984
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Stephen Lee Taller Ben Shahn Archive, Gift of Dolores S. Taller, M25664
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.7
Human 98.7
Text 88.4
Art 80.5
Poster 71.3
Advertisement 71.3
Plant 69.8
Drawing 60.6
Blossom 60.6
Flower 60.6

Clarifai
created on 2019-10-29

people 99.7
portrait 99.6
man 99
mustache 98.2
adult 98.1
one 97.7
facial hair 97.7
lid 96.5
wear 94.8
retro 94.4
leader 93.9
vintage 92.6
outfit 88.2
old 87.4
art 87.3
engraving 86.2
print 85.8
illustration 82
military 81.8
beard 80.7

Imagga
created on 2019-10-29

person 29.9
man 29.6
portrait 27.8
face 27.7
male 27
mask 25.4
clothing 21
covering 20.5
disguise 19.5
art 19.4
black 18.8
religion 17.9
costume 16.7
culture 16.2
adult 16.2
head 16
comedian 15.8
ancient 15.6
statue 15.3
model 14.8
sculpture 14.6
performer 14.5
suit 14.4
handsome 14.3
guy 14.1
old 13.9
church 13.9
mysterious 12.6
god 12.4
serious 12.4
ruler 12.4
people 12.3
hat 12.2
fashion 12.1
attractive 11.9
style 11.9
vintage 11.6
golden 11.2
dark 10.9
businessman 10.6
mystery 10.6
antique 10.4
party 10.3
expression 10.2
uniform 10.2
entertainer 10.2
attire 10
dress 9.9
studio 9.9
carnival 9.7
close 9.7
look 9.6
closeup 9.4
historical 9.4
garment 9.2
business 9.1
retro 9
sexy 8.8
military 8.7
standing 8.7
faith 8.6
eyes 8.6
jacket 8.5
religious 8.4
famous 8.4
human 8.2
one 8.2
symbol 8.1
celebration 8
necktie 8
consumer goods 7.9
hair 7.9
icon 7.9
masquerade 7.9
venetian 7.9
hidden 7.9
decoration 7.8
prayer 7.7
luxury 7.7
artist 7.7
holy 7.7
professional 7.6
stone 7.6
monument 7.5
painter 7.4
beard 7.4
bow tie 7.4
makeup 7.3
pose 7.2
history 7.2
coat 7.1
smile 7.1
military uniform 7.1
architecture 7

Google
created on 2019-10-29

Illustration 85.8
Gentleman 82.6
Art 75.5
Moustache 63.5
Drawing 57.6

Microsoft
created on 2019-10-29

text 99.7
drawing 99.1
sketch 98.8
book 98.3
cartoon 97.4
man 91.3
human face 79.8
clothing 74.5
old 71.2
person 65.1
hat 51.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 90.7%
Confused 0%
Fear 0%
Disgusted 0%
Sad 0.4%
Calm 99.4%
Angry 0.2%
Surprised 0%
Happy 0%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a man wearing a hat 82.7%
an old photo of a man 82.6%
an old photo of a man wearing a hat 79.8%

Text analysis

Amazon

OR/
LA B OR/
LA B

Google

AROR LAB
AROR
LAB