Human Generated Data

Title

Me. Labori (The Dreyfus Affair)
Date

1984
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.14
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Me. Labori (The Dreyfus Affair)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1984

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles I. Westheimer, M24098.14

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 98.6
Person 98.6
Text 81.4
Face 68.6
Advertisement 66.7
Poster 65.6
Pottery 65.1
Plant 65.1
Vase 65.1
Jar 65.1
Potted Plant 65.1
Finger 59.5
Priest 57.6
Overcoat 56.4
Suit 56.4
Apparel 56.4
Clothing 56.4
Coat 56.4

Clarifai
created on 2019-10-29

man 98.4
adult 96.9
portrait 96.5
people 94.4
retro 94
one 93.4
lid 93.2
mustache 93.2
business 92.4
person 91.4
actor 88.4
humor 88.2
cap 85.1
tie 83.6
sunglasses 82.7
funny 82.2
wear 81.8
sign 81.8
face 81.7
desktop 81.3

Imagga
created on 2019-10-29

suit 56.5
man 53.8
male 52.5
clothing 46.1
handsome 40.1
covering 39.8
portrait 39.5
businessman 37.1
person 36.6
garment 36.6
adult 34.3
guy 30.6
mask 29.7
face 28.4
business 27.4
looking 24
studio 21.3
people 21.2
executive 21.2
disguise 21.2
confident 20.9
tie 20.9
model 20.2
consumer goods 20.1
smile 20
professional 19.5
necktie 19.5
corporate 18.9
attractive 18.9
smiling 18.8
human 18.8
shirt 18.7
one 17.9
black 17.6
attire 16.4
men 16.3
modern 16.1
casual 16.1
success 16.1
glasses 15.7
happy 15.7
jacket 15.5
expression 15.4
youth 15.3
serious 15.3
head 15.1
hand 15
look 14.9
work 14.1
manager 14
standing 13.9
friendly 13.7
office 13.7
fashion 13.6
mustache 12.8
coat 12.8
bow tie 12.3
trench coat 12.1
stylish 11.8
cool 11.6
sexy 11.2
eyes 11.2
occupation 11
successful 11
alone 11
job 10.6
style 10.4
funny 10.1
single 9.9
businesspeople 9.5
boy 9.5
happiness 9.4
worker 8.9
posing 8.9
raincoat 8.9
hair 8.7
lifestyle 8.7
wearing 8.6
close 8.6
performer 8.2
pose 8.2
closeup 8.1
costume 8.1
masculine 7.8
hat 7.5
comedian 7.5
dark 7.5
mature 7.4
mortarboard 7.4
color 7.2

Google
created on 2019-10-29

Illustration 82.4
Gentleman 76.6
Moustache 72.9
Art 67.7
Poster 66.8
Gesture 55.8

Microsoft
created on 2019-10-29

cartoon 99.1
drawing 98.7
text 97.2
sketch 96.6
man 93.4
person 90.2
art 89.9
human face 85.4
wearing 80.2
painting 74.7
illustration 67.3
clothing 62.2
old 51.3
dressed 33

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 86.1%
Disgusted 0%
Surprised 0%
Confused 0.1%
Sad 6.8%
Happy 0%
Fear 0.1%
Angry 0.3%
Calm 92.7%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Categories

Imagga

people portraits 69.4%
events parties 19.3%
pets animals 8%
paintings art 2.4%

Captions

Microsoft
created on 2019-10-29

a man wearing a hat 79.8%
a man wearing a suit and tie 79.7%
a man wearing a suit and hat 79.6%

Text analysis

Amazon

OR/
LAB OR/
LAB

Google

ORI LAB
ORI
LAB