Human Generated Data

Title

Morris M. Estee (U.S. delegate)
Date

1889-1890
People

Artist: Mathew B. Brady, American 1823 - 1896
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.26

Human Generated Data

Title

Morris M. Estee (U.S. delegate)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 99.4
Apparel 99.4
Coat 98.1
Overcoat 98.1
Person 96.2
Human 96.2
Art 87.1
Suit 70.1
Face 65.5
Photography 65.5
Photo 65.5
Portrait 65.5
Text 59.5
Painting 59.2

Clarifai
created on 2019-03-01

people 99.5
one 99
portrait 98.2
adult 98
man 96.8
leader 95.8
administration 91.8
facial hair 90.3
wear 89.9
writer 87.5
elderly 80.9
art 79.6
print 79.5
scientist 78.6
painting 77.7
side view 76.8
mustache 75.5
outfit 74.3
chair 73.4
music 70.4

Imagga
created on 2019-03-01

suit 64.9
man 53.1
male 46.8
businessman 46.8
person 39.2
business 37.1
portrait 36.9
adult 34.3
handsome 33.9
executive 33.7
clothing 31.9
garment 31.3
necktie 27.1
bow tie 26.9
people 26.8
tie 26.6
face 26.3
senior 24.4
professional 24.2
confident 23.7
office 22.5
looking 22.4
corporate 22.3
jacket 21
black 20.7
successful 19.2
old 18.8
one 18.7
mature 18.6
covering 18.6
success 17.7
work 17.3
elderly 16.3
expression 16.2
modern 16.1
hand 16
manager 15.8
baron 15.8
smile 15.7
standing 15.6
alone 15.5
men 15.5
smiling 15.2
shirt 14.9
boss 14.4
happy 13.8
occupation 13.8
studio 13.7
older 13.6
businesspeople 13.3
lifestyle 13
human 12.8
casual 12.7
1 12.5
consumer goods 12.5
only 12.4
glasses 12
job 11.5
attractive 11.2
friendly 11
gray hair 10.8
businessperson 10.7
formal 10.5
attire 10.5
call 10.2
gray 9.9
grandfather 9.9
fashion 9.8
worker 9.8
collar 9.6
hair 9.5
elegant 9.4
holding 9.1
single 9
stylish 9
masculine 8.8
couple 8.7
confidence 8.6
sitting 8.6
guy 8.5
head 8.4
cheerful 8.1
hands 7.8
60s 7.8
ruler 7.8
color 7.8
model 7.8
eyes 7.7
serious 7.6
mask 7.4
businesswoman 7.3
aged 7.2
happiness 7.1

Google
created on 2019-03-01

Photograph 96.5
Gentleman 89.2
Picture frame 77.5
Portrait 76
Art 62.5
Facial hair 60.7
Self-portrait 55.4

Microsoft
created on 2019-03-01

wall 98.5
person 96.5
man 90.8
posing 88.3
suit 73.4
old 70.9
dressed 30.3
museum 30.3
art 8.2
portrait 8.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 94.9%
Sad 1.2%
Happy 5.7%
Angry 4.1%
Disgusted 1.3%
Calm 12.5%
Surprised 61%
Confused 14.2%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.2%
Suit 70.1%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 85.8%
a man that is standing in front of a mirror posing for the camera 79.8%
an old man standing in front of a mirror posing for the camera 78.6%

Text analysis

Amazon

hu
hu Eslee.
Eslee.