Human Generated Data

Title

John E. Hanson (U.S. delegate)
Date

1889-1890
People

Artist: Mathew B. Brady, American 1823 - 1896
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.27

Human Generated Data

Title

John E. Hanson (U.S. delegate)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.27

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 97.6
Apparel 97.6
Art 95.4
Person 94.6
Human 94.6
Coat 91.2
Overcoat 90.2
Painting 84.4
Portrait 66.3
Face 66.3
Photo 66.3
Photography 66.3
Accessory 64.4
Accessories 64.4
Tie 64.4
Suit 60.6
Steamer 56.4

Clarifai
created on 2019-02-28

people 98.9
one 97.8
man 97
portrait 95.9
adult 95
leader 94.8
administration 88.3
print 85.7
wear 83.2
art 82.6
painting 81.5
writer 77.6
retro 75.1
politician 73
elderly 71.8
business 70.4
old 69.4
scientist 69
illustration 68
engraving 65.8

Imagga
created on 2019-02-28

suit 76.8
clothing 52.9
man 49.7
businessman 45
garment 44.4
necktie 43.7
male 41.1
bow tie 39.6
business 39.5
person 38
portrait 36.9
handsome 36.6
military uniform 33.1
adult 31.7
covering 28.2
people 27.3
uniform 27.3
tie 26.6
face 26.3
jacket 26
consumer goods 26
executive 25.2
success 24.9
professional 22.9
looking 21.6
shirt 21.5
successful 21
confident 20.9
standing 20.9
corporate 20.6
one 20.2
guy 19.8
work 19.6
men 18
office 17.7
smile 17.1
expression 17.1
black 17
happy 16.9
studio 16.7
lifestyle 16.6
alone 16.4
job 15.9
smiling 15.9
human 15.7
modern 15.4
casual 15.3
model 14.8
manager 14
fashion 13.6
boss 13.4
elegant 12.9
hand 12.2
attractive 11.9
friendly 11.9
happiness 11.8
worker 11.6
adolescent 11.3
mature 11.2
style 11.1
hair 11.1
head 10.9
formal 10.5
businesspeople 10.4
senior 10.3
youth 10.2
cheerful 9.8
elderly 9.6
occupation 9.2
juvenile 9.1
employee 8.7
boy 8.7
confidence 8.6
only 8.6
serious 8.6
old 8.4
20s 8.2
single 8.2
businesswoman 8.2
stylish 8.1
gray 8.1
hat 8
posing 8
vertical 7.9
1 7.7
money 7.7
fashionable 7.6
smart 7.5
dark 7.5
color 7.2
working 7.1

Google
created on 2019-02-28

Photograph 96.5
Gentleman 88.3
Picture frame 85.6
Portrait 62.5
Vintage clothing 54.7
Art 50.2

Microsoft
created on 2019-02-28

old 48.2
picture frame 10.6
museum 10.6
person 7
domain 5.3
portrait 3.9
victorian 2.8
hat 1.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 95.4%
Confused 31.3%
Angry 10%
Disgusted 4.4%
Calm 18.8%
Happy 5.6%
Surprised 22.1%
Sad 7.8%

Microsoft Cognitive Services

Age 53
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.6%
Tie 64.4%
Suit 60.6%

Categories

Imagga

people portraits 54.8%
paintings art 18.7%
events parties 17.4%
streetview architecture 7.3%

Captions

Microsoft
created on 2019-02-28

a man posing for a photo 88.7%
an old photo of a man 86.1%
a man posing for a picture 86%

Text analysis

Amazon

n
n Hauson.
Hauson.