Human Generated Data

Title

A.W. Fergusson (interpreter)
Date

1889-1890
People

Artist: Mathew B. Brady, American 1823 - 1896
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.40

Human Generated Data

Title

A.W. Fergusson (interpreter)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.40

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 98.2
Apparel 98.2
Person 94.4
Human 94.4
Art 85.5
Overcoat 85.1
Coat 85.1
Sleeve 68.8
Photography 67.4
Portrait 67.4
Face 67.4
Photo 67.4
Painting 62.8
Standing 61
Man 60.8
Suit 60.1
Text 59

Clarifai
created on 2019-02-28

people 99.1
one 97.6
man 96.1
portrait 95.4
adult 93.9
wear 92.7
administration 90.6
leader 87.6
military 86.9
retro 84.7
art 81.7
painting 75.9
print 75
indoors 73.2
music 72.9
outfit 72.3
war 65.8
pensive 65.4
writer 64.1
facial hair 62.9

Imagga
created on 2019-02-28

suit 67
garment 54.3
bow tie 51.9
clothing 45.3
necktie 45
person 37.9
portrait 32.4
man 32.3
adult 30.4
people 27.9
business 26.1
male 25.5
businessman 24.7
adolescent 23.8
face 23.4
fashion 23.4
jacket 22.5
covering 20.6
handsome 20.5
one 19.4
juvenile 19.3
looking 18.4
alone 18.3
lifestyle 18.1
model 17.9
consumer goods 17.7
attractive 17.5
executive 17.2
elegant 17.1
success 16.9
standing 15.7
black 15.4
casual 15.3
confident 14.6
hair 14.3
human 14.3
successful 13.7
studio 13.7
smile 12.8
happy 12.5
manager 12.1
sexy 12
expression 11.9
old 11.8
professional 11.8
happiness 11.8
posing 11.6
tie 11.4
lady 11.4
office 11.2
modern 11.2
men 11.2
color 11.1
statue 11
hand 10.6
style 10.4
dress 9.9
sculpture 9.8
cheerful 9.8
1 9.6
brunette 9.6
boss 9.6
only 9.5
businesspeople 9.5
camera 9.2
head 9.2
boy 8.8
smiling 8.7
coat 8.6
cute 8.6
corporate 8.6
clothes 8.4
pretty 8.4
elegance 8.4
businesswoman 8.2
stylish 8.1
indoors 7.9
vertical 7.9
youth 7.7
historical 7.5
dark 7.5
shirt 7.5
vintage 7.4
guy 7.4
pose 7.3
job 7.1
work 7.1

Google
created on 2019-02-28

Photograph 96.7
Snapshot 83.3
Gentleman 78.4
Picture frame 64.8
Vintage clothing 59
Art 50.2

Microsoft
created on 2019-02-28

wall 98.4
old 96
man 95.4
person 91
suit 79.9
posing 76
white 71.5
vintage 35.8
older 22.3
picture frame 18.6
museum 18.6
domain 4.7
victorian 3.9
photograph 2.5
art 2.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Male, 61.2%
Surprised 26.4%
Disgusted 2.3%
Happy 11.2%
Angry 4.8%
Calm 31.6%
Sad 7.7%
Confused 16%

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.4%
Suit 60.1%

Categories

Imagga

events parties 83.5%
people portraits 9.4%
paintings art 4.8%
streetview architecture 1.4%

Text analysis

Amazon

Seiygusou.
htenfriten
Ma Seiygusou. htenfriten
Ma