Human Generated Data

Title

Horatio Guzman (Nicaraguan delegate)

Date

1889-1890

People

Artist: Mathew B. Brady, American 1823 - 1896

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.3

Human Generated Data

Title

Horatio Guzman (Nicaraguan delegate)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 95.6
Apparel 95.6
Human 95
Person 95
Art 91.9
Painting 86.8
Coat 83.4
Overcoat 83.4
Photography 63.3
Photo 63.3
Face 63.3
Portrait 63.3
Text 61
Accessory 58.7
Tie 58.7
Accessories 58.7

Clarifai
created on 2019-02-26

people 99.8
one 99.1
adult 98.7
portrait 98.2
man 96.4
leader 95
wear 94.5
art 94.2
print 93.6
administration 89.5
painting 85
military 79.8
retro 78.8
vintage 78.4
woman 77.9
illustration 77
old 76.2
outfit 75.7
chair 74.6
outerwear 74.2

Imagga
created on 2019-02-26

suit 56
jacket 39.1
person 35.6
garment 32.2
portrait 31.7
clothing 30.5
trench coat 28.8
people 28.5
business 27.3
man 26.9
adult 25.9
male 24.8
coat 24.4
face 23.4
model 23.3
raincoat 23.1
businessman 22.1
attractive 21.7
fashion 21.1
one 20.9
happy 20.7
smile 20.7
necktie 20.6
handsome 19.6
success 19.3
tie 19
bow tie 18.3
businesswoman 18.2
covering 18.1
elegant 18
lady 17.9
shirt 17.7
successful 17.4
standing 17.4
smiling 17.4
work 17.3
casual 17
professional 16.9
alone 16.4
office 16.1
looking 16
lifestyle 15.9
executive 15.9
corporate 15.5
black 15.1
hair 15.1
job 15
pretty 14.7
cheerful 14.6
confident 14.6
clothes 14.1
sexy 13.7
happiness 13.3
expression 12.8
boss 12.4
studio 12.2
cloak 12.1
manager 12.1
friendly 11.9
dress 11.7
uniform 11.6
hand 11.4
military uniform 11.3
human 11.3
style 11.1
cute 10.8
camera 10.2
elegance 10.1
posing 9.8
corporation 9.6
confidence 9.6
guy 9.5
color 9.5
single 9
worker 8.9
brunette 8.7
only 8.6
consumer goods 8.6
old 8.4
dark 8.4
20s 8.2
pose 8.2
stylish 8.1
working 8
boy 7.9
vertical 7.9
adolescent 7.8
men 7.7
modern 7.7
businesspeople 7.6
fashionable 7.6
hat 7.4
vintage 7.4
holding 7.4
statue 7.3
bright 7.2
indoors 7

Google
created on 2019-02-26

Photograph 95.8
Gentleman 86.3
Picture frame 69.2
Portrait 51.6
Art 50.2

Microsoft
created on 2019-02-26

wall 99.4
man 95.1
old 93.5
suit 82.6
posing 81
white 65.3
older 23.6
picture frame 7.2
museum 7.2
art 0.9
portrait 0.6
person 0.6

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Male, 96.1%
Disgusted 1.8%
Calm 64.4%
Sad 5.7%
Angry 7.6%
Confused 12.7%
Happy 4.4%
Surprised 3.4%

Microsoft Cognitive Services

Age 44
Gender Male

Feature analysis

Amazon

Person 95%
Tie 58.7%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 72.4%
a vintage photo of a man in a suit and tie 72.3%
a man that is standing in front of a mirror posing for the camera 62.4%

Text analysis

Amazon

mh
vzman,
mh vzman, Neeroe
Neeroe
1

Google

.
u々mare.
u々mare