Human Generated Data

Title

J.G. do Amaral Valente (Brazilian delegate)
Date

1889-1890
People

Artist: Mathew B. Brady, American 1823 - 1896
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.14

Human Generated Data

Title

J.G. do Amaral Valente (Brazilian delegate)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 95.7
Human 95.7
Advertisement 88.8
Apparel 87.2
Clothing 87.2
Art 86.4
Text 66.3
Overcoat 63.9
Coat 63.9
Tie 62
Accessories 62
Accessory 62
Portrait 60.6
Photography 60.6
Photo 60.6
Face 60.6
Billboard 57.8
Suit 56.1
Poster 55.9
Painting 55.2

Clarifai
created on 2019-02-19

people 99.8
one 98.2
man 96.8
portrait 96.7
adult 96.5
leader 90.8
wear 90.5
administration 88.6
art 83.7
print 80
retro 77
scientist 74.8
military 74.8
music 74.7
writer 70.1
outfit 68.2
vintage 63.5
facial hair 62.9
chair 62.9
politician 61.7

Imagga
created on 2019-02-19

suit 72
man 49.1
garment 44.3
businessman 42.4
bow tie 41.2
person 39.2
necktie 37.8
business 37.7
male 37
portrait 35.6
clothing 34.8
adult 34.3
handsome 31.2
executive 25.4
people 24.6
one 23.9
face 23.4
professional 22.9
jacket 22.2
office 20.1
tie 19.9
success 19.3
successful 19.2
looking 19.2
alone 19.2
confident 19.1
corporate 18.9
expression 18.8
covering 17.5
standing 17.4
smile 17.1
black 17
casual 16.9
adolescent 16.9
lifestyle 16.6
men 16.3
shirt 15.9
guy 15.6
businesspeople 15.2
consumer goods 14.8
work 14.1
attractive 14
manager 14
juvenile 13.8
job 13.3
studio 12.9
modern 12.6
happy 12.5
only 12.4
smiling 12.3
mature 12.1
fashion 12.1
human 12
old 11.8
model 11.7
1 11.6
boss 11.5
hand 11.4
elegant 11.1
formal 10.5
single 9.9
indoors 9.7
brunette 9.6
confidence 9.6
hair 9.5
room 9.3
businessperson 8.8
serious 8.6
glasses 8.3
camera 8.3
20s 8.2
friendly 8.2
indoor 8.2
worker 8.2
businesswoman 8.2
happiness 7.8
color 7.8
corporation 7.7
money 7.7
senior 7.5
company 7.4
holding 7.4
style 7.4
employee 7

Google
created on 2019-02-19

Photograph 96.7
Gentleman 90.8
Snapshot 82.5
Male 81.8
Picture frame 69.4
Facial hair 68.1
Portrait 65.1
Vintage clothing 64.7
Moustache 58.8

Microsoft
created on 2019-02-19

wall 99.7
man 99.2
person 96.5
suit 96.3
old 94.7
posing 94.1
black 73.4
vintage 38.1
picture frame 12.3
museum 12.3
photograph 3.2
domain 2.9
portrait 2.7
victorian 2.1
art 1.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.5%
Sad 7.6%
Calm 80.4%
Surprised 0.7%
Disgusted 0.2%
Happy 0.3%
Angry 4.6%
Confused 6.3%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.7%
Tie 62%
Suit 56.1%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 75.4%
a vintage photo of a man wearing a suit and tie 75.3%
a vintage photo of a man in a suit and tie 75.2%

Text analysis

Amazon

Braril.
Me. Valeete. Braril.
Valeete.
Me.