Human Generated Data

Title

H. Remsen Whitehouse (secretary)

Date

1889-1890

People

Artist: Mathew B. Brady, American 1823 - 1896

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.37

Human Generated Data

Title

H. Remsen Whitehouse (secretary)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.37

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 97.9
Apparel 97.9
Person 96.1
Human 96.1
Art 94.3
Coat 91.4
Overcoat 91.2
Painting 82.1
Suit 72.5
Art Gallery 58.3

Clarifai
created on 2019-03-01

people 99.8
one 99.1
adult 98.1
portrait 97.3
man 97.1
leader 95.3
administration 95.2
wear 93.3
print 92.8
art 90.4
painting 89.2
retro 87.6
music 78.2
outfit 78
politician 77.1
scientist 76.3
writer 74.7
vintage 73.2
side view 70
illustration 69.3

Imagga
created on 2019-03-01

suit 69.4
garment 52.4
bow tie 51.9
clothing 50.4
necktie 47.5
man 39
person 38.6
businessman 35.3
portrait 33.6
business 32.8
male 31.2
adult 31.1
people 27.9
handsome 25
covering 22.6
consumer goods 22.2
face 22
executive 21.7
jacket 21.3
one 20.9
tie 20.9
military uniform 20.7
success 20.1
professional 19.6
model 18.7
smile 18.5
looking 18.4
alone 18.3
office 17.7
standing 17.4
confident 17.3
uniform 16.8
lifestyle 16.6
fashion 16.6
work 16.5
shirt 15.9
adolescent 15.6
successful 15.6
corporate 15.5
casual 15.3
happy 15
human 15
men 14.6
modern 14
smiling 13.7
studio 13.7
hand 12.9
black 12.8
expression 12.8
attractive 12.6
juvenile 12.5
elegant 12
boss 11.5
only 11.5
manager 11.2
old 11.1
hair 11.1
guy 11
happiness 11
worker 10.9
job 10.6
color 10
style 9.6
confidence 9.6
coat 9.5
businesspeople 9.5
camera 9.2
friendly 9.1
businesswoman 9.1
holding 9.1
cheerful 8.9
1 8.7
20s 8.2
single 8.2
lady 8.1
posing 8
working 8
building 7.9
brunette 7.8
youth 7.7
dark 7.5
clothes 7.5
mature 7.4
statue 7.3
sexy 7.2
gray 7.2
fresh 7.2
bright 7.1
indoors 7

Google
created on 2019-03-01

Microsoft
created on 2019-03-01

old 91.5
suit 82.6
posing 61.9
picture frame 37.2
vintage 25.8
museum 25.8
person 6.4
art 6.2
domain 5.8
victorian 4.9
photograph 3.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 99.3%
Sad 3.1%
Disgusted 0.5%
Angry 3.8%
Happy 1.5%
Confused 17.1%
Surprised 9.4%
Calm 64.5%

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Suit 72.5%

Text analysis

Amazon

e
e thhihehnse.
thhihehnse.
meerican
meerican beoretany
beoretany