Human Generated Data

Title

Samuel Towers
Date

1916
People

Artist: John H. Garo, American 1868 - 1939
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.825

Human Generated Data

Title

Samuel Towers

People

Artist: John H. Garo, American 1868 - 1939

Date

1916

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.7
Face 99.7
Person 96.7
Head 89.5
Portrait 83.6
Photo 83.6
Photography 83.6
Coat 78.5
Overcoat 78.5
Apparel 78.5
Clothing 78.5
Suit 78.5
Art 76.2
Text 69.3
Man 60.2
Painting 56.7
Drawing 56.1
Jaw 55.8
Military Uniform 55.6
Officer 55.6
Military 55.6

Imagga
created on 2022-01-08

necktie 100
bow tie 100
man 62.6
garment 52.1
male 51.9
suit 49.5
businessman 42.5
portrait 40.2
handsome 36.6
business 36.5
person 36.4
adult 36.3
clothing 33.4
tie 32.3
face 29.9
executive 27.8
expression 26.5
people 26.3
manager 26.1
corporate 25.8
professional 24.9
looking 24.8
men 23.2
confident 22.8
guy 22.4
office 21.7
one 21.7
success 21
black 20.7
mature 20.5
smiling 20.3
beard 19.8
head 19.4
happy 18.8
boss 18.2
shirt 17.8
smile 17.1
studio 16.7
serious 15.3
hair 15.1
human 15
work 14.9
glasses 14.8
standing 14.8
successful 14.7
eyes 14.7
jacket 14.5
attractive 13.3
old 13.3
senior 13.1
hand 12.9
casual 12.7
close 12
look 11.4
worker 10.6
confidence 10.5
occupation 10.1
modern 9.8
cheerful 9.8
collar 9.6
pensive 8.8
angry 8.8
sad 8.7
grandfather 8.5
dark 8.4
emotion 8.3
fashion 8.3
alone 8.2
job 8
hands 7.8
masculine 7.8
model 7.8
older 7.8
formal 7.7
thinking 7.6
one person 7.5
baron 7.3
friendly 7.3
working 7.1
happiness 7.1
employee 7

Google
created on 2022-01-08

Forehead 98.5
Black 89.6
Collar 83.2
Tints and shades 74.7
Rectangle 73.1
Vintage clothing 68.4
Tie 68.3
Moustache 68.1
Facial hair 67.1
Stock photography 66.9
Blazer 65.8
Self-portrait 65.2
Suit 65.2
History 65
No expression 63.6
Formal wear 58.2
Wrinkle 56.3
Portrait 56.2
Portrait photography 54.2
Visual arts 50.7

Microsoft
created on 2022-01-08

text 99.3
man 99.3
human face 97.8
suit 96.2
person 95.5
portrait 91.2
clothing 85.3
wearing 77.3
necktie 63.7
old 53.1
staring 24

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 62-72
Gender Male, 100%
Confused 63.8%
Calm 30.4%
Sad 2.1%
Surprised 1.2%
Angry 1%
Fear 0.7%
Disgusted 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%
Suit 78.5%

Captions

Microsoft

W. E. B. Du Bois wearing a suit and tie 97.7%
W. E. B. Du Bois wearing a suit and tie looking at the camera 96.1%
W. E. B. Du Bois wearing a suit and tie who is looking at the camera 95.3%