Human Generated Data

Title

Eugene Foss
Date

1916
People

Artist: John H. Garo, American 1868 - 1939
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Transferred from the Fogg Art Museum, 2.2002.586

Human Generated Data

Title

Eugene Foss

People

Artist: John H. Garo, American 1868 - 1939

Date

1916

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Tie 99.3
Accessories 99.3
Accessory 99.3
Apparel 99
Overcoat 99
Suit 99
Clothing 99
Coat 99
Human 98.1
Person 98.1
Art 93.8
Painting 93.1
Text 74.7
Face 73.1
Portrait 68.7
Photography 68.7
Photo 68.7

Imagga
created on 2021-12-14

bow tie 93.4
necktie 90.6
suit 88.1
garment 69.3
businessman 65.5
man 60
male 54.1
business 47.5
handsome 45.6
person 44.8
clothing 44.7
executive 43
tie 41.9
corporate 37
portrait 37
professional 34.7
adult 32.4
confident 31.9
success 30.7
successful 28.4
men 28.4
people 26.3
manager 26.1
face 24.9
expression 24.8
looking 24.1
guy 23.6
office 22.6
boss 22.1
one 21.7
shirt 19.7
smile 19.3
standing 19.2
work 18.9
black 18.9
modern 18.3
happy 18.2
mature 17.7
studio 16
smiling 16
old 15.4
consumer goods 14.7
covering 14.5
worker 14.2
model 14
glasses 13.9
lifestyle 13.8
jacket 13.7
human 13.5
confidence 13.4
serious 13.4
job 13.3
occupation 12.9
fashion 12.8
head 12.6
senior 12.2
hand 12.2
lawyer 12.1
company 12.1
thinking 11.4
smart 11.3
attractive 11.2
formal 10.5
look 9.7
businesspeople 9.5
elegant 9.5
outside 9.4
casual 9.3
friendly 9.2
gray 9
posing 8.9
businessperson 8.8
hair 8.7
close 8.6
career 8.5
alone 8.2
employee 8
happiness 7.9
eyes 7.8
collar 7.7
money 7.7
stylish 7.3
color 7.2

Google
created on 2021-12-14

Forehead 98.5
Coat 90.5
Tie 88.6
Jaw 87.8
Collar 83.7
Suit 82.4
Blazer 78.2
Formal wear 74.6
Tints and shades 72.7
Rectangle 72.2
Beard 72
Art 70.8
Facial hair 70.8
Vintage clothing 67.9
Moustache 64.5
Self-portrait 63.7
History 63.2
Stock photography 62.6
Dress shirt 59.4
Portrait 58.1

Microsoft
created on 2021-12-14

man 99.5
person 98.3
text 97.6
human face 96.2
suit 93.6
clothing 90.5
old 85.1
portrait 81.5
tie 70.6
black and white 62.1
gentleman 53.3
posing 38.3
necktie 19.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 98.7%
Angry 50.4%
Calm 36.4%
Sad 10.6%
Confused 1%
Disgusted 0.8%
Fear 0.5%
Surprised 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.3%
Suit 99%
Person 98.1%

Captions

Microsoft

a man wearing a suit and tie 98.9%
an old photo of a man wearing a suit and tie 98.2%
an old photo of a man in a suit and tie 98.1%