Human Generated Data

Title

George Ellis
Date

1923
People

Artist: John H. Garo, American 1868 - 1939
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.822

Human Generated Data

Title

George Ellis

People

Artist: John H. Garo, American 1868 - 1939

Date

1923

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Face 99.5
Human 99.5
Person 98.8
Suit 96.8
Overcoat 96.8
Coat 96.8
Clothing 96.8
Apparel 96.8
Glasses 96.7
Accessories 96.7
Accessory 96.7
Head 93.2
Photography 80.1
Portrait 80.1
Photo 80.1
Tie 74.6
Text 67.1
Art 64.7
Mustache 64.1
Man 62.8
Military 61.2
Officer 61.2
Military Uniform 61.2
Beard 56

Imagga
created on 2022-01-08

suit 92.7
businessman 69.1
necktie 60.9
man 60
garment 58.9
bow tie 53.5
executive 53.2
male 52.6
business 49.9
person 43.6
handsome 42
corporate 41.4
tie 40.9
portrait 40.2
clothing 38.9
professional 33.9
confident 32.8
adult 31.8
men 30.1
success 29.9
manager 28.9
boss 28.8
people 27.4
office 27.4
successful 25.7
looking 25.7
face 24.9
expression 24
baron 23.5
mature 22.4
one 19.5
work 18.9
smile 18.6
happy 18.2
black 18.2
smiling 18.1
job 17.7
guy 16.9
consumer goods 16.6
standing 16.6
covering 16.5
businesspeople 16.2
old 16.1
studio 16
head 16
worker 15.6
modern 15.5
shirt 15
jacket 14.5
senior 14.1
occupation 13.8
confidence 13.4
employee 13.1
human 12.8
lawyer 12.2
glasses 12.1
formal 11.5
career 11.4
lifestyle 10.9
businessperson 10.8
hand 10.7
serious 10.5
smart 10.4
company 10.3
businessmen 9.8
corporation 9.7
collar 9.6
hair 9.5
elegant 9.4
casual 9.3
businesswoman 9.1
look 8.8
older 8.8
leadership 8.7
elderly 8.6
eyes 8.6
thinking 8.6
friendly 8.3
alone 8.2
cheerful 8.1
gray 8.1
team 8.1
judge 8
pensive 7.8
40s 7.8
model 7.8
leader 7.7
outside 7.7
money 7.7
entrepreneur 7.6
out 7.6
meeting 7.6
teamwork 7.4
color 7.3
beard 7.2
working 7.1
happiness 7.1

Google
created on 2022-01-08

Tie 89.2
Coat 88.3
Jaw 87.7
Collar 83.5
Suit 81.7
Comb over 80.2
Blazer 78.3
Tints and shades 73.3
Dress shirt 73
Formal wear 69.2
Vintage clothing 68.6
Wrinkle 68.4
History 65.8
No expression 65
Stock photography 62.6
Picture frame 61.9
White-collar worker 59.5
Official 58.1
Portrait 56.4
Moustache 53

Microsoft
created on 2022-01-08

man 99.9
person 99.5
suit 99
text 97.9
wall 95
human face 93.2
tie 78.7
portrait 77.3
posing 75.4
clothing 62.3
old 51.6
dark 40
necktie 16.7
staring 16.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 59-69
Gender Male, 100%
Sad 99.5%
Calm 0.3%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%
Happy 0%
Surprised 0%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Suit 96.8%
Glasses 96.7%
Tie 74.6%

Captions

Microsoft

a man wearing a suit and tie 99.2%
a man wearing a suit and tie looking at the camera 98.7%
a man wearing a suit and tie smiling and looking at the camera 98.2%

Text analysis

Amazon

1923
Garos 1923
Garos