Human Generated Data

Title

George Ellis

Date

1923

People

Artist: John H. Garo, American 1868 - 1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.822

Human Generated Data

Title

George Ellis

People

Artist: John H. Garo, American 1868 - 1939

Date

1923

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Face 99.5
Human 99.5
Person 98.8
Coat 96.8
Suit 96.8
Overcoat 96.8
Clothing 96.8
Apparel 96.8
Glasses 96.7
Accessories 96.7
Accessory 96.7
Head 93.2
Portrait 80.1
Photography 80.1
Photo 80.1
Tie 74.6
Text 67.1
Art 64.7
Mustache 64.1
Man 62.8
Officer 61.2
Military 61.2
Military Uniform 61.2
Beard 56

Imagga
created on 2022-01-08

suit 92.7
businessman 69.1
necktie 60.9
man 60
garment 58.9
bow tie 53.5
executive 53.2
male 52.6
business 49.9
person 43.6
handsome 42
corporate 41.4
tie 40.9
portrait 40.2
clothing 38.9
professional 33.9
confident 32.8
adult 31.8
men 30.1
success 29.9
manager 28.9
boss 28.8
people 27.4
office 27.4
successful 25.7
looking 25.7
face 24.9
expression 24
baron 23.5
mature 22.4
one 19.5
work 18.9
smile 18.6
happy 18.2
black 18.2
smiling 18.1
job 17.7
guy 16.9
consumer goods 16.6
standing 16.6
covering 16.5
businesspeople 16.2
old 16.1
studio 16
head 16
worker 15.6
modern 15.5
shirt 15
jacket 14.5
senior 14.1
occupation 13.8
confidence 13.4
employee 13.1
human 12.8
lawyer 12.2
glasses 12.1
formal 11.5
career 11.4
lifestyle 10.9
businessperson 10.8
hand 10.7
serious 10.5
smart 10.4
company 10.3
businessmen 9.8
corporation 9.7
collar 9.6
hair 9.5
elegant 9.4
casual 9.3
businesswoman 9.1
look 8.8
older 8.8
leadership 8.7
elderly 8.6
eyes 8.6
thinking 8.6
friendly 8.3
alone 8.2
cheerful 8.1
gray 8.1
team 8.1
judge 8
pensive 7.8
40s 7.8
model 7.8
leader 7.7
outside 7.7
money 7.7
entrepreneur 7.6
out 7.6
meeting 7.6
teamwork 7.4
color 7.3
beard 7.2
working 7.1
happiness 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

man 99.9
person 99.5
suit 99
text 97.9
wall 95
human face 93.2
tie 78.7
portrait 77.3
posing 75.4
clothing 62.3
old 51.6
dark 40
necktie 16.7
staring 16.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 59-69
Gender Male, 100%
Sad 99.5%
Calm 0.3%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%
Happy 0%
Surprised 0%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Suit 96.8%
Glasses 96.7%
Tie 74.6%

Captions

Microsoft

a man wearing a suit and tie 99.2%
a man wearing a suit and tie looking at the camera 98.7%
a man wearing a suit and tie smiling and looking at the camera 98.2%

Text analysis

Amazon

1923
Garos 1923
Garos