Human Generated Data

Title

Thomas Huckle Weller

Date

1981

People

Artist: George Augusta, American born 1922

Sitter: Thomas Huckle Weller,

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Gift of the committee to honor Dr. Weller upon his retirement, to the Harvard Medical School, 1981, HNA59

Human Generated Data

Title

Thomas Huckle Weller

People

Artist: George Augusta, American born 1922

Sitter: Thomas Huckle Weller,

Date

1981

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-19

Accessories 98.7
Tie 98.7
Accessory 98.7
Human 95.3
Person 95.3
Apparel 95
Clothing 95
Shirt 76.3
Necktie 75.6
Art 73.8
Painting 59.7
Linen 57.4
Home Decor 57.4

Clarifai
created on 2019-04-19

people 99.5
adult 99.5
one 99.5
wear 99
man 98.7
portrait 98.4
facial expression 95.3
recreation 93.3
leader 92.7
business 92.3
room 92.1
indoors 90.8
administration 90.6
furniture 90.2
two 89.5
outerwear 89.2
tie 88.1
actor 87.8
seat 87.6
menswear 84.4

Imagga
created on 2019-04-19

suit 100
businessman 78.7
garment 78.6
clothing 56.6
man 55.9
executive 55.7
male 54
business 52.3
handsome 49.1
person 42.3
necktie 42.1
tie 40.9
corporate 40.4
professional 36.7
confident 36.5
portrait 36.3
adult 35.7
men 33.5
consumer goods 31.8
covering 31.5
successful 29.3
people 29.1
success 27.4
office 26.5
manager 25.2
standing 22.6
mature 22.4
work 22
looking 21.6
expression 21.4
boss 21.1
face 20.6
worker 19.9
smiling 19.6
job 19.5
occupation 19.3
modern 19
shirt 18.7
happy 18.2
businesspeople 18.1
one 17.9
senior 17.8
formal 17.2
smile 17.1
hand 16.7
friendly 16.5
working 15
company 14.9
studio 14.5
black 13.8
cheerful 13.8
jacket 13.4
happiness 13.3
glasses 13
businessperson 12.7
old 12.6
leadership 12.5
confidence 12.5
guy 12.5
serious 12.4
smart 12.3
model 11.7
leader 11.6
only 11.5
one person 11.3
attractive 11.2
elegant 11.2
alone 11
entrepreneur 10.7
40s 10.7
corporation 10.6
human 10.5
career 10.4
older 9.7
computer 9.6
collar 9.6
elderly 9.6
lifestyle 9.4
stylish 9.1
color 8.9
gray hair 8.9
lawyer 8.5
laptop 8.2
employee 8.2
commodity 7.9
determined 7.9
motivation 7.8
hands 7.8
businessmen 7.8
sitting 7.7
gesture 7.6
director 7.6
fashionable 7.6
head 7.6
fashion 7.5
holding 7.4
positive 7.4
team 7.2
posing 7.1
indoors 7
look 7

Google
created on 2019-04-19

Suit 92.6
Gentleman 90
Male 83.2
Portrait 81.9
Formal wear 78
Painting 61.3
Tuxedo 59.7
White-collar worker 56
Art 50.2

Microsoft
created on 2019-04-19

person 99.9
man 97.3
wedding 35.7
tie 19.8
suit 11.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-90
Gender Male, 95.5%
Surprised 0.6%
Disgusted 0.9%
Sad 3.2%
Angry 1.4%
Happy 1.4%
Calm 87.6%
Confused 4.8%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.7%
Person 95.3%

Captions

Microsoft

a man wearing a suit and tie 93.2%
a man wearing a neck tie 85.5%
a man in a suit and tie 85.4%