Human Generated Data

Title

William Amory (1804-1888)
Date

1881
People

Artist: Daniel Huntington, American 1816 - 1906
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica, M.D., 2004.221

Human Generated Data

Title

William Amory (1804-1888)

People

Artist: Daniel Huntington, American 1816 - 1906

Date

1881

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 98.3
Person 98.3
Painting 97.8
Art 97.8
Accessory 75.1
Accessories 75.1
Tie 75.1
Clothing 61.8
Apparel 61.8

Clarifai
created on 2018-03-23

people 99.9
one 99.8
portrait 99.8
adult 98.5
man 97.7
wear 97.2
leader 96.5
administration 94.1
neckwear 91.9
painting 91.6
menswear 90.4
outerwear 89.9
outfit 88.9
cravat 87.5
art 86.8
politician 86.2
jacket 83.7
facial hair 83.5
royalty 80.9
indoors 79.8

Imagga
created on 2018-03-23

man 58.5
male 51.1
businessman 48.6
person 45.2
executive 44.9
suit 41.4
business 35.9
handsome 34.8
adult 34.6
portrait 34.3
bow tie 30.3
necktie 29.6
people 29.6
senior 29.1
professional 28.3
tie 23.7
men 22.3
elderly 22
black 21.4
office 20.9
corporate 20.6
face 20.6
smiling 20.3
old 20.2
smile 20
manager 19.6
mature 19.5
happy 18.8
hand 18.2
confident 18.2
success 17.7
glasses 17.6
work 17.3
looking 16.8
garment 16.5
clothing 16.3
lifestyle 15.9
human 15.8
older 15.6
judge 15.4
expression 15.4
successful 14.7
guy 14.5
worker 14.3
businesspeople 14.2
job 14.2
working 14.2
standing 13.9
jacket 13.4
grandfather 13.2
speaker 12.9
boss 12.4
formal 12.4
serious 12.4
casual 11.9
look 11.4
shirt 11.3
computer 11.2
one 11.2
sitting 11.2
employee 11.1
friendly 11
retired 10.7
retirement 10.6
articulator 10.5
baron 10.4
hair 10.3
modern 9.8
fashion 9.8
cheerful 9.8
businessperson 9.8
leadership 9.6
couple 9.6
confidence 9.6
hands 9.6
career 9.5
model 9.3
occupation 9.2
laptop 9.1
60s 8.8
indoors 8.8
love 8.7
elegant 8.6
communicator 8.5
one person 8.5
attractive 8.4
holding 8.3
home 8
happiness 7.8
head 7.6
power 7.6
waiter 7.5
planner 7.4
stylish 7.2
color 7.2
gray 7.2

Google
created on 2018-03-23

portrait 93.8
gentleman 86.8
painting 83.5
elder 70.9
art 67
diplomat 64.4
self portrait 57.9

Microsoft
created on 2018-03-23

person 99.6
man 97.7
necktie 56

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 94%
Confused 0.6%
Disgusted 0.3%
Calm 95.7%
Happy 0.3%
Surprised 0.3%
Sad 1.9%
Angry 0.8%

Microsoft Cognitive Services

Age 62
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Tie 75.1%

Captions

Microsoft

a man wearing a suit and tie 97.9%
a man in a suit and tie 97.8%
a man wearing a suit 96.4%