Human Generated Data

Title

James Savage (1784-1873)
Date

1886
People

Artist: David Dalhoff Neal, American 1838 - 1915

Sitter: James Savage Jr., 1832 - 1862
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Bequest of Mrs. William B. Rogers (Emma Savage) to Harvard College, 1911, H204

Human Generated Data

Title

James Savage (1784-1873)

People

Artist: David Dalhoff Neal, American 1838 - 1915

Sitter: James Savage Jr., 1832 - 1862

Date

1886

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Accessory 98.1
Accessories 98.1
Tie 98.1
Human 96.6
Person 96.6
Art 93.9
Apparel 75.4
Clothing 75.4
Painting 72.8
Coat 64.3
Text 59.7
Photo 55.2
Face 55.2
Photography 55.2
Portrait 55.2

Clarifai
created on 2020-04-23

people 99.6
portrait 99.4
one 99
man 98.4
adult 97.9
wear 96.4
outfit 91.3
music 90.5
menswear 88.4
facial expression 86.3
outerwear 85.9
dinner jacket 84.4
musician 83.4
writer 83
mustache 82.2
book series 81.7
neckwear 81.6
jacket 80.9
art 80.3
elderly 79.9

Imagga
created on 2020-04-23

executive 66.7
businessman 64.6
suit 56.6
man 56.6
business 53.5
male 51.2
person 47.8
corporate 41.3
professional 39.5
office 38.6
handsome 33
confident 32.8
adult 31.6
people 31.3
businesspeople 29.5
men 28.4
tie 27.6
manager 27
success 26.6
portrait 25.9
successful 25.7
work 25.2
baron 22.7
happy 22
smile 20.7
worker 20.1
businesswoman 20
smiling 19.6
company 19.6
job 19.5
expression 18.8
corporation 18.4
scholar 17.4
mature 16.8
hand 16.7
employee 16.7
businessmen 16.6
team 16.2
meeting 16
looking 16
working 15.9
alone 15.6
modern 15.4
necktie 15.4
formal 15.3
desk 15.1
guy 14.9
intellectual 14.9
standing 14.8
judge 14.7
lifestyle 14.5
clothing 14.1
secretary 13.9
waiter 13.8
sitting 13.8
entrepreneur 13.7
boss 13.4
garment 13
face 12.8
colleagues 12.7
communication 12.6
confidence 12.5
hands 12.2
group 12.1
computer 12
laptop 11.9
partner 11.6
black 11.5
career 11.4
one person 11.3
senior 11.3
teamwork 11.1
dining-room attendant 11.1
friendly 11
jacket 11
bow tie 10.9
businessperson 10.7
40s 10.7
mid adult 10.6
leadership 10.6
elderly 10.6
color 10
holding 9.9
cheerful 9.8
old 9.8
partners 9.7
one 9.7
busy 9.7
workplace 9.5
building 9.5
outside 9.4
shirt 9.4
together 8.8
agreement 8.8
couple 8.7
partnership 8.7
happiness 8.6
money 8.5
casual 8.5
attractive 8.4
positive 8.3
human 8.3
indoor 8.2
outdoors 8.2
lawyer 8
day 7.9
planner 7.9
table 7.8
conversation 7.8
1 7.7
elegant 7.7
serious 7.6
smart 7.5
teacher 7.5
glasses 7.4
occupation 7.3

Google
created on 2020-04-23

Portrait 93.6
Self-portrait 76.6
Painting 75
Suit 62.3
Art 50.2

Microsoft
created on 2020-04-23

person 99.9
man 96.9
sitting 96.6
clothing 95
text 93.8
suit 92.5
human face 89.1
tie 73.7
portrait 72.5
necktie 29.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-68
Gender Female, 62.5%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%
Surprised 0%
Angry 0.2%
Sad 2.3%
Calm 97.1%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.1%
Person 96.6%
Painting 72.8%

Captions

Microsoft

James Savage sitting on a bench 81.2%
James Savage wearing a suit and tie sitting on a bench 81.1%
James Savage in a suit and tie sitting on a bench 81%