Human Generated Data

Title

Thomas Coffin Amory I (1767-1812)
Date

c. 1810
People

Artist: Gilbert Stuart, American 1755 - 1828
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica, 2021.78

Human Generated Data

Title

Thomas Coffin Amory I (1767-1812)

People

Artist: Gilbert Stuart, American 1755 - 1828

Date

c. 1810

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2021-08-28

Painting 99
Art 99
Person 97
Human 97

Imagga
created on 2021-08-28

bow tie 73.3
suit 70
necktie 68.3
garment 56.8
man 55.8
male 46.2
businessman 45.9
business 42.6
clothing 37.4
person 33.3
executive 33.2
office 32.2
waiter 31.8
professional 30.6
employee 29
people 27.9
handsome 27.7
adult 27.2
corporate 26.7
tie 26.6
portrait 25.9
dining-room attendant 25.5
success 25
work 23.6
happy 22.6
worker 22.1
boss 21.1
smile 20.7
successful 20.1
confident 20
manager 19.6
smiling 18.8
men 18
expression 17.1
job 16.8
face 16.4
guy 15.1
shirt 15
mature 14.9
black 14.6
looking 14.4
standing 13.9
consumer goods 12.6
covering 12.5
desk 12.3
businesswoman 11.8
lifestyle 11.6
hand 11.4
jacket 11.1
working 10.6
leader 10.6
one 10.5
businesspeople 10.4
senior 10.3
hair 10.3
money 10.2
glasses 10.2
occupation 10.1
lawyer 9.9
attractive 9.8
old 9.8
human 9.8
leadership 9.6
hands 9.6
career 9.5
one person 9.4
happiness 9.4
modern 9.1
computer 8.8
businessmen 8.8
eyes 8.6
workplace 8.6
gesture 8.6
finance 8.5
head 8.4
pretty 8.4
company 8.4
finger 8.3
baron 8.3
friendly 8.2
laptop 8.2
cheerful 8.1
older 7.8
sitting 7.7
elderly 7.7
formal 7.6
casual 7.6
serious 7.6
fashion 7.5
meeting 7.5
secretary 7.5
holding 7.4
alone 7.3
team 7.2
love 7.1

Google
created on 2021-08-28

Cheek 97.9
Chin 96.7
Eyebrow 93.9
Dress shirt 87.4
Sleeve 86.8
Coat 85.8
Flash photography 85.3
Gesture 85.3
Collar 84.1
Art 83.1
Suit 78.7
Blazer 78.3
Formal wear 76.9
Bow tie 75
Painting 74.7
Vintage clothing 69.9
White-collar worker 66.7
Self-portrait 65
Tie 64.8
Facial hair 63.9

Microsoft
created on 2021-08-28

person 99.8
man 99.2
painting 98.3
wall 97.8
human face 94.5
art 88.2
portrait 87
clothing 77.3
text 73.9
drawing 64.2
necktie 49.1
dark 37.7
male 17.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 98.8%
Calm 92.3%
Sad 5.6%
Confused 0.6%
Disgusted 0.4%
Angry 0.4%
Surprised 0.3%
Happy 0.3%
Fear 0.1%

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99%
Person 97%

Captions

Microsoft

a man wearing a suit and tie 94.6%
a person posing for the camera 93.7%
a man in a suit and tie 93.6%