Human Generated Data

Title

Thomas Coffin Amory I (1767-1812)

Date

c. 1810

People

Artist: Gilbert Stuart, American 1755 - 1828

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica, 2021.78

Human Generated Data

Title

Thomas Coffin Amory I (1767-1812)

People

Artist: Gilbert Stuart, American 1755 - 1828

Date

c. 1810

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica, 2021.78

Machine Generated Data

Tags

Amazon
created on 2021-08-28

Painting 99
Art 99
Person 97
Human 97

Clarifai
created on 2023-10-13

portrait 99.5
people 99.5
one 98.8
wear 98.3
man 98.1
adult 97.4
facial expression 97.3
menswear 94.8
neckwear 91.2
music 90.8
jacket 89.4
tie 89
outfit 87.5
retro 83.6
dinner jacket 81.6
fashion 80.7
outerwear 78.6
vest 78.4
boy 78.1
musician 77

Imagga
created on 2021-08-28

bow tie 73.3
suit 70
necktie 68.3
garment 56.8
man 55.8
male 46.2
businessman 45.9
business 42.6
clothing 37.4
person 33.3
executive 33.2
office 32.2
waiter 31.8
professional 30.6
employee 29
people 27.9
handsome 27.7
adult 27.2
corporate 26.7
tie 26.6
portrait 25.9
dining-room attendant 25.5
success 25
work 23.6
happy 22.6
worker 22.1
boss 21.1
smile 20.7
successful 20.1
confident 20
manager 19.6
smiling 18.8
men 18
expression 17.1
job 16.8
face 16.4
guy 15.1
shirt 15
mature 14.9
black 14.6
looking 14.4
standing 13.9
consumer goods 12.6
covering 12.5
desk 12.3
businesswoman 11.8
lifestyle 11.6
hand 11.4
jacket 11.1
working 10.6
leader 10.6
one 10.5
businesspeople 10.4
senior 10.3
hair 10.3
money 10.2
glasses 10.2
occupation 10.1
lawyer 9.9
attractive 9.8
old 9.8
human 9.8
leadership 9.6
hands 9.6
career 9.5
one person 9.4
happiness 9.4
modern 9.1
computer 8.8
businessmen 8.8
eyes 8.6
workplace 8.6
gesture 8.6
finance 8.5
head 8.4
pretty 8.4
company 8.4
finger 8.3
baron 8.3
friendly 8.2
laptop 8.2
cheerful 8.1
older 7.8
sitting 7.7
elderly 7.7
formal 7.6
casual 7.6
serious 7.6
fashion 7.5
meeting 7.5
secretary 7.5
holding 7.4
alone 7.3
team 7.2
love 7.1

Google
created on 2021-08-28

Cheek 97.9
Chin 96.7
Eyebrow 93.9
Dress shirt 87.4
Sleeve 86.8
Coat 85.8
Flash photography 85.3
Gesture 85.3
Collar 84.1
Art 83.1
Suit 78.7
Blazer 78.3
Formal wear 76.9
Bow tie 75
Painting 74.7
Vintage clothing 69.9
White-collar worker 66.7
Self-portrait 65
Tie 64.8
Facial hair 63.9

Microsoft
created on 2021-08-28

person 99.8
man 99.2
painting 98.3
wall 97.8
human face 94.5
art 88.2
portrait 87
clothing 77.3
text 73.9
drawing 64.2
necktie 49.1
dark 37.7
male 17.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 98.8%
Calm 92.3%
Sad 5.6%
Confused 0.6%
Disgusted 0.4%
Angry 0.4%
Surprised 0.3%
Happy 0.3%
Fear 0.1%

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99%
Person 97%

Categories

Imagga

events parties 93.9%
people portraits 6.1%

Captions

Azure OpenAI

Created by gpt-4 on 2024-11-16

This is an image of a painting depicting a person from approximately the waist up. The individual is dressed in formal attire from a past era, with a black coat and a white, ruffled shirt that has intricate details, suggesting a style typical of the late 18th or early 19th century. The person's right hand is lifted towards the chest, with the fingers gently curled as if adjusting or holding something near the shirt area. The clothing is represented with careful attention to the folds and textures, indicating that the artist was skilled in capturing the depth and realism of fabrics. The background is a nondescript, dark, and muted tone, which places the focus on the figure and attire. The overall mood of the painting is somber and reflective, with an emphasis on the elegance of the attire.

Anthropic Claude

Created on 2024-11-13

The image appears to be a portrait painting of a man wearing a formal black suit and a white ruffled collar. The man has a serious expression on his face, with dark eyes and a slightly furrowed brow. His hair is dark and slightly tousled. The background is a dark, uniform color that helps to focus the viewer's attention on the subject's face and upper body. Overall, the painting conveys a sense of gravity and formality, characteristic of many traditional portrait paintings.

Meta Llama

Created on 2024-11-22

The image depicts a portrait of a man, likely painted in the 19th century. The subject is dressed in formal attire, consisting of a black coat and white shirt with a high collar. He has short, curly hair that is light brown in color. His gaze is directed towards the viewer, and his expression is neutral, conveying a sense of seriousness or contemplation. The background of the painting is a muted brown color, which serves to highlight the subject's features and create a sense of depth. The overall effect of the portrait is one of elegance and refinement, suggesting that the subject was a member of the upper class or a person of importance during his time. The style of the painting is reminiscent of classical portraiture, with attention to detail and a focus on capturing the subject's likeness.