Human Generated Data

Title

John McAllister, Jr. (1786-1877)

Date

1831

People

Artist: Thomas Sully, American 1783 - 1872

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.157

Human Generated Data

Title

John McAllister, Jr. (1786-1877)

People

Artist: Thomas Sully, American 1783 - 1872

Date

1831

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.157

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 97.9
Human 97.9
Art 95.8
Painting 94
Clothing 83
Apparel 83
Coat 57.5

Clarifai
created on 2018-03-22

portrait 99.6
people 99.6
one 99.4
adult 99
wear 98.9
facial expression 97.5
jacket 96.8
man 96.7
menswear 96.4
outerwear 96.1
outfit 95.1
neckwear 92.3
business 88.6
dinner jacket 87.6
tie 87.6
fashionable 86.2
music 84
blazer 83.9
confidence 83.2
indoors 83.2

Imagga
created on 2018-03-22

suit 70.9
necktie 58.7
bow tie 56.6
businessman 54.8
man 53.2
male 47.6
garment 47.1
business 46.2
executive 44.3
person 40.4
adult 36.3
professional 35.1
corporate 34.4
clothing 31.8
portrait 31.8
office 31.4
people 30.2
success 28.2
handsome 27.7
tie 25.7
confident 25.5
men 24.9
successful 23.8
standing 23.5
smile 22.8
work 22
happy 22
expression 21.4
boss 21.1
smiling 20.3
looking 20
businesswoman 20
manager 19.6
face 17.8
job 16.8
worker 16.8
company 16.8
modern 15.4
guy 15.3
mature 14.9
jacket 14.8
hand 14.5
businesspeople 14.3
shirt 14
businessmen 13.7
black 13.5
team 13.5
formal 13.4
lifestyle 13
human 12.8
director 12.7
meeting 12.3
friendly 11.9
alone 11.9
happiness 11.8
staff 11.6
fashion 11.3
elegant 11.2
teamwork 11.1
consumer goods 10.6
corporation 10.6
cheerful 10.6
leadership 10.6
covering 10.5
attractive 10.5
one 10.5
smart 10.4
model 10.1
employee 9.9
studio 9.9
businessperson 9.8
40s 9.8
couple 9.6
hands 9.6
hair 9.5
colleagues 8.8
partnership 8.7
entrepreneur 8.6
confidence 8.6
money 8.5
one person 8.5
finance 8.5
senior 8.4
baron 8.4
positive 8.3
group 8.1
building 7.9
love 7.9
businesswomen 7.9
partners 7.8
eyes 7.8
mid adult 7.7
leader 7.7
30s 7.7
serious 7.6
two 7.6
workplace 7.6
gesture 7.6
lawyer 7.6
secretary 7.6
holding 7.4
glasses 7.4
color 7.2
sexy 7.2

Google
created on 2018-03-22

portrait 89.6
gentleman 84.1
painting 60.8

Microsoft
created on 2018-03-22

person 99.6
clothing 94.8
suit 77.4
posing 53.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Angry 2.8%
Confused 6.4%
Calm 61.5%
Sad 4.7%
Happy 11.5%
Surprised 10.5%
Disgusted 2.6%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Person 97.9%

Categories

Imagga

events parties 96.3%
people portraits 3.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a portrait of a man in a black suit and white shirt -100%

OpenAI GPT

Created by gpt-4 on 2024-01-25

The image is a classic portrait featuring a figure dressed in period attire. The person is wearing a dark, formal coat with a high collar and decorative buttons aligned down the front. Underneath the coat, there's a vest peeking out, and at the base of the neck, a white cravat tied in a prominent bow adds a touch of elegance to the ensemble. The background is relatively plain and dark, highlighting the figure's attire. The overall composition suggests the style of portraiture common in the late 18th to early 19th centuries, where emphasis was placed on the attire and status of the individual.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to be a portrait painting of a man. The man is wearing a dark suit and has a serious, somewhat stern expression on his face. He has curly, dark hair and is looking directly at the viewer. The background is dark, which helps draw the viewer's attention to the subject's face and upper body. The painting seems to be in a classical, academic style, suggesting it was created in the 19th century or earlier.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a portrait of a man in a black coat with gold buttons, wearing a white cravat and a white shirt. The background is dark brown.

  • The man's face is painted in detail, showing his features clearly.
    • He has short hair that is graying at the temples.
    • His eyes are brown, and his eyebrows are thick and dark.
    • His nose is straight, and his lips are thin.
    • He has a small chin and a prominent jawline.
  • The man's clothing is also painted in detail.
    • He wears a black coat with gold buttons down the front.
    • Underneath the coat, he wears a white shirt with a high collar.
    • Around his neck, he wears a white cravat that is tied in a bow.
  • The background of the painting is dark brown.
    • It is a solid color with no patterns or textures.
    • It provides a neutral backdrop for the man's portrait.

Overall, the image is a formal portrait of a man in the early 19th century. The level of detail in the painting suggests that it was created by a skilled artist.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image presents a portrait of a man dressed in formal attire, likely from the 19th century. The subject is depicted wearing a dark-colored coat with gold buttons, a white cravat or ascot, and a black vest. His hair is short and gray, and he appears to be looking directly at the viewer.

The background of the painting is a warm, muted brown color, which provides a subtle contrast to the subject's dark clothing. The overall effect of the portrait is one of elegance and refinement, suggesting that the subject was a member of the upper class or a professional of some sort.

The painting style is reminiscent of traditional European portraiture, with attention to detail and a focus on capturing the subject's likeness. The use of muted colors and a simple background allows the viewer to focus on the subject's features and expression.

Overall, the image presents a dignified and sophisticated portrait of a man from the past, inviting the viewer to appreciate the artistry and craftsmanship that went into creating it.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a portrait of a man. He is wearing a black coat with a white inner shirt and a white necktie. He is also wearing eyeglasses. He is looking to the right, and his mouth is slightly open. The man's hair is gray, and he has a receding hairline. He is wearing a black vest with two buttons. The background is a brownish color.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a portrait of a man, possibly an elderly man, wearing a black coat with a white shirt and a black vest. He is looking directly at the camera with a serious expression on his face. The man has gray hair and is wearing glasses. The background is dark, and the portrait is framed in a dark brown frame. The portrait appears to be an oil painting.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here is a description of the image:

The image is a portrait of a man in what appears to be early 19th-century attire. He is wearing a dark coat with a high collar, a vest, and a white cravat or stock tie. The man has light graying hair and is wearing gold-rimmed spectacles. The background is a soft, dark gradient of brown and tan, which provides a contrast to the man's attire and skin tone. The painting style seems traditional, with attention to detail in the clothing and facial features. The light catches the left side of his face, giving definition to his features.

Created by gemini-2.0-flash-lite on 2025-04-26

Here is a description of the image:

The image is a portrait of a man painted in a classical style. The man is depicted from the chest up, against a simple, dark brown background.

The man is wearing a dark blue coat with gold buttons, a black waistcoat, and a white shirt with a cravat. He has thin, wire-rimmed glasses and gray hair. His expression is serious, and his gaze is directed toward the viewer. The painting is well-lit, with a focus on the man's face and upper body, and the artist has captured the texture of the clothing and skin with skill. The overall impression is of a formal, elegant portrait.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait painting of a man. He is depicted in a formal pose, facing the viewer. The man has short, dark hair and is wearing spectacles. He is dressed in early 19th-century attire, which includes a dark coat with a high collar, a white cravat, and a waistcoat. The background of the painting is a plain, dark color, which helps to highlight the subject. The painting style appears to be realistic, with attention to detail in the facial features and clothing. The overall mood of the painting is serious and dignified, reflecting the formal nature of the portrait.