Human Generated Data

Title

Carl Peter Teigen (c. 1897-1936)

Date

19th-20th century

People

Artist: Denman Waldo Ross, American 1853 - 1935

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.86

Human Generated Data

Title

Carl Peter Teigen (c. 1897-1936)

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

19th-20th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.86

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 97.7
Human 89.8
Face 58.1

Clarifai
created on 2020-04-23

people 97.7
man 96.5
painting 92.5
art 92
portrait 91
one 89.4
old 88.4
retro 87.4
paper 86.4
jacket 82.8
adult 82.5
antique 81.4
person 81
popularity 81
vintage 78
wear 77.2
desktop 72.4
artistic 70.3
famous 70.1
wall 69.7

Imagga
created on 2020-04-23

bow tie 100
necktie 100
garment 60.2
man 53.1
male 44
clothing 33.4
portrait 31.7
adult 31.7
handsome 30.3
people 29
person 26.4
looking 24.8
smile 24.2
face 23.4
couple 22.7
happy 22.6
attractive 21
love 19.7
casual 19.5
businessman 19.4
hair 18.2
business 17.6
smiling 17.4
tie 17.1
shirt 16.8
senior 15.9
mature 15.8
guy 15.4
lifestyle 15.2
husband 14.5
executive 14.3
suit 13.7
black 13.2
expression 12.8
human 12.8
old 12.5
happiness 12.5
married 12.5
beard 12.4
cheerful 12.2
success 12.1
romance 11.6
elderly 11.5
look 11.4
corporate 11.2
men 11.2
work 11
professional 11
confident 10.9
head 10.9
model 10.9
together 10.5
neck brace 10.5
boy 10.4
eyes 10.3
fashion 9.8
sexy 9.6
retirement 9.6
relationship 9.4
glasses 9.3
one 9
office 8.8
wife 8.5
brace 8.4
grandfather 8.3
family 8
posing 8
support 7.8
dating 7.8
pretty 7.7
health 7.6
age 7.6
marriage 7.6
hand 7.6
joy 7.5
outdoors 7.5
friendly 7.3
lady 7.3
alone 7.3
worker 7.3
spectacles 7.3
gray 7.2
eye 7.2

Google
created on 2020-04-23

Portrait 89.9
Chin 88.9
Forehead 82.2
Self-portrait 76.9
Painting 66.1
Art 65.5

Microsoft
created on 2020-04-23

painting 97.9
drawing 96
human face 92.8
clothing 92.6
sketch 91.2
man 87.7
person 86.9
portrait 76.8
art 61.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 98.9%
Sad 2.9%
Angry 3.7%
Calm 90.8%
Confused 0.9%
Happy 0.1%
Surprised 0.9%
Disgusted 0.3%
Fear 0.3%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting

Clarifai

Human face
Man
Clothing
Human mouth
Human nose
Human eye
Human ear

AWS Rekognition

Person 89.8%

AWS Rekognition

Painting 84.4%

Clarifai

Human face 98.7%

Clarifai

Man 81.5%

Clarifai

Clothing 40.7%

Clarifai

Human mouth 37.8%

Clarifai

Human nose 37.8%

Clarifai

Human eye 37.1%

Clarifai

Human ear 35.2%

Categories

Imagga
created on 2020-04-23

interior objects 69.1%
food drinks 13.8%
pets animals 11.6%
people portraits 4.8%

Captions

Microsoft
created by unknown on 2020-04-23

a man looking at the camera 81.2%
a man wearing a suit and tie 81.1%
a close up of a man 81%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man with a bow tie

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man with a bow tie

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image is a painting depicting an individual from a side profile view. The person has brown hair combed neatly to the side. They are wearing a white shirt with a high collar and a necktie with hues of yellow and accents of red. The background is relatively nondescript, with muted earthy tones. The overall style of the painting appears to be in a traditional, realistic manner with a focus on capturing the character and attire of the subject.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-27

This is a painted portrait in profile view, showing a young person with brown hair styled in a neat cut typical of the early 20th century. The subject is wearing a white collar and an orange-brown bow tie. The painting style is loose and impressionistic, with visible brushstrokes and a muted color palette dominated by browns and beiges. The background is dark and atmospheric, helping to emphasize the subject's profile. The artist has captured a sense of youth and contemplation in the pose and expression. The painting appears to be done in oils and demonstrates skilled technique in capturing light and shadow on the face.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a portrait painting showing a profile view of a young person facing left. The subject is wearing a white collar and an orange-brown bow tie. They have short brown hair styled in a neat cut typical of the early 20th century. The painting appears to be done in an impressionistic style, with loose brushstrokes and a muted color palette dominated by browns and greens in the background. The artist has captured a sense of youth and contemplation in the subject's expression. The painting appears to be unfinished, as the lower portion of the canvas is left bare.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait painting of a young man. The painting depicts the man in profile, with his head slightly turned to the side. He has reddish-brown hair and is wearing a white collared shirt with a yellow tie or collar accessory. The painting has a somewhat subdued color palette, with the background appearing to be a muted, textured surface. The overall style and execution of the painting suggests it is a representational work, likely from the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a portrait of a man, likely painted by John Singer Sargent. The man is shown in profile, facing left, with his head turned slightly towards the viewer. He has short brown hair and wears a white collared shirt with a yellow bow tie featuring red and blue accents. The background of the painting is a muted brown color, which may be a canvas or a wall.

The overall style of the painting suggests that it is a work of realism, with attention to detail and a focus on capturing the subject's likeness. The use of muted colors and the simple composition also give the painting a sense of intimacy and subtlety.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a portrait of a young man, likely created in the early 20th century, as suggested by the style and the artist's signature. The painting showcases a young individual with a serious expression, dressed in attire that is characteristic of the period. The artist's use of color and brushwork adds depth and character to the subject, capturing a moment in time with a sense of realism and emotional depth.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a portrait painting of a man with short, light brown hair and a mustache. He is wearing a white shirt with a yellow bow tie. The man is looking to the right, and his shadow is cast on the wall behind him. The wall is painted in a light brown color, and the painting appears to be done in a realistic style.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image depicts a painting of a man with a mustache and a bow tie. He is wearing a white shirt and a gray suit. The man's face is illuminated by a light source, possibly from the left side, casting a shadow on the right side of his face. The painting has a brownish-gray background, and the man's head is slightly tilted to the right.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image is an oil painting featuring a young man in profile. The man has a fair complexion, with a reddish hue on his cheeks and nose, suggesting a flush or perhaps rosiness. His hair is short, neatly combed back, and appears to be a medium brown color with highlights. He has a slight mustache.

The man is wearing a white collared shirt and a brown suit jacket. A yellowish-brown bow tie is visible.

The background is a mottled mix of greens and browns, creating a soft, diffused area around the man's head and shoulders.

The overall style is reminiscent of late 19th or early 20th-century portraiture.

Created by gemini-2.0-flash-lite on 2025-04-27

Here's a description of the image:

This is a portrait painting of a young man, likely from the early 20th century. He's depicted in a half-length view, turned slightly to the side.

Here's a breakdown of the key elements:

  • Subject: The man has fair skin with a reddish complexion, possibly due to natural skin tones or the artist's technique. He has light brown hair, a thin mustache, and a serious expression.
  • Attire: He is wearing a light-colored suit jacket, a white collared shirt, and a mustard-colored bow tie. This style is consistent with the early 1900s fashion.
  • Background: The background is an indistinct mix of dark green and brown hues, which allows the figure to stand out. It appears to be a painted canvas or other surface and the visible texture of the fabric suggests that it is a canvas.
  • Technique: The painting appears to be done in an impressionistic or realist style. The brushstrokes seem to be visible. The artwork is detailed and focuses on the play of light on the subject's face.
  • Overall Impression: The portrait exudes an air of introspection and formality. The man's gaze is off to the side, which creates a sense of mystery. It's a classic portrait that captures the essence of the sitter's appearance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait painting of a young man. The painting is done in an impressionistic style, characterized by loose brushstrokes and a focus on capturing the essence of the subject rather than fine details. The subject is depicted in profile, facing to the left. He has short, dark hair and is wearing a white collared shirt with a bow tie that appears to be orange and blue. The background is neutral and somewhat blurred, allowing the focus to remain on the subject. The overall tone of the painting is subdued, with a palette dominated by earthy and muted colors. The texture of the canvas is visible, adding to the painterly quality of the work.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

This image is a painting of a man in profile view. The man is wearing a white collared shirt with a yellow bow tie. The background is a muted, textured canvas, and the lighting highlights the contours of his face and the texture of his collar. The painting style appears to be impressionistic, with broad brushstrokes and a focus on capturing the subject's form and expression rather than fine details.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

The image is a portrait painting depicting a man in profile, facing to the left. He has short, neatly combed brown hair and a mustache. The man is wearing a white collared shirt and a light-colored jacket. The background is softly painted with muted tones, creating a subtle contrast with the subject. The overall style of the painting is realistic, with attention to detail in the facial features and clothing. The texture of the canvas is also visible, adding to the painting's tactile quality.