Human Generated Data

Title

Erik H. Gould

Date

19th-20th century

People

Artist: Denman Waldo Ross, American 1853 - 1935

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.109.176

Human Generated Data

Title

Erik H. Gould

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

19th-20th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.109.176

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 96.7
Painting 96.7
Human 95.8
Apparel 84.2
Coat 84.2
Clothing 84.2
Overcoat 84.2
Accessories 77.5
Accessory 77.5

Clarifai
created on 2020-04-23

people 99.7
portrait 99.2
one 98.4
man 98.4
adult 96.9
wear 95.9
painting 93.8
art 92.9
jacket 92.3
leader 85.7
profile 81.7
retro 80.4
side view 77.7
brunette 72.9
mustache 71.2
music 69.1
lid 68.1
facial expression 65.6
necklace 63.8
facial hair 63.1

Imagga
created on 2020-04-23

suit 91.5
businessman 74.3
executive 65.7
man 56.6
business 52.4
male 49.1
corporate 44.8
handsome 44.7
person 43.5
professional 42.8
confident 41
portrait 36.3
tie 36.1
successful 34.9
office 33.8
garment 33.3
men 31.9
adult 31.1
manager 30.8
baron 30.8
success 28.2
people 28
clothing 26.1
boss 25.9
looking 25.7
work 25.2
mature 25.2
modern 22.5
expression 22.2
job 22.2
smiling 21.8
businesspeople 20.9
standing 20.9
necktie 20.6
occupation 20.2
face 19.9
black 18.9
smile 18.6
one 18
senior 17.9
happy 17.6
old 16.8
worker 16.2
smart 16.1
guy 16
lawyer 15.3
secretary 14.8
corporation 14.5
formal 14.4
serious 14.3
consumer goods 14.1
covering 14.1
glasses 13.9
friendly 13.8
studio 13.7
businesswoman 13.7
shirt 13.1
company 13.1
lifestyle 13
businessmen 12.7
team 12.6
elderly 12.5
confidence 12.5
working 12.4
career 12.3
building 11.9
employee 11.8
businessperson 11.7
leadership 11.6
collar 11.5
meeting 11.3
elegant 11.2
older 10.7
cheerful 10.6
attractive 10.5
workplace 10.5
entrepreneur 10.5
casual 10.2
colleagues 9.7
director 9.7
hair 9.5
outside 9.4
teamwork 9.3
communication 9.3
stylish 9.1
jacket 9
human 9
indoors 8.8
judge 8.8
40s 8.8
look 8.8
model 8.6
one person 8.5
hand 8.4
20s 8.3
alone 8.2
group 8.1
close 8
gray hair 7.9
60s 7.8
masculine 7.8
sitting 7.7
busy 7.7
staff 7.7
fashionable 7.6
fashion 7.6
outdoors 7.5
color 7.2
posing 7.1
happiness 7.1

Google
created on 2020-04-23

Portrait 95.2
Self-portrait 84.4
Art 62.5
Painting 53.4

Microsoft
created on 2020-04-23

painting 97.3
human face 96.9
suit 94.8
clothing 92.6
portrait 91.8
person 90.7
man 90.4
text 90.1
drawing 82.1
sketch 62.6
tie 61.1
old 43.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 73.3%
Disgusted 0.1%
Happy 0%
Fear 0.1%
Angry 0.6%
Calm 47%
Sad 51.6%
Surprised 0.1%
Confused 0.4%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Tie

Clarifai

Human face
Man
Human nose
Human mouth
Human arm
Human ear
Human eye

AWS Rekognition

Person 95.8%

AWS Rekognition

Suit 84.2%

AWS Rekognition

Tie 77.5%

Clarifai

Human face 97.2%

Clarifai

Man 92.3%

Clarifai

Human nose 46.4%

Clarifai

Human mouth 38.3%

Clarifai

Human arm 37.3%

Clarifai

Human ear 36.8%

Clarifai

Human eye 34.9%

Categories

Imagga
created on 2020-04-23

events parties 96.2%
people portraits 3.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a suit and tie

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a young man in a suit

OpenAI GPT

Created by gpt-4 on 2024-12-03

This is a classical portrait painting featuring a person in profile. The individual is depicted from the side, displaying the right ear, part of the hair, and the collar of a white shirt under a dark jacket, possibly a suit. The background is a solid, dark color and appears quite simple, placing the focus on the subject of the painting. The painting style suggests it may be from the 19th or early 20th century, based on the use of brushwork and realistic portrayal of the clothing and hair.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This is a classical portrait painting, likely from the early 20th century, showing a young man in profile against a dark burgundy background. The subject is wearing a formal dark suit with a white collar and tie. The painting demonstrates skilled technique in capturing the subtle skin tones and lighting on the subject's face. The style is realistic with careful attention to detail, particularly in the rendering of the features and the way light falls across the face. The composition is traditional, with the figure positioned slightly off-center and gazing to the left of the frame. The overall mood of the painting is contemplative and dignified.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a painted portrait in a classical style, showing a young man in profile against a dark burgundy background. The subject is wearing a formal dark suit and white collar. The painting demonstrates skilled technique in capturing the subtle skin tones and lighting on the subject's face. The style appears to be from the early 20th century, with careful attention paid to realistic rendering while maintaining an artistic sensibility. The composition is simple but effective, with the figure positioned against the dark background in a way that draws attention to the face and creates a sense of dignity and presence.

Created by claude-3-haiku-20240307 on 2024-11-27

The image is a portrait painting of a young man with fair hair and a serious expression. He is wearing a dark suit and is positioned in a pensive, contemplative pose against a dark background. The painting has a subdued, somber tone, capturing the subject's thoughtful demeanor.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

This image is a painting of a man in a suit, with the subject positioned to the left of the frame. The man has short brown hair and is dressed in a dark-colored suit jacket over a white collared shirt and a light-colored tie. His gaze is directed to the left side of the image.

The background of the painting is a dark brown color, which helps to accentuate the subject's features. The overall atmosphere of the image suggests that it may be a portrait or a formal photograph, possibly taken in a studio setting.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a portrait of a young man, painted in a realistic style. The subject is depicted in a three-quarter view, facing the right side of the canvas. He has short, light-colored hair and wears a dark suit jacket over a white shirt and tie. The background of the painting is a dark, muted color that helps to focus attention on the subject's face and upper body. The overall effect is one of simplicity and elegance, with the artist using subtle shading and color to create a sense of depth and dimensionality.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a portrait of a man, possibly from an old painting. The man is dressed in a black suit with a white shirt and a tie. He is standing with his head slightly tilted to the side, looking directly at the viewer. The man's face is illuminated by a light source, casting a shadow on his left side. The background is dark, with a slight blur, which adds to the vintage feel of the portrait. The image has a slightly worn and aged appearance, suggesting that it may be an antique or a reproduction of an old painting.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a painting of a person. The person is a young man with light brown hair and a pale complexion. He is wearing a dark suit with a white shirt underneath. The man is looking straight ahead, and his facial expression is neutral. The background of the painting is a solid brown color. There is a tear on the top left corner of the painting.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image is a portrait of a young man, rendered in an oil painting style. The man is positioned in a three-quarter profile, facing towards the left of the frame. He has light skin, with a subtle flush of pink in his cheeks and lips, and light brown hair styled in a neat, slightly disheveled manner. His eyes are a hazel or light brown color.

He is dressed in a dark-colored suit, paired with a white shirt and a muted grey tie. The background is a deep, reddish-brown, which contrasts with the lighter tones of the man's face and shirt, making him the focal point.

There is some damage to the painting, particularly in the upper left corner, where the canvas appears to be torn or worn away. This adds a sense of age and history to the image. The overall style is reminiscent of classical portraiture, with a focus on capturing the likeness and character of the subject.

Created by gemini-2.0-flash-lite on 2025-04-27

The image is a portrait painting of a young man. He is depicted from the chest up, angled slightly to the left. The man has fair skin, reddish lips, and blonde hair. He is wearing a dark suit jacket, a white collared shirt, and a light gray tie. The background is a deep, rich, dark red or maroon color. The canvas appears to be slightly damaged, with a small tear at the top left. The painting has a classic, traditional feel, likely dating from the early to mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait painting of a young man. The subject is depicted in a three-quarter view, facing slightly to the left. He has light brown hair, styled in a manner typical of early to mid-20th century fashion. His facial expression is neutral, with a contemplative or introspective look.

The young man is dressed formally in a dark suit jacket over a white dress shirt with a tie. The background is dark, which helps to highlight the subject's face and clothing, giving the painting a somber and serious tone. The painting style appears to be realistic, with attention to detail in the facial features and clothing. The overall mood of the painting is one of solemnity and reflection.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

The image is a painting of a young man in a formal suit. The background is a deep, dark red, which contrasts with the subject's attire. The man has light skin and short, light-colored hair. He is wearing a suit with a white shirt and a tie. The lighting in the painting highlights the contours of his face and the texture of his suit, giving it a three-dimensional quality. The style of the painting suggests it is a traditional portrait, possibly from the early 20th century based on the formal attire and the technique used.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This is a painted portrait of a young man depicted in a formal style. The subject is shown from the shoulders up, facing slightly to the left, with a direct and serious expression. His attire consists of a dark suit jacket, a white collared shirt, and a light tie, suggesting a formal or professional setting. The background is a plain, dark, almost monochromatic color, which helps to focus attention on the subject. The overall tone of the image is subdued and somewhat somber, with muted colors and soft lighting. The brushstrokes are visible, adding texture and depth to the painting. There is a noticeable scratch or mark in the upper left area of the image, possibly indicating damage or wear on the artwork.