Human Generated Data

Title

The Art Lover

Date

1937

People

Artist: Mervin Jules, American 1912 - 1994

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Donated by Jack Sando '62 and Judith Sando, in appreciation of Professor Seymour Slive, 2005.114

Human Generated Data

Title

The Art Lover

People

Artist: Mervin Jules, American 1912 - 1994

Date

1937

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Donated by Jack Sando '62 and Judith Sando, in appreciation of Professor Seymour Slive, 2005.114

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Painting 99.9
Art 99.9
Human 99.2
Person 99.2
Person 95.6
Person 85.9
Person 82.3
Person 65.1

Clarifai
created on 2018-04-19

people 99.9
adult 99.8
painting 99.6
one 99.3
man 98.9
two 98.6
religion 97.2
furniture 96.7
wear 96.2
art 95.8
room 95.6
elderly 95.6
home 94.7
group 94.4
family 94.3
woman 93.5
indoors 93.2
portrait 93
battle 90.2
war 89.6

Imagga
created on 2018-04-19

fireplace 72.9
old 22.3
man 21.5
jigsaw puzzle 19.3
fire screen 17.9
puzzle 16.2
screen 15.1
chest 14
person 13.8
vintage 13.2
fire 13.1
portrait 12.3
texture 11.8
aged 11.8
people 11.7
male 11.3
protective covering 11.2
grunge 11.1
room 11
box 10.9
interior 10.6
covering 10.5
game 10.4
home 10.4
face 9.9
adult 9.7
black 9.6
brown 9.6
sitting 9.4
hot 9.2
attractive 9.1
indoors 8.8
container 8.7
antique 8.6
living 8.5
food 8.5
meal 8.1
structure 8
metal 8
close 8
paper 7.8
ancient 7.8
industry 7.7
grungy 7.6
dinner 7.6
relaxation 7.5
pattern 7.5
flame 7.5
design 7.4
closeup 7.4
heat 7.4
retro 7.4
color 7.2
religion 7.2
work 7.2
art 7.1
worker 7.1
job 7.1
working 7.1

Google
created on 2018-04-19

painting 91.4
art 86.1
picture frame 77.6
wood 61.7
artwork 57.7
portrait 57.4
stock photography 55.8
impressionist 52.5

Microsoft
created on 2018-04-19

indoor 85.6
old 47.9

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 26-43
Gender Male, 76.9%
Angry 15.3%
Confused 4.5%
Calm 26.3%
Sad 46.5%
Happy 1.1%
Surprised 5.4%
Disgusted 0.8%

AWS Rekognition

Age 35-52
Gender Male, 57.6%
Calm 3.5%
Surprised 0.8%
Happy 10.8%
Confused 1.1%
Disgusted 2%
Angry 2.1%
Sad 79.7%

AWS Rekognition

Age 45-66
Gender Female, 98.3%
Surprised 2.4%
Disgusted 1.6%
Confused 1.8%
Angry 2.6%
Happy 1.1%
Calm 1.2%
Sad 89.3%

AWS Rekognition

Age 38-59
Gender Male, 73.9%
Angry 3.5%
Confused 5.9%
Disgusted 5.7%
Surprised 4.4%
Calm 41.5%
Sad 32.1%
Happy 6.9%

AWS Rekognition

Age 35-55
Gender Male, 52.4%
Disgusted 45.1%
Surprised 45.1%
Sad 48.2%
Calm 51%
Angry 45.5%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 48-68
Gender Male, 54.2%
Happy 45%
Calm 54.2%
Angry 45.1%
Sad 45.1%
Confused 45.1%
Disgusted 45.3%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Disgusted 45.2%
Angry 45.3%
Sad 47%
Confused 45.2%
Calm 50%
Surprised 45.3%
Happy 47%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Painting
Person
Painting 99.9%
Person 99.2%
Person 95.6%
Person 85.9%
Person 82.3%
Person 65.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a man in a suit and tie is looking at a painting of a woman -100%

OpenAI GPT

Created by gpt-4 on 2024-01-26

This image depicts an individual sitting in profile to the right, facing a mirror that reflects an interior scene different from the setting the individual is in. The reflected scene appears to be a bustling environment with various individuals and activity. The individual's attention is directed towards the mirror, and in their hand are two oval items, which they appear to be examining closely. The painting's perspective is designed to invite the viewer to look over the individual's shoulder, into the mirror and the scene depicted within.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts an elderly man intently observing a painting which appears to show a group of figures in an industrial or urban setting. The man is seated, his head tilted slightly as he examines the artwork in front of him. The painting within the painting features vibrant colors and a dynamic, crowded scene. The overall impression is one of contemplation and engagement with the artistic work.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image depicts a painting of an older man in a black suit, holding a pocket watch and gazing at another painting. The man is balding, with a receding hairline, and has a white shirt visible under his jacket. He holds the pocket watch in his right hand, which is positioned in front of him.

The painting he is looking at is framed in white and features a scene of people gathered around a woman who appears to be speaking or singing. The background of the painting is dark, with what seems to be a factory or industrial setting. The overall atmosphere of the image suggests that the man is deeply engaged in contemplating the painting, possibly reflecting on its themes or messages.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of a man holding a small, round object in his hand, with a mirror reflecting a scene of people in the background. The man is bald and wears a black suit jacket over a white collared shirt. He holds the object, which resembles a pocket watch, in his right hand. In the background, a mirror reflects a scene of people gathered in a room, with one person standing on a table or platform, shouting or speaking to the others. The atmosphere of the image suggests that the man in the foreground is observing or listening to the scene unfolding in the mirror, possibly with a sense of interest or concern.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

In the painting, there is a bald man wearing a black suit. He is holding a watch in his hand, and he is looking at the painting on the wall. The painting on the wall is a picture of a man standing in front of a group of people. The man is holding a flag and raising his hand. The group of people are looking at the man.

Created by amazon.nova-lite-v1:0 on 2025-01-04

This is an oil painting depicting a man wearing a suit and holding a watch in his hand. He is looking at a framed painting on the wall, which shows a scene of people in a room with a man in the center, possibly shouting or speaking. The painting on the wall is set against a backdrop of an industrial landscape with chimneys and buildings. The painting has a dark, moody atmosphere, and the man in the foreground appears to be deep in thought or contemplation.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is an oil painting with a dark, somber tone. A bald, elderly man in a black suit is seen in profile on the right side of the painting. He is holding a pair of round spectacles in his hand, and his mouth is slightly open, as if he is speaking or surprised.

On the left side, there is a framed scene depicting a crowd of people, likely workers or protestors, with an orator at the forefront holding a flag. The background of the framed scene shows industrial chimneys with smoke billowing out against a fiery orange sky. The overall mood conveyed by the painting is one of reflection, perhaps on the contrast between the individual's comfortable status and the struggle of the working class depicted in the framed scene.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

This painting depicts a scene with a complex, somewhat surreal composition. It appears to be an oil painting with a dark, aged aesthetic.

Foreground:

  • A man is prominently featured in the foreground, viewed from his side. He has a large, pale, bald head. His features are somewhat exaggerated and simple. He is wearing a dark suit and a white shirt with a collar.
  • His right hand is holding a pair of eyeglasses, suggesting contemplation or perhaps an attempt to see more clearly.
  • The background behind the man is dark, suggesting a simple, flat space or perhaps a dimly lit room.

Midground:

  • The central focus is a rectangular frame, resembling a window or a picture frame. This frame contains a scene within the scene.
  • The scene within the frame depicts a gathering of people, seemingly at a rally or demonstration. A figure appears to be addressing the crowd, possibly giving a speech, and holding a flag.
  • Behind the crowd, there's a backdrop of industrial structures: smokestacks and buildings, suggesting a factory or industrial setting. The sky in this inner scene is a dramatic orange, indicating either sunrise, sunset, or perhaps the glow from a fire or industrial process.

Overall Impression:

The painting appears to be a commentary on observation, or perhaps an attempt to interpret the events happening in the frame. The artist's style is reminiscent of early modern painting with a simplified style and focus on conveying emotion. The contrast between the stark, pale figure in the foreground and the dynamic, colorful scene within the frame creates a sense of tension or contemplation. The choice of subject matter—a political gathering in an industrial setting—suggests a social or political theme.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is a painting that depicts an older, bald man in a suit looking through a window or a framed scene. The man appears to be holding a pair of glasses in his right hand. The scene he is observing through the window shows a group of people in what looks like a rustic or industrial setting. The individuals in the background are dressed in work clothes and appear to be engaged in various activities, possibly indicative of labor or a social gathering. The overall color palette is muted, with earthy tones dominating the painting, giving it a somewhat somber or reflective mood. The painting has a textured, almost impressionistic style, which adds to its artistic and narrative depth.