Human Generated Data

Title

Dublin Newsboy Boarding a Tram

Date

1926

People

Artist: Jack Butler Yeats, Irish 1871 - 1957

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Benjamin and Lilian Hertzberg, 2005.26

Human Generated Data

Title

Dublin Newsboy Boarding a Tram

People

Artist: Jack Butler Yeats, Irish 1871 - 1957

Date

1926

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Benjamin and Lilian Hertzberg, 2005.26

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 99.9
Modern Art 96.1
Canvas 93.4
Mural 58.6
Paint Container 56.2

Clarifai
created on 2020-04-23

art 99.6
painting 99.5
artistic 99.3
graffiti 99.2
messy 97.8
creativity 96.7
dirty 96.6
old 96.2
wall 94.3
street 92.4
design 92.1
amazing 91
color 90.6
flame 90
canvas 89.9
urban 89.5
painter 89.2
visuals 89.1
coloring 87.7
trash 82.3

Imagga
created on 2020-04-23

graffito 100
decoration 71.5
grunge 32.4
old 32
texture 29.2
wall 26
dirty 25.3
art 24.1
paint 22.6
vintage 19
textured 18.4
pattern 17.8
antique 17.3
wood 16.7
artistic 16.5
retro 16.4
brown 16.2
stone 16
architecture 15.6
color 15.6
aged 15.4
material 15.2
surface 15
rough 14.6
black 14.4
grungy 14.2
structure 14.2
design 14.1
colorful 12.9
construction 12.8
detail 12.1
metal 12.1
light 12
backdrop 11.5
painted 11.5
weathered 11.4
canvas 11.4
natural 11.4
ancient 11.2
dark 10.9
ice 10.8
decay 10.6
rust 10.6
urban 10.5
frame 10
close 9.7
wooden 9.7
damaged 9.5
rusty 9.5
building 8.9
steel 8.8
crystal 8.8
paper 8.6
brick 8.6
door 8.6
industry 8.5
iron 8.4
decorative 8.4
artwork 8.2
landscape 8.2
industrial 8.2
backgrounds 8.1
yellow 8
rock 7.8
abandoned 7.8
travel 7.7
wallpaper 7.7
concrete 7.7
worn 7.6
water 7.3
bright 7.2

Google
created on 2020-04-23

Painting 97.4
Modern art 93.2
Art 90.3
Acrylic paint 85.3
Visual arts 82.2
Still life 74.1
Artwork 68.3
Paint 66.4
Artist 58.9
Watercolor paint 50.4

Microsoft
created on 2020-04-23

painting 100
drawing 99.9
child art 98.7
sketch 98.6
art 96.6
dirty 68.6
old 62.3
watercolor paint 53
graffiti 45.3

Color Analysis

Feature analysis

Amazon

Painting

Clarifai

Person
Human face

AWS Rekognition

Painting 99.9%

Clarifai

Person 85%

Clarifai

Human face 82.6%

Categories

Imagga
created on 2020-04-23

pets animals 47.5%
paintings art 20.3%
nature landscape 16.9%
streetview architecture 5%
food drinks 2.6%
events parties 2.6%
interior objects 1.9%

Captions

Microsoft
created by unknown on 2020-04-23

a graffiti covered wall 70.5%
a graffiti covered building 58%
graffiti on a wall 57.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a suit and tie

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man with a hat and jacket

OpenAI GPT

Created by gpt-4 on 2024-01-25

Sorry, I can't help with identifying or making assumptions about people in images.

Created by gpt-4o-2024-05-13 on 2025-01-02

This image is an abstract painting created by Oskar Kokoschka, titled "Self-Portrait of a Degenerate Artist" from 1937. In the painting, there is a figure on the right-hand side that appears to be the artist himself, depicted in a highly expressive and impassioned style. The brushstrokes are bold and dynamic, creating a sense of movement and emotional intensity. The figure's face and upper body are composed of thick, swirling strokes of paint in shades of red, purple, and yellow, with facial features that are loosely defined but convey a sense of solemnity or contemplation.

The background on the left side of the painting consists of cooler tones, predominantly blue and grey, with similar dynamic brushstrokes that create a textured and somewhat chaotic environment. This contrast between the warm tones of the figure and the cool tones of the background enhances the drama and focus on the central figure.

The painting seems to reflect the turbulent times and the inner emotional state of the artist, possibly commenting on his feelings of alienation or defiance against the repressive political climate of the era. The overall impression is one of intense emotion, personal struggle, and artistic defiance.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This is an abstract expressionist painting with a moody, dark atmosphere. The background is dominated by shadowy greys and deep blues, creating a somber, industrial-like setting. In the foreground, there are dynamic brush strokes in lighter colors - pinks, whites, and touches of yellow - that seem to form an abstracted figure. The painting technique appears loose and gestural, with thick impasto paint application creating texture and movement. The contrast between the dark background and the lighter figure creates a dramatic effect, while the overall composition suggests a sense of isolation or solitude. The style is reminiscent of mid-20th century abstract expressionism, with its emotional intensity and spontaneous, energetic brushwork.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to be an abstract expressionist painting featuring a bold, energetic composition of overlapping shapes and colors. The predominant colors are shades of gray, with accents of red, yellow, and other vibrant hues. The brushstrokes are thick and expressive, creating a sense of movement and dynamism within the frame. The overall impression is one of a tumultuous, emotionally charged scene, though the specific subject matter is not clearly defined. The painting has a striking, atmospheric quality that invites the viewer to interpret and engage with the work on a more intuitive, subjective level.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image depicts a painting of a man in an interior setting, characterized by loose brushstrokes and muted colors. The man is positioned on the right side of the canvas, facing left, with his head turned slightly towards the viewer. He has short, light-colored hair and wears a dark jacket over a white shirt, which is open at the collar.

In the background, there are several vertical lines that suggest the presence of windows or doors, although they are not clearly defined. The overall atmosphere of the painting is one of introspection and contemplation, as if the man is lost in thought. The use of muted colors and loose brushstrokes adds to the sense of melancholy and introspection, creating a somber and reflective mood.

The painting appears to be an impressionist work, with the artist focusing on capturing the play of light and shadow on the subject's face and clothing. The loose brushstrokes and muted colors give the painting a sense of spontaneity and immediacy, as if the artist was working quickly to capture the moment. Overall, the image presents a thoughtful and contemplative scene, inviting the viewer to reflect on the emotions and thoughts of the subject.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image is an impressionist painting of a man in a room, with the man standing on the right side of the canvas and facing left. He has white hair and wears a dark jacket over a light-colored shirt. The background features a gray wall with a window on the left side, through which a bright light shines. The overall atmosphere of the painting is one of quiet contemplation, with the man lost in thought as he gazes out the window.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a person standing in front of a window. The person is wearing a blue shirt and a red jacket. The person's face is painted in a way that it is not clearly visible. The person is holding a white object in their hand. The background of the painting is painted in a way that it is not clearly visible.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is an abstract painting of a person in a blue jacket and a white shirt with a yellow collar. The person is standing in front of a gray wall with a white light shining on it. The person's face is slightly blurry, and the background is dark. The painting has a black border. The person's hair is messy, and the painting has a slightly blurry effect.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

This is an oil painting with a rough, expressive style. The brushstrokes are visible and contribute to the overall mood. The color palette is dominated by muted tones of grey, blue, brown, and red, with occasional pops of yellow and white.

The subject appears to be a portrait of a person set against an indistinct, possibly urban background. The figure has a somewhat ghostly or ethereal presence due to the loose brushwork and blurred edges. The face is abstract, with features suggested rather than precisely defined. The figure seems to be behind bars or a frame of some kind, adding a layer of constraint or enclosure to the scene.

The background is a blend of indistinct shapes and colors, which could suggest buildings, interiors, or an abstract landscape. The overall impression is one of introspection, isolation, or emotional turmoil.

Created by gemini-2.0-flash-lite on 2025-04-26

This is an expressive, impressionistic painting of a person in a muted, shadowy setting. The artwork is executed with thick brushstrokes and a palette dominated by grays, blues, reds, and a touch of yellow.

Key Elements and Observations:

  • Subject: The primary subject appears to be a person, likely a man, whose face is rendered with thick, blended strokes of color. It's somewhat abstract but still conveys a human form. The subject is wearing clothing that appears to be dark in color with red accents.
  • Setting: The background is indistinct but appears to be an interior space. The blurry background with vertical lines suggests a corridor or a space with architectural elements such as pillars or walls.
  • Style/Technique: The painting has a strong expressionistic quality. The brushwork is loose and visible, and the colors are not necessarily naturalistic. This technique creates a sense of movement, emotion, and raw energy.
  • Color Palette: The use of cool, muted colors (grays, blues) creates a somber, atmospheric feel, but the inclusion of vibrant reds and yellows adds areas of visual interest and drama.
  • Composition: The artist seems to be using a close-up perspective, focusing on the subject's face and torso. The subject is positioned slightly off-center. The use of vertical lines guides the eye around the artwork.

Overall, the painting is a striking and emotive work of art that seems to prioritize emotional expression and the texture of paint over photographic accuracy.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is an abstract painting that appears to depict a figure, possibly a person, in a somewhat distorted and expressionistic style. The figure is rendered with bold, thick brushstrokes and a palette dominated by muted tones, including shades of gray, blue, brown, and red. The background is similarly abstract, with vague forms and lines that suggest an interior space, perhaps a room or a studio.

The figure seems to be holding an object, which could be interpreted as a paintbrush or a similar tool, indicating that the subject might be an artist. The overall mood of the painting is introspective and somewhat melancholic, with a focus on the emotional and psychological state of the figure rather than on realistic detail. The use of color and texture adds to the expressive quality of the work, conveying a sense of depth and complexity.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image is an abstract painting featuring a figure that appears to be holding a bouquet of flowers. The painting is done in a loose, expressive style with visible brushstrokes and a limited color palette dominated by grays, blues, and muted earth tones. The background is abstract and suggests an urban environment with tall buildings and possibly a street scene. The figure is positioned on the right side of the canvas, facing left, with the flowers in the foreground. The overall mood of the painting is somber and contemplative.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

This is an abstract painting featuring a figure that appears to be a woman, depicted in profile view. The painting employs a dynamic and somewhat expressionistic style, with bold brushstrokes and a mix of colors including shades of blue, red, yellow, and gray. The figure is shown with a dynamic pose, possibly dancing or in motion, with her head tilted back and her hair or hair-like elements flowing. The background is equally abstract, with an impressionistic rendering of what could be a street or urban setting, marked by vertical lines and abstract shapes that suggest buildings or structures. The overall mood of the painting is somewhat enigmatic and expressive, inviting viewers to interpret the emotional state or context of the figure within the abstracted setting.