Human Generated Data

Title

Nocturne in Grey and Gold: Chelsea Snow

Date

1876

People

Artist: James Abbott McNeill Whistler, American 1834 - 1903

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.172

Human Generated Data

Title

Nocturne in Grey and Gold: Chelsea Snow

People

Artist: James Abbott McNeill Whistler, American 1834 - 1903

Date

1876

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.172

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Nature 99.8
Outdoors 99.4
Storm 98.8
Winter 98.8
Blizzard 98.8
Snow 98.8
Human 97.8
Ice 86.9
Weather 72.8

Clarifai
created on 2020-04-24

art 95.2
dirty 93.1
no person 92.6
wear 91.4
soil 90.6
vintage 90.1
paper 88.7
urban 87.9
street 87.6
sooty 87.6
retro 87.2
empty 86.8
texture 86.3
old 86.2
artistic 84.1
eerie 82.9
bill 82.5
parchment 82.2
worn 82.1
decay 80

Imagga
created on 2020-04-24

basement 30.2
grunge 26.4
old 25.1
wall 24.8
dark 21.7
light 20.7
vintage 20.7
grungy 19
road 17.2
texture 16.7
tunnel 16.4
empty 16.3
aged 16.3
landscape 15.6
ancient 15.6
dirty 15.4
cell 15.3
architecture 14.8
tree 13.8
urban 13.1
retro 13.1
building 12.8
garage 12.6
fireplace 12.3
forest 12.2
scene 12.1
antique 12.1
street 12
abandoned 11.7
sidewalk 11
room 11
rough 10.9
season 10.9
man 10.7
passageway 10.7
passage 10.6
brick 10.6
rural 10.6
travel 10.6
autumn 10.5
country 10.5
black 10.2
industrial 10
city 10
fantasy 9.9
interior 9.7
pattern 9.6
concrete 9.6
sky 9.6
alley 9.5
space 9.3
house 9.2
scenery 9
warehouse 9
worn 8.6
damaged 8.6
rusty 8.6
nobody 8.5
path 8.5
design 8.4
stone 8.4
wallpaper 8.4
frame 8.3
peaceful 8.2
device 8.2
morning 8.1
door 8.1
brown 8.1
mountain 8
night 8
scenic 7.9
foggy 7.9
misty 7.8
paper 7.8
artistic 7.8
art 7.8
fog 7.7
blank 7.7
construction 7.7
mystery 7.7
winter 7.7
outdoor 7.6
old fashioned 7.6
weathered 7.6
way 7.5
wood 7.5
structure 7.4
park 7.4
environment 7.4
countryside 7.3
transportation 7.2
history 7.2
sunlight 7.1
trees 7.1
snow 7
textured 7

Google
created on 2020-04-24

Wall 81.3
Visual arts 72.2
Art 67.7
Tints and shades 64.5
Painting 63
Stock photography 62.1
Concrete 55.1
Space 54.2
Floor 53.9

Microsoft
created on 2020-04-24

ground 96.2
painting 91.9
text 77.5
rain 76.6
rainy 33.9
concrete 25.2
cement 24.2

Color Analysis

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Tree
Person
Window

AWS Rekognition

Person 97.8%

Clarifai

Tree 56.5%

Clarifai

Tree 45.1%

Clarifai

Tree 40.4%

Clarifai

Tree 36.1%

Clarifai

Tree 35.3%

Clarifai

Person 49.8%

Clarifai

Window 38.6%

Categories

Imagga
created on 2020-04-24

interior objects 99.9%

Captions

Microsoft
created by unknown on 2020-04-24

a building in the rain 38.3%
a close up of an umbrella on a rainy day 31.7%
a close up of a street 31.6%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a person walking down a snowy road

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a street at night with people walking

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image depicts a painting characterized by a dim, atmospheric scene. It appears to be set in the evening or at night, with a soft, blue-grey palette. The composition features a desolate urban street with a single, small, and indistinct figure walking along the snow-covered ground towards a source of warm light. The light emanates from a few illuminated windows and street lamps, creating a hazy glow that bathes the surrounding area in a subtle mist. The buildings and trees are barely detailed, contributing to the overall impressionistic style of the painting. The blurred edges and muted colors enhance the quiet, contemplative mood of the scene.

Created by gpt-4 on 2024-01-27

Sorry, I can't help with identifying or making assumptions about people in images.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-27

This is a moody, atmospheric painting depicting a nocturnal winter scene. A solitary figure appears as a small dark silhouette against a snow-covered street or ground. The background shows buildings with warmly lit windows glowing in the darkness, creating points of yellow light that contrast with the overall dark, muted tones of the painting. The scene has a mysterious, almost melancholic quality, with the vast expanse of snow and the lone figure emphasizing a sense of solitude. The style appears to be from the late 19th or early 20th century, with its impressionistic handling of light and atmosphere. The painting effectively captures the quiet stillness of a winter night in what appears to be a city or town setting.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a snowy, dimly lit street at night. In the foreground, a lone figure can be seen walking down the snow-covered road. The background shows the faint outlines of buildings with lit windows, casting a warm glow against the dark, shadowy surroundings. The overall atmosphere of the scene conveys a sense of solitude and tranquility in the winter night.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image depicts a painting of a person walking down a street at night. The painting is done in muted colors, with the dominant colors being shades of brown and gray.

In the foreground, there is a person walking down the street, dressed in dark clothing. The person is small compared to the rest of the painting, giving the impression that they are far away.

The background of the painting shows a row of buildings along the street, with windows lit up. The sky above is dark, with a few clouds visible. The overall atmosphere of the painting is one of quietness and solitude, with the only sound being the footsteps of the person walking down the street.

The painting appears to be an oil painting, with visible brushstrokes and texture. The style of the painting is reminiscent of Impressionism, with a focus on capturing the fleeting effects of light and color.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image is a painting of a street scene at night, with a person walking away from the viewer. The painting is done in a style reminiscent of Impressionism, with visible brushstrokes and a focus on capturing the fleeting effects of light and color.

  • The street is empty, except for the figure of a person walking away from the viewer.
    • The person is small in the distance, making it difficult to discern any details about their appearance or clothing.
    • They are walking away from the viewer, which creates a sense of depth and distance in the painting.
  • The street is lined with buildings on either side, which are dark and indistinct.
    • The buildings are not well-lit, and their details are difficult to make out.
    • The darkness of the buildings serves to highlight the light of the street lamps and the moon, creating a sense of contrast and drama in the painting.
  • There are several street lamps along the street, which are lit up and casting a warm glow over the scene.
    • The street lamps are tall and slender, with a classic design that adds to the sense of nostalgia and timelessness in the painting.
    • The light from the street lamps illuminates the street and the surrounding buildings, creating a sense of warmth and comfort.
  • The sky above is dark and cloudy, with a few stars visible through the gaps in the clouds.
    • The clouds are thick and grey, which adds to the sense of gloom and melancholy in the painting.
    • The stars are small and distant, which creates a sense of vastness and mystery in the painting.

Overall, the image is a beautiful and evocative painting that captures the mood and atmosphere of a quiet street at night. The use of light and color creates a sense of depth and contrast, while the empty street and dark buildings add to the sense of melancholy and nostalgia.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The painting depicts a person walking on a snowy street at night. The person is wearing a long coat and hat, and their shadow is cast on the ground. The street is illuminated by streetlights, and there are buildings on either side of the street. The buildings have windows, and some of them have lights on. The sky is dark, and there are no clouds visible. The painting has a monochromatic color scheme, with shades of gray and blue.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a person walking on a street at night. The street is covered with snow. The person is wearing a hat and shoes. On the left side of the street, there is a building with a window. The building is lit up, and the light is reflected on the street. On the right side, there is another building with a lit-up window. The street is surrounded by darkness.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a dimly lit, atmospheric painting of a winter street scene at night. The sky is a dusky blue, transitioning into darker shades that suggest a thick haze or fog.

In the foreground, a blanket of snow covers the ground, its surface rendered in a pale blue-gray hue, reflecting the ambient light. The snow appears smooth and undisturbed, save for the slight undulations of the terrain.

A solitary figure, cloaked in darkness, walks alone on the snowy street. The figure is small and indistinct, positioned slightly left of the center, contributing to the overall sense of solitude and quietude.

In the background, a building glows with warm, inviting light emanating from its windows. The illumination casts a soft, diffused glow onto the surrounding area, contrasting with the surrounding cold darkness. The other lamps and window lights hint at life and activity further off in the distance, adding depth to the composition.

The overall mood of the painting is melancholic and contemplative, evoking a sense of the quiet beauty of a winter night. The limited color palette and soft brushstrokes contribute to a dreamlike, ethereal quality.

Created by gemini-2.0-flash-lite on 2025-04-26

The image is a painting of a snow-covered street at night. It depicts a lonely figure walking along the road, the scene bathed in the soft glow of streetlights and the warm light spilling from windows. The sky is a deep, hazy blue, which suggests a cold night. The buildings are silhouetted against the night, and the overall mood is one of isolation and introspection. The brushstrokes are visible, and the texture of the painting adds to the atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a nighttime scene in an urban setting, likely a city street covered in snow. The painting is rendered in a dark, moody style, characteristic of tonalism or impressionism. The scene is dimly lit, with a few light sources illuminating parts of the street and buildings.

In the foreground, a lone figure walks away from the viewer, adding a sense of solitude and quietness to the scene. The person is dressed in dark clothing, blending into the shadows. The street is lined with buildings, and the snow on the ground reflects the faint light, creating a subtle glow.

The overall atmosphere is one of tranquility and isolation, with the muted colors and soft lighting contributing to a serene and somewhat melancholic mood. The painting captures the stillness and beauty of a snowy night in the city.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-26

This image is a painting depicting a snowy night scene. The scene is illuminated by the soft glow of street lamps and a large building in the background, which appears to be a church or a similar structure with arched windows and a dome. The building is mostly obscured by the darkness and the falling snow, giving it a mysterious and somewhat eerie appearance.

In the foreground, a lone figure is walking away from the viewer, heading towards the building. The figure is small and almost blends into the snowy landscape, emphasizing the vastness and isolation of the scene. The snow-covered ground is uneven, with some areas appearing to be higher or more piled up than others.

The overall atmosphere of the painting is quiet and somber, with the muted colors and the lone figure creating a sense of solitude and contemplation. The painting captures a moment of stillness in a cold, snowy night, with the light from the lamps and the building providing a faint sense of warmth and shelter amidst the cold.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-26

This image depicts a nighttime urban scene, rendered in a somber and moody atmosphere. The painting features a person walking alone on a dimly lit street, which appears to be partially covered with snow, suggesting a cold and quiet winter evening. The figure is small in the foreground, emphasizing the vastness and solitude of the environment.

In the background, there is a large building with a few illuminated windows, casting a faint glow against the dark sky. The sky itself is a deep, dark blue, almost black, with a hint of lighter tones near the horizon. The overall composition uses muted colors and a textured, possibly impasto technique, giving the painting a gritty and atmospheric quality. The streetlights are sparse and not very bright, which adds to the sense of isolation and quietness. The painting conveys a feeling of loneliness and perhaps contemplation, as the solitary figure moves towards the light from the building.

Text analysis

Amazon

A