Human Generated Data

Title

River Scene

Date

-

People

-

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.513

Human Generated Data

Title

River Scene

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.513

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Art 99
Transportation 85.2
Vehicle 85.2
Human 82.5
Drawing 62.9
Photography 60
Photo 60

Clarifai
created on 2019-05-30

art 98.7
architecture 98.3
house 98.1
painting 97.8
old 97.7
building 97.7
wall 96.9
illustration 96.5
water 96.1
vintage 95.9
travel 94.2
print 94
ancient 93.8
town 93.8
no person 93.4
city 90.4
river 90.3
Gothic 89.1
tower 88.8
urban 88.5

Imagga
created on 2019-05-30

castle 100
palace 100
fortification 97
defensive structure 61.2
structure 45.4
architecture 44.7
tower 40.4
old 37.8
fortress 36.9
ancient 36.4
landmark 36.2
travel 36
medieval 35.6
building 35.2
history 34.1
stone 33
tourism 32.3
city 31.7
historic 31.3
wall 27.5
historical 23.6
sky 21.1
monument 20.6
town 20.5
tourist 20
landscape 18.7
water 18.1
bridge 18
river 17.9
fort 16.7
famous 15.9
england 15.3
kingdom 14.7
buildings 14.2
hill 14.1
house 13.6
scenic 13.2
rock 13.1
destination 12.2
church 12.1
culture 12
towers 11.8
ruin 11.7
cityscape 11.4
stronghold 10.9
royal 10.7
middle 10.6
brick 10.4
exterior 10.2
holiday 10.1
mountain 9.8
trees 9.8
lake 9.2
scenery 9
walls 8.8
urban 8.8
king 8.8
houses 8.7
great 8.6
united 8.6
clouds 8.5
boat 8.4
vacation 8.2
citadel 7.9
day 7.9
scene 7.8
village 7.7
cathedral 7.7
outdoors 7.5
reflection 7.3
protection 7.3
sunset 7.2
sea 7.1
autumn 7.1

Google
created on 2019-05-30

Microsoft
created on 2019-05-30

building 99.1
painting 98.8
drawing 97.8
ship 89.4
boat 88.6
sketch 87.8
watercraft 84.1
art 83.9
old 78.1
child art 77.6
water 73.5
lake 65.5

Color Analysis

Feature analysis

Amazon

Painting
Boat
Person

Clarifai

Tree
Building

AWS Rekognition

Painting 99%

AWS Rekognition

Boat 85.2%

AWS Rekognition

Person 82.5%

AWS Rekognition

Person 76.9%

AWS Rekognition

Person 65.4%

Clarifai

Tree 84.6%

Clarifai

Tree 82.8%

Clarifai

Tree 75.1%

Clarifai

Tree 65.2%

Clarifai

Tree 40.2%

Clarifai

Tree 38.4%

Clarifai

Tree 37.3%

Clarifai

Building 64.3%

Categories

Imagga
created on 2019-05-30

paintings art 99.3%

Captions

Microsoft
created by unknown on 2019-05-30

a close up of an old building 76.5%
an old brick building 67.8%
an old brick building on a sunny day 67.7%

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

a city by person, 16th century.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a painting of a boat in a river

OpenAI GPT

Created by gpt-4 on 2025-03-08

This image depicts a rustic and somewhat idyllic scene. At the forefront, there is a body of water, likely a river or a lake, with a single person rowing a small boat. The water's edge is lined with rocks and a bit of vegetation. To the left, a dilapidated wooden structure seems to be a shed or an old hut, with a distressed roof, suggestive of neglect or abandonment.

The middle ground of the picture is dominated by stone buildings that exude an old-world charm, hinting at a village or a small medieval town. They appear sturdy but aged, with some parts overgrown with ivy or similar climbing plants. The architecture has features like arches and possibly bell towers, indicating these might be part of a larger complex, perhaps religious or historical in nature.

On the right-hand side, another larger building mirrors the condition of those in the center, with a visible cartwheel leaning against it, further emphasizing the rural nature of this setting.

In the background, we can just make out a hazy landscape with another structure that could be a ship or boat on the water, creating a sense of continuation of this tranquil, though somewhat melancholic environment.

Overall, the sky is bright with hints of cloud, suggesting it might be an early morning or a late afternoon. The artwork employs a somewhat muted color palette, conveying a calm, peaceful, yet old and worn atmosphere.

Created by gpt-4o-2024-05-13 on 2025-03-08

This image is an idyllic landscape painting depicting a serene riverside scene with rustic buildings. On the left, a tall tree stands near an old stone building with a thatched roof and an open wooden structure, possibly a boathouse, where some nets and tools can be seen. The building appears weathered and has vines or greenery growing on it.

To the right of the image, there is another weathered stone building with a gabled roof. Leaning against this building are wooden wheelbarrows and other farming equipment.

In the center of the painting is a calm river, on which a small rowboat with a lone figure is floating. The river stretches into the distance, where another boat with two figures standing and fishing is visible. The far background of the painting consists of a distant, hazy mountainous horizon.

The overall color scheme of the painting includes earthy tones of brown and green for the buildings and foreground, softened by the pale blue of the water and sky. The scene evokes a sense of tranquility and a connection to nature and simpler times.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-28

This is a watercolor painting depicting a peaceful waterfront scene with rustic stone buildings along the shore. The buildings appear to be old and weathered, with some featuring thatched or wooden roofs. A slender birch tree with delicate branches leans over the water on the left side of the composition. The water is calm and blue, with a few small boats visible - one in the foreground with a figure rowing, and another in the distance. The landscape extends into misty mountains in the background. The scene has a romantic, pastoral quality typical of 18th or early 19th-century landscape painting. Various details like a wagon wheel and architectural elements add to the rustic charm of the scene. The color palette is predominantly soft blues and browns, creating a serene atmosphere.

Created by claude-3-haiku-20240307 on 2025-01-15

The image depicts a scenic, historical landscape with various architectural elements. It appears to be a painting or illustration featuring a body of water, likely a river or lake, surrounded by stone buildings, cottages, and other structures. There are people visible in boats on the water, and trees and other foliage around the buildings. The overall style and composition suggest this is a depiction of an idyllic, picturesque European village or town setting from a past era.

Created by claude-3-5-sonnet-20241022 on 2025-01-15

This is a pastoral watercolor painting depicting a peaceful waterfront scene. The composition shows several rustic stone buildings along the shore, with a slender birch tree in the foreground on the left side. There are small boats on the calm water, with a figure in one boat near the center. The architecture appears to be medieval or rustic European in style, with stone walls and distinctive chimneys. In the background, there are distant mountains or hills under a pale blue sky. The overall mood is tranquil and romantic, typical of 18th or 19th century landscape painting. Along the shoreline, there are rocks and reeds, and a wooden cart wheel can be seen in the lower right corner of the image. The color palette is soft and muted, with browns, blues, and pale yellows dominating the scene.

Created by claude-3-opus-20240229 on 2025-01-15

The image depicts a tranquil coastal village scene, likely from the 18th or 19th century based on the architectural style. Stone or brick buildings with tiled roofs are clustered along the shoreline. A small wooden boat with figures in it can be seen in the calm waters, while a couple other boats are docked or pulled up on shore.

The village is surrounded by lush trees and foliage, with some sparse white flowering trees in the foreground, adding to the peaceful, rustic atmosphere. The colors are muted and earthy, dominated by shades of brown, tan and green, giving the painting an antique, timeless quality.

Overall, it conveys an idyllic, picturesque scene of a bygone era and simpler way of life in a quaint European fishing village. The composition and delicate details invite the viewer to imagine stepping back in time to this charming setting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-15

The image depicts a serene scene of a river with a small boat and a person rowing, set against the backdrop of a quaint village. The river is calm and peaceful, with a few rocks scattered along its banks. In the foreground, a small wooden boat is visible, with a person sitting in it, rowing gently. The person is dressed in simple clothing, suggesting a rustic or rural setting.

In the background, a charming village can be seen, with several buildings and structures that appear to be made of stone or brick. The buildings are adorned with windows, doors, and chimneys, giving them a cozy and inviting appearance. The village is surrounded by trees and greenery, adding to the natural beauty of the scene.

The overall atmosphere of the image is one of tranquility and peacefulness, evoking a sense of simplicity and contentment. The use of muted colors and soft lighting adds to the serene ambiance, creating a sense of calmness and relaxation. The image appears to be a painting or drawing, with bold brushstrokes and vivid colors that bring the scene to life.

Overall, the image is a beautiful representation of a peaceful and idyllic scene, inviting the viewer to step into its serene and tranquil world.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-15

The image depicts a serene landscape featuring a river, buildings, and boats. The river is the central element, with a few boats navigating through it. On the left bank, there are several buildings, including a large stone structure with a tower, a smaller stone building, and a wooden shed. A tree stands tall on the left side of the image, adding to the natural beauty of the scene.

In the background, the sky is a soft blue, with a few clouds scattered about. The overall atmosphere of the image is one of tranquility and peace, inviting the viewer to step into the idyllic world depicted.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-15

The painting depicts a serene scene of a lake with a person fishing in a small boat. The person is wearing a hat and holding a fishing rod. There are rocks on the left side of the lake, and a tree is standing on the left side. On the right side, there is a stone wall with a wheel and a broken wooden chair. The sky is clear and blue, and the overall atmosphere is peaceful and calm.

Created by amazon.nova-lite-v1:0 on 2025-01-15

The image is a painting of a riverside scene. It depicts a small town or village situated on the edge of a river. The town features several buildings, including a church with a tower and a small house with a thatched roof. There are also some trees and a small boat on the river, with a person rowing it. The painting has a slightly blurry effect, giving it a dreamy and nostalgic feel. The overall composition is reminiscent of a landscape painting from the 19th century.

Created by amazon.nova-lite-v1:0 on 2025-01-12

The image is a painting of a landscape with a castle on the left side, a tower on the right side, and a boat sailing on the water in the middle. The castle has a tower on top and a chimney on the side. The tower on the right side has a wheel on the ground. The boat is sailing on the water, and there are two people on it. The water is calm, and there are trees and plants on the shore.

Created by amazon.nova-pro-v1:0 on 2025-01-12

The painting depicts a serene landscape with a river flowing through it. On the left side, there is a large building with a tower, and a smaller building with a thatched roof is located in front of it. A tree is standing next to the smaller building. A person is sitting on a boat in the middle of the river, holding a fishing rod. On the right side, there is a building with a wheel.

Google Gemini

Created by gemini-2.0-flash on 2025-05-15

The painting presents a serene waterside scene with a mix of man-made structures and natural elements under a soft, muted sky.

On the left side of the image, a cluster of buildings dominates the landscape. These structures appear to be old and constructed of stone, with various additions and alterations over time. One building features a covered shed extending from its side, which seems to house some kind of machinery or tools. Vegetation, including ivy and small trees, has taken root on the rooftops and walls, indicating the buildings' age and the natural processes reclaiming them.

A delicate tree stands to the side of the buildings, its branches reaching upwards with sparse, light-colored leaves. The tree adds a touch of natural beauty to the scene, contrasting with the solidity of the stone structures.

In the foreground, a body of water reflects the sky's soft colors. A small boat is visible in the water, occupied by a person who seems to be navigating the waters. The water's surface is calm, with subtle ripples and reflections.

On the right side of the image, another stone building is positioned. It's partially obscured by foliage and appears to be in a state of disrepair. The building has visible windows and architectural details, hinting at its past grandeur. A discarded wooden wheel leans against the building, adding a sense of abandonment and decay.

In the distance, figures can be seen fishing by the shoreline, and possibly some more buildings on the other side of the water. The backdrop consists of a soft, hazy sky with gentle gradations of color, contributing to the overall tranquility of the scene.

Created by gemini-2.0-flash-lite on 2025-05-15

Here's a description of the image:

Overall Impression:

The image is a charming watercolor painting depicting a serene waterside scene, likely from an older era. The style suggests a somewhat romantic and idyllic view.

Detailed Breakdown:

  • Architecture: There are buildings with a rustic, stone-like texture. They appear old, with some structures in partial ruin or covered in vegetation, lending a sense of history. Some of the buildings have thatched or weathered roofs.
  • Water and Boats: A body of water, perhaps a lake or a river, dominates the foreground. Two small boats with people can be seen in the water. A small boat in the mid-foreground is being rowed by a person. Two other people in the distance seem to be fishing.
  • Landscape: The shoreline on the left side is rocky. There's a single tree on the left side of the picture, with branches that appear to be dead. Further into the distance, a hazy skyline hints at other structures or a distant city. The composition is framed by a sky gradient that goes from a soft light blue to a more white hue.
  • Atmosphere: The painting exudes a peaceful, quiet ambiance. The colors are soft and muted, enhancing the calm nature of the scene.

In summary: The painting is an elegant, well-composed image of a European style waterfront.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The image depicts a serene and picturesque waterfront scene, likely from a historical or rural setting. Here's a detailed description:

  1. Buildings and Structures:

    • On the left side, there are two prominent stone buildings with sloped roofs. The building closest to the viewer has a wooden extension or shed attached to it.
    • To the right, there is another stone structure with a wooden wheel leaning against it, suggesting it might be part of a mill or similar building.
    • In the background, a tower or turret is visible, adding to the rustic charm of the scene.
  2. Water and Boats:

    • A calm body of water occupies the foreground and middle ground of the image.
    • Several small boats are present: one with a person rowing in the foreground, and a few more further out on the water, including a sailboat.
    • The water reflects the buildings and the sky, enhancing the tranquil atmosphere.
  3. Vegetation:

    • There are trees and shrubs scattered throughout the scene. A large tree with sparse foliage stands prominently on the left side.
    • The vegetation adds a touch of nature to the otherwise man-made landscape.
  4. Sky and Background:

    • The sky is clear with a soft gradient of colors, suggesting either early morning or late afternoon.
    • In the distance, faint outlines of mountains or hills can be seen, providing depth to the scene.
  5. Additional Details:

    • There are various objects and elements that add to the scene's authenticity, such as the wooden wheel, fishing nets, and rocks along the shore.
    • The overall color palette is muted, with earthy tones dominating the buildings and natural elements.

This image captures a peaceful moment in a rural or coastal village, highlighting the harmony between human structures and the natural environment.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-09

This image is a painting depicting a serene riverside scene. It features a variety of buildings, including a stone house with a thatched roof on the left, a small wooden structure resembling a mill, and a larger castle-like building on the right. The stone house has a gate and what appears to be a cobblestone path leading to it. The wooden structure has a wheel resting against it, suggesting it could be a mill or a similar structure used for grinding grain.

In the foreground, there is a river with a small boat carrying two figures. The riverbanks are adorned with rocks, trees, and bushes, adding to the natural beauty of the scene. The background includes a distant landscape with mountains under a light blue sky, which evokes a sense of tranquility and distance. The overall color palette of the painting is soft and muted, with earthy tones and pastel hues, giving it an antique and timeless feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-09

This is a painted landscape depicting a serene, rural scene with a body of water in the foreground. There are several small, rustic buildings made of stone or brick, with thatched or tiled roofs. The buildings appear aged and weathered, giving the scene an old-world charm.

In the foreground, there is a small boat with a person rowing, and another boat further out on the water with two figures standing. The water is calm, reflecting the peaceful atmosphere of the scene. To the left, there is a tree with sparse foliage, and some rocks and grass near the water's edge. On the right side, there is a larger building with a slanted roof and a wheel leaning against it.

The background features a clear sky with some clouds, and a hint of distant hills or mountains. The overall color palette is muted, with earthy tones dominating the scene, enhancing the tranquil and rustic ambiance.