Human Generated Data

Title

Market Scene with Figures and Buildings

Date

19th-20th century

People

Artist: Denman Waldo Ross, American 1853 - 1935

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.731

Human Generated Data

Title

Market Scene with Figures and Buildings

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

19th-20th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.731

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Human 99.7
Art 99.5
Building 67.1
Architecture 65.1
Back 59

Clarifai
created on 2020-04-23

people 99.8
painting 99.8
adult 98.9
child 98.9
group 98.7
art 98.7
religion 98.3
woman 98.1
print 98
son 97.3
man 97.2
wear 95.6
family 95.4
calamity 94.5
veil 90.9
illustration 90.4
home 89.9
ceremony 89
famine 88.9
boy 87.8

Imagga
created on 2020-04-23

tourist 44.3
traveler 35.3
person 31.1
old 17.4
people 15.6
man 14.1
architecture 14.1
temple 13.7
child 13.6
religion 13.4
male 12.2
building 12
travel 12
ancient 11.2
stone 11
house 10.9
traditional 10.8
wall 10.4
culture 10.3
vintage 9.9
art 9.8
sculpture 9.8
portrait 9.7
happy 9.4
religious 9.4
holiday 9.3
tree 9.3
fan 9.2
park 9.2
outdoors 9.1
history 8.9
brick 8.9
standing 8.7
love 8.7
men 8.6
statue 8.6
dress 8.1
women 7.9
couple 7.8
summer 7.7
outdoor 7.6
city 7.5
follower 7.5
peace 7.3
smiling 7.2
color 7.2
family 7.1
interior 7.1

Google
created on 2020-04-23

Painting 95.8
Art 82.2
Visual arts 77.4
Picture frame 74.4
Artwork 55.2

Microsoft
created on 2020-04-23

painting 98.6
person 97.1
clothing 91.1
drawing 89.3
text 88.9
human face 69.8
several 10.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-51
Gender Male, 64.9%
Sad 1.4%
Fear 1.2%
Confused 0.6%
Angry 7.2%
Surprised 2.6%
Happy 42.6%
Calm 43.9%
Disgusted 0.5%

AWS Rekognition

Age 46-64
Gender Female, 50.4%
Disgusted 45%
Confused 45.1%
Angry 47.5%
Sad 46.6%
Happy 45.5%
Fear 47.2%
Calm 46.5%
Surprised 46.6%

AWS Rekognition

Age 16-28
Gender Female, 54.5%
Disgusted 45.2%
Confused 45.1%
Happy 45.4%
Surprised 45.1%
Angry 51.7%
Fear 45.1%
Sad 45.7%
Calm 46.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting

Clarifai

Clothing
Picture frame
Human face
Man
Tree
Footwear

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 93.4%

AWS Rekognition

Person 88.2%

AWS Rekognition

Person 80.2%

AWS Rekognition

Person 77.4%

AWS Rekognition

Painting 99.5%

Clarifai

Clothing 79%

Clarifai

Clothing 75.6%

Clarifai

Clothing 70.9%

Clarifai

Clothing 69.9%

Clarifai

Clothing 64.3%

Clarifai

Clothing 59.4%

Clarifai

Clothing 50.2%

Clarifai

Clothing 48.5%

Clarifai

Clothing 46.9%

Clarifai

Clothing 37.7%

Clarifai

Clothing 33.6%

Clarifai

Picture frame 76.8%

Clarifai

Human face 74.7%

Clarifai

Human face 73.2%

Clarifai

Human face 69.2%

Clarifai

Human face 67.9%

Clarifai

Human face 56.1%

Clarifai

Human face 46.8%

Clarifai

Human face 44.4%

Clarifai

Human face 34.7%

Clarifai

Man 61.4%

Clarifai

Man 53.9%

Clarifai

Man 44.4%

Clarifai

Tree 58.8%

Clarifai

Tree 38.6%

Clarifai

Footwear 41.1%

Categories

Imagga
created on 2020-04-23

pets animals 66%
streetview architecture 19.5%
nature landscape 6.3%
paintings art 2.7%
events parties 2.3%
people portraits 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a white shirt

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of people in traditional clothing

OpenAI GPT

Created by gpt-4 on 2024-12-03

This is a painting depicting an outdoor scene with multiple figures who appear to be engaged in a social gathering or a market setting. The artwork is rendered in an impressionistic style, characterized by visible brushstrokes and a vibrant portrayal of light and shadow. Several individuals are standing, and some are clad in colorful clothing, which adds to the liveliness of the scene.

In the foreground, a variety of objects, possibly goods for sale, such as fruits or flowers, are scattered on the ground on what looks like cloths or mats. The architecture in the background suggests a series of buildings with pillars, and there are trees that contribute to the suggestion of an outdoor, possibly tropical, environment.

The canvas has visible unpainted edges with holes and markings that hint at it being stretched onto a frame for display. The composition and the brushwork give a sense of movement and the hustle and bustle typically found in public spaces where people congregate for commerce or community events.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-29

This is a painting depicting a scene with several people gathered under what appears to be a columned porch or veranda with white pillars. The painting has an impressionistic style with loose brushstrokes and soft edges. The scene shows a group of people in various colorful clothing, including yellows, reds, and whites. In the foreground, there are some scattered items that look like flowers or produce on the ground. The architecture features classical-style white columns, and there are some green trees or foliage visible in the background against a bluish sky. The painting has a warm, casual atmosphere that suggests a community gathering or market scene. The canvas appears to have a light-colored border or frame, and the overall color palette combines earthy tones with bright accents.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a painting depicting a market or gathering scene with a group of people under a columned structure with white pillars. The painting appears to be set in a warm climate, with some greenery visible in the background. The scene shows several individuals in various casual attire, with some wearing bright colors like orange, yellow, and white. The style is somewhat impressionistic, with loose brushstrokes and a soft, atmospheric quality. In the foreground, there appear to be some scattered items or produce on the ground, painted with touches of green and red. The architecture suggests this might be a colonial-era building or marketplace. The overall color palette is warm and earthy, with highlights of brighter colors throughout the composition.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a lively outdoor scene in what appears to be a tropical or subtropical setting. There are numerous figures visible, all of whom seem to be people of color. The figures are wearing a variety of colorful, seemingly traditional clothing and are engaged in what looks to be some kind of social gathering or celebration taking place under a canopy or structure with a distinctive architectural style. The overall impression is one of vibrant cultural activity and community.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a vibrant painting of a group of people gathered in front of a building, with a prominent figure standing in the foreground. The painting is characterized by its use of warm colors and loose brushstrokes, which convey a sense of energy and movement.

Key Elements:

  • Central Figure: A man stands prominently in the foreground, wearing a white garment with red and white patterns around his waist. He appears to be addressing the group or leading them in some way.
  • Group of People: Behind the central figure, a group of people are gathered, some of whom are seated on the ground while others stand. They are dressed in various attire, including shirts, pants, and skirts.
  • Building: In the background, a building with a red roof and white columns can be seen. The building appears to be some kind of public space or gathering place.
  • Surroundings: The painting also features trees and other foliage in the background, which adds to the overall sense of atmosphere and setting.

Artistic Style:

  • Impressionist Influence: The painting's use of loose brushstrokes and vivid colors suggests an Impressionist influence. This style of painting emphasizes capturing the fleeting effects of light and color.
  • Expressive Brushwork: The artist's brushwork is expressive and dynamic, with visible strokes that add texture and energy to the painting.
  • Color Palette: The color palette is warm and inviting, with shades of brown, yellow, and red dominating the scene. These colors evoke a sense of comfort and familiarity.

Overall Impression:

  • Vibrant and Energetic: The painting exudes a vibrant and energetic atmosphere, capturing the dynamic movement and interaction of the group.
  • Sense of Community: The gathering of people in front of the building suggests a sense of community and social connection.
  • Cultural Significance: The painting may hold cultural significance, as it appears to depict a specific cultural or social context. However, without more information, it is difficult to determine the exact meaning or significance of the painting.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a vibrant painting of a group of people gathered in front of a building, with a focus on the figures and their surroundings.

  • Building:
    • The building is white with red roofs and columns.
    • It appears to be a large structure with multiple rooms or sections.
    • The building is likely a public or community space given its size and the number of people gathered around it.
  • People:
    • There are approximately 15-20 people in the painting, all of whom are dressed in casual attire.
    • Some individuals are standing, while others are sitting or kneeling on the ground.
    • The people appear to be engaged in various activities, such as talking, laughing, or simply enjoying the surroundings.
  • Surroundings:
    • The background of the painting features trees and a blue sky, suggesting a warm and sunny day.
    • The overall atmosphere of the painting is one of relaxation and community, with the people gathered together in a peaceful setting.
  • Color Palette:
    • The painting features a range of colors, including earth tones, blues, and greens.
    • The dominant colors are shades of brown, beige, and tan, which give the painting a warm and natural feel.
  • Style:
    • The painting is executed in a loose, expressive style, with visible brushstrokes and textures.
    • The artist's use of color and composition creates a sense of movement and energy in the painting.

Overall, the image presents a lively and inviting scene of people gathered in a public space, surrounded by nature and enjoying each other's company.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is an oil painting on canvas depicting a scene of people in a public space. The painting is framed in a wooden frame with a golden border. The painting depicts a group of people standing and sitting in a public space, possibly a market or a gathering. The people are dressed in traditional clothing, and some of them are wearing hats. In the foreground, there is a woman sitting on the ground, possibly selling something. The background of the painting shows a building with a red roof and a tree.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The painting depicts a group of people standing in front of a building. The people are dressed in various colors, and some are wearing hats. The building has a red roof and white pillars. There are also some trees in the background. The painting has a blurry effect, and the colors are somewhat muted. The painting is mounted on a canvas with a wooden frame.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image is a painting depicting a group of people gathered near a building with columns, likely a temple or similar structure. The figures are mostly dark-skinned and dressed in various garments, some more traditional than others. In the foreground, there are flowers or garlands laid out on the ground, suggesting a religious or ceremonial context. The overall style of the painting is impressionistic, with visible brushstrokes and a focus on capturing the atmosphere and light of the scene. The painting is stretched on a canvas frame.

Created by gemini-2.0-flash-lite on 2025-04-27

Here's a description of the image:

Overall Impression:

The image is an oil painting, likely a sketch or study, depicting a scene in what appears to be a tropical or subtropical setting. The style is Impressionistic, with loose brushstrokes and a focus on capturing light and atmosphere rather than precise detail. The canvas is unframed, and the edges show the staples used to stretch the canvas onto a wooden frame.

Subject Matter:

The painting depicts a gathering of people, possibly in a public space like a temple or marketplace. The central figures are several men, mostly shirtless, wearing variations of traditional attire like lungis or shorts.

Key Elements and Composition:

  • Figures: The men are the focal point, standing and interacting within the scene. Their dark skin tones contrast with the lighter clothing and surroundings.
  • Architecture: In the background, there's a structure with columns and a red roof, suggesting a temple or building with religious significance.
  • Environment: The color palette suggests a sunny day. Hints of foliage (palm trees, etc.) indicate a tropical climate.
  • Colors and Light: The artist utilizes a warm, earthy color palette with highlights of yellow, red, and blue. The light seems bright, possibly overhead. The loose brushstrokes give a sense of movement and vibrancy.
  • Foreground Details: The lower part of the image shows a group of flower arrangements, which might relate to a ritual or offering at the building.

Possible Interpretation:

The painting could be a scene of daily life, perhaps a market or religious gathering in a South Asian setting. The artist has focused on capturing the feeling of the place and the atmosphere of the gathering, rather than meticulously rendering every detail.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is an impressionistic painting depicting a group of people gathered in front of a building with white columns and a red roof. The scene appears to be set outdoors, likely in a tropical or subtropical location, given the lush greenery and bright, sunny atmosphere.

The people in the painting are dressed in colorful, casual clothing, suggesting a warm climate. Some individuals are standing, while others are sitting or crouching. The figures are rendered with loose, visible brushstrokes, which is characteristic of the impressionistic style. This technique gives the painting a sense of movement and spontaneity.

In the foreground, there are flowers and possibly other offerings on the ground, which might indicate a ceremonial or religious gathering. The overall mood of the painting is vibrant and lively, capturing a moment of communal activity in a picturesque setting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

The image is a painting depicting a group of people in what appears to be a tropical setting. The figures are dressed in colorful, casual attire, with some wearing sarongs and others in lighter, flowing garments. The background features a structure with a red-tiled roof and white columns, suggesting a colonial or historical architectural style. There are palm trees and other greenery, indicating a warm climate. The overall scene has a relaxed, social atmosphere, possibly capturing a moment of everyday life in a tropical locale. The painting is framed with a simple, rustic border, giving it a slightly rustic or artistic feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image depicts a painting of a group of people gathered in front of a building with columns. The scene appears to be set in a warm, possibly tropical location, as suggested by the presence of palm trees and the attire of the people. The building has a classical architectural style with white columns and a red-tiled roof. The people are dressed in casual, colorful clothing, and some are standing while others are sitting. The painting has a loose, impressionistic style with visible brushstrokes and a focus on capturing the atmosphere and mood of the scene rather than precise details. The edges of the canvas are visible, showing the texture of the material and some wear.