Human Generated Data

Title

Fishing Boats on Shore, Dieppe

Date

1887

People

Artist: William Edward Norton, American 1843 - 1916

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard University Collection, 1969.52

Human Generated Data

Title

Fishing Boats on Shore, Dieppe

People

Artist: William Edward Norton, American 1843 - 1916

Date

1887

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard University Collection, 1969.52

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Person 99.7
Human 99.7
Person 98.9
Person 98.7
Person 98.2
Person 98.2
Art 98.1
Painting 98.1
Person 97.4
Person 96.9
Person 96.7
Person 96.1
Person 95.3
Person 95.3
Person 94.5
Person 83.4
Person 80
Person 79.6
Person 77.3
Person 73.5
Person 69
Person 67.5
Transportation 56.1
Military 56.1
Cruiser 56.1
Vehicle 56.1
Ship 56.1
Navy 56.1

Clarifai
created on 2020-04-23

people 99.4
watercraft 98.4
group 98.3
military 97.5
many 95.7
war 95.3
adult 94.6
ship 94.2
flag 93.2
man 92.6
soldier 91.8
warship 91.4
vehicle 90.2
flame 87.2
woman 86.2
weapon 85.5
battle 85.2
accident 84.9
storm 84
ceremony 84

Imagga
created on 2020-04-23

city 20.8
building 19.5
tourism 19
old 18.8
travel 18.3
architecture 18
history 17
seller 16.8
people 16.7
sky 16.6
private 15.3
weapon 13.9
stone 13.7
person 12.6
landmark 12.6
chemical weapon 12.5
pedestrian 12.3
man 12.1
fountain 12.1
water 12
snow 12
street 12
danger 11.8
religion 11.6
tourist 11.6
military 11.6
ancient 11.2
statue 11
sea 10.9
protection 10.9
dirty 10.8
park 10.7
outdoor 10.7
gas 10.6
sculpture 10.5
weapon of mass destruction 10
wall 9.8
destruction 9.8
accident 9.8
structure 9.7
nuclear 9.7
landscape 9.7
rock 9.6
historical 9.4
monument 9.3
ice 9.3
power 9.2
house 9.2
historic 9.2
summer 9
urban 8.7
natural 8.7
fog 8.7
holiday 8.6
construction 8.6
culture 8.5
winter 8.5
town 8.3
color 8.3
umbrella 8.2
mountain 8
stalker 7.9
radioactive 7.8
day 7.8
radiation 7.8
soldier 7.8
toxic 7.8
male 7.8
protective 7.8
horror 7.8
cold 7.7
chemical 7.7
mask 7.7
light 7.5
ocean 7.5
smoke 7.4
lake 7.3
peace 7.3
industrial 7.3
national 7.2
uniform 7.1
season 7

Google
created on 2020-04-23

Painting 71.9
Vehicle 65.6
Boat 63.5
Watercraft 53
Sailboat 52.7
Sail 51.4
Art 50.2

Microsoft
created on 2020-04-23

person 97.2
ship 95.8
group 95.6
people 95.1
outdoor 93.7
text 88
painting 77.4
watercraft 63.6
boat 62.8
rain 59.7
crowd 44.6
rainy 21.6
several 10.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 24-38
Gender Male, 54.4%
Fear 45%
Happy 45.2%
Confused 45%
Sad 45.2%
Angry 45%
Surprised 45%
Disgusted 45%
Calm 54.5%

AWS Rekognition

Age 55-73
Gender Male, 50.2%
Calm 49.5%
Surprised 49.6%
Happy 49.5%
Sad 49.6%
Disgusted 49.5%
Confused 49.7%
Angry 49.6%
Fear 50%

AWS Rekognition

Age 14-26
Gender Female, 50.1%
Fear 49.5%
Calm 50.2%
Sad 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.7%
Angry 49.5%
Surprised 49.6%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Fear 49.5%
Sad 49.6%
Surprised 49.6%
Disgusted 49.5%
Calm 50.2%
Happy 49.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 42-60
Gender Female, 50%
Sad 49.5%
Happy 50%
Confused 49.6%
Angry 49.6%
Calm 49.5%
Surprised 49.8%
Fear 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-40
Gender Female, 50.1%
Surprised 49.6%
Angry 49.6%
Fear 49.5%
Disgusted 49.5%
Happy 50%
Calm 49.6%
Confused 49.5%
Sad 49.7%

AWS Rekognition

Age 32-48
Gender Female, 50.3%
Disgusted 49.6%
Calm 49.6%
Surprised 49.5%
Angry 49.6%
Happy 49.5%
Sad 49.8%
Confused 49.7%
Fear 49.6%

AWS Rekognition

Age 43-61
Gender Female, 50.4%
Angry 49.5%
Happy 49.5%
Calm 50.4%
Confused 49.5%
Fear 49.5%
Sad 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-40
Gender Male, 50.4%
Fear 49.5%
Confused 49.5%
Calm 49.9%
Sad 50%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 37-55
Gender Male, 50.2%
Disgusted 49.5%
Calm 49.7%
Sad 49.6%
Fear 49.5%
Surprised 49.5%
Confused 50.2%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 31-47
Gender Female, 50.1%
Surprised 49.9%
Confused 49.5%
Disgusted 49.5%
Fear 49.5%
Calm 49.8%
Happy 49.6%
Angry 49.6%
Sad 49.6%

AWS Rekognition

Age 23-37
Gender Male, 50.2%
Angry 49.8%
Fear 49.7%
Disgusted 49.6%
Happy 49.6%
Calm 49.5%
Sad 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 23-37
Gender Female, 50%
Surprised 49.5%
Fear 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.5%
Calm 50.5%
Angry 49.5%

AWS Rekognition

Age 37-55
Gender Male, 50.3%
Disgusted 49.5%
Angry 49.5%
Fear 49.5%
Surprised 49.5%
Sad 50%
Calm 50%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-42
Gender Female, 50.1%
Angry 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Confused 49.6%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 26-40
Gender Male, 50.2%
Confused 50%
Calm 49.6%
Angry 49.5%
Disgusted 49.5%
Fear 49.5%
Surprised 49.6%
Sad 49.6%
Happy 49.6%

AWS Rekognition

Age 30-46
Gender Female, 50.3%
Disgusted 49.5%
Surprised 49.7%
Angry 49.7%
Confused 49.6%
Happy 49.5%
Sad 49.8%
Calm 49.7%
Fear 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.4%
Happy 49.5%
Surprised 49.5%
Sad 49.8%
Calm 49.5%
Disgusted 49.5%
Fear 49.5%
Confused 49.5%
Angry 50.1%

Feature analysis

Amazon

Person
Painting
Person 99.7%
Person 98.9%
Person 98.7%
Person 98.2%
Person 98.2%
Person 97.4%
Person 96.9%
Person 96.7%
Person 96.1%
Person 95.3%
Person 95.3%
Person 94.5%
Person 83.4%
Person 80%
Person 79.6%
Person 77.3%
Person 73.5%
Person 69%
Person 67.5%
Painting 98.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a group of people standing around a fish market -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

The image depicts a bustling harbor scene where a crowd of people are gathered. Many of them are engaged in activities typical of a marketplace, possibly involving the buying and selling of fish, as there are fish visible on the ground. The harbor is filled with large sailboats, and several flags can be seen waving atop the masts of these boats. The attire of the people suggests a historical period, given the traditional and heavy clothing. The overall atmosphere is busy and industrious, capturing a sense of daily life in a coastal community.

Created by gpt-4 on 2024-01-25

The image depicts a bustling fish market at a harbor. A variety of people are gathered around, many likely to be fishermen and buyers. A fish lies on the ground, suggesting the sale and trade of fresh seafood. The background shows several masted ships with sails folded, and flags of different countries flying, indicating a port that accommodates international vessels. The setting appears to be overcast, with a gray sky that suggests a cold or foggy climate. It is painted in a realistic style with a muted color palette, capturing a slice of life by the sea.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a crowded scene of people gathered on a dockside or harbor. There are a number of sailboats and ships visible in the background, with flags and sails fluttering in the wind. The people in the foreground appear to be from various walks of life, wearing a range of clothing styles and representing different social classes. Some are bundled up against the cold weather, while others seem more casually dressed. The overall impression is of a bustling, vibrant scene of activity and movement.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image depicts a painting of a bustling harbor scene, with a large crowd of people gathered on the shore. The crowd is dressed in traditional clothing, with men wearing hats and women wearing long skirts and aprons. In the foreground, several people are standing near a pile of fish, while others are engaged in conversation or looking out at the water.

In the background, several large ships are visible, their sails billowing in the wind. The sky above is overcast, with dark clouds gathering on the horizon. The overall atmosphere of the painting is one of activity and energy, capturing the vibrant spirit of a bustling harbor town.

The painting's style is reminiscent of Impressionism, with loose brushstrokes and vivid colors used to convey the sense of movement and life in the scene. The artist's use of light and shadow adds depth and dimension to the painting, drawing the viewer's eye through the crowded harbor and out to the ships at sea.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a bustling scene of people gathered on a dock, with several boats in the background. The painting is titled "Le Port de Brest" and was created by Eugene Boudin in 1865.

  • People:
    • The people in the painting are dressed in clothing typical of the mid-19th century.
    • They appear to be engaged in various activities, such as fishing, loading cargo, and socializing.
    • The crowd is diverse, with people of different ages and occupations present.
  • Boats:
    • In the background, several boats are visible, including sailboats and possibly a ship.
    • The boats are adorned with flags, adding to the sense of activity and commerce in the scene.
    • The boats appear to be docked or preparing to set sail.
  • Dock:
    • The dock is the central focus of the painting, with the crowd gathered around it.
    • The dock is depicted as a busy and vibrant space, with crates, nets, and other equipment scattered about.
    • The dock appears to be made of stone or wood, with a slight incline to facilitate the loading and unloading of goods.
  • Sky:
    • The sky above the scene is overcast, with clouds that suggest a rainy or stormy day.
    • The sky is depicted in muted tones, which adds to the overall sense of gloominess in the painting.
    • The sky does not dominate the composition, instead serving as a backdrop for the more dynamic elements of the scene.

Overall, "Le Port de Brest" is a vivid depiction of a bustling port scene, with a focus on the people and activities that take place there. The painting captures the energy and vitality of the dock, while also conveying a sense of the challenges and hardships faced by those who work there.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a scene of a bustling fish market on a port. In the foreground, a diverse group of people, including men, women, and children, are gathered around, engaging in lively activities. Some are carrying baskets, while others are inspecting the fresh fish laid out on the ground. The fish market is set against a backdrop of various sailboats and ships docked at the port, some of which have flags fluttering in the wind. The sky above is overcast, adding a somber tone to the scene. The overall atmosphere is one of activity and commerce, with the market serving as a hub of trade and interaction.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a group of people standing on a wet ground, probably a port. Some of them are wearing hats, while others are wearing shoes. Some of them are carrying baskets, while others are holding bags. There are several boats docked in the port, and some of them have flags on their masts. In the distance, there is a ship that seems to be sailing on the water.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The painting depicts a bustling scene at a seaside fish market, likely in France given the French flags displayed on the masts of the fishing boats. The sky is overcast, casting a diffused light over the entire scene.

A crowd of people, mostly dressed in traditional clothing, is gathered near the shore. Many of the women wear white bonnets or head coverings. Some people are bending over, presumably inspecting or purchasing the fish that are laid out on the ground. The fish appear to be mostly rays, with their distinctive wide, flat bodies.

Several fishing boats are visible in the background, their masts adorned with French flags. The boats are of varying sizes, with their sails furled. The overall impression is one of a busy, traditional fishing village, full of activity and a sense of the everyday rhythm of life.

Created by gemini-2.0-flash-lite on 2025-04-26

The image is a painting depicting a bustling scene at a seaside market, likely a fish market. The painting is rendered in a muted palette with grey and brown tones dominating, suggesting a cloudy or overcast day.

Key Elements:

  • Boats: Several fishing boats are visible in the background, their masts and sails partially obscuring the sky. Some boats have flags with vertical stripes (likely French flags), giving a sense of location.
  • People: A large crowd of people fills the foreground and midground. They are dressed in clothing that would be typical for the late 19th century or early 20th century, including working-class attire such as aprons, caps, and bonnets, suggesting a fishing community.
  • Fish: Several large fish are laid out on the ground, indicating the main trade of the market.
  • Atmosphere: The overall impression is one of a busy, working environment. The muted colors, the gathering of people, and the presence of boats evoke a sense of a coastal community. The sky is overcast, giving the painting a realistic, working-class vibe.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a bustling scene at a harbor, likely from the late 19th or early 20th century. The focal point is a group of people gathered near several fishing boats, which are adorned with flags. The boats have large sails and are moored close to the shore.

The crowd consists of men, women, and children, dressed in period clothing. Many of the men appear to be fishermen, wearing work clothes and hats, while some are engaged in conversation or handling fishing equipment. The women are dressed in long skirts and blouses, and some are wearing headscarves or bonnets. Children are also present, adding to the lively atmosphere.

The scene is set on a cloudy day, with a misty or foggy ambiance, which gives the painting a somewhat muted and serene feel. The ground is wet, suggesting recent rain, and there are puddles reflecting the light. The overall mood of the painting is one of everyday life and community, capturing a moment of interaction and activity at the harbor.

Text analysis

Amazon

D:t7