Human Generated Data

Title

Untitled (Natchez, Mississippi)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3322

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Natchez, Mississippi)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3322

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Nature 96.6
Outdoors 96.6
Architecture 95.9
Building 95.9
Countryside 95.9
Hut 95.9
Rural 95.9
Shelter 90.3
Housing 86.3
House 79.6
Porch 79.6
Accessories 72.2
Bag 72.2
Soil 61.1
Yard 60.4
Brick 57.3
Shack 57.1
Clothing 56.4
Shorts 56.4
City 56
Road 55.8
Street 55.8
Urban 55.8
Wood 55.5

Clarifai
created on 2018-05-10

people 99.8
home 98.8
group 96.6
group together 96.3
two 93.8
adult 93.4
monochrome 90.4
war 90.4
man 88.9
calamity 88.3
child 86
black and white 82.5
one 81.8
disrepair 81.5
four 80.5
campsite 80.5
family 80.4
no person 79.2
street 78.5
log cabin 78.4

Imagga
created on 2023-10-05

mobile home 100
trailer 100
housing 100
structure 89.4
wheeled vehicle 88.2
vehicle 61.6
conveyance 29.6
old 22.3
wood 17.5
winter 16.2
building 16.1
landscape 14.1
hut 13.6
sky 13.4
architecture 13.3
beach 12.9
empty 12.9
industry 12.8
grunge 12.8
industrial 12.7
trees 12.4
vintage 12.4
track 12.2
cold 12.1
car 11.8
dirty 11.7
house 11.7
transportation 11.7
bench 11.5
retro 11.5
snow 11.3
travel 11.3
sea 10.9
light 10.7
antique 10.4
door 10.2
black 10.2
transport 10
forest 9.6
outdoors 9
shelter 8.7
park 8.2
home 8
steel 8
wooden 7.9
sand 7.9
work 7.8
railway 7.8
construction 7.7
train 7.7
tree 7.7
stone 7.7
path 7.6
fence 7.5
ocean 7.5
environment 7.4
factory 7.4
wall 7.4
vacation 7.4
street 7.4
water 7.3
metal 7.2
aged 7.2
color 7.2
road 7.2
coast 7.2
seat 7.2
grass 7.1
day 7.1
rural 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

ground 98.9
outdoor 98.3
building 89.2

Color Analysis

Feature analysis

Amazon

Person
Handbag

Clarifai

House
Window
Clothing
Footwear
Porch
Plant
Human face

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 96.7%

AWS Rekognition

Handbag 72.2%

Clarifai

House 91.4%

Clarifai

House 85.6%

Clarifai

House 38.9%

Clarifai

Window 79.5%

Clarifai

Window 65%

Clarifai

Window 62.3%

Clarifai

Window 59.7%

Clarifai

Clothing 60.2%

Clarifai

Clothing 46.3%

Clarifai

Footwear 54.7%

Clarifai

Footwear 53.6%

Clarifai

Porch 50.5%

Clarifai

Porch 35.4%

Clarifai

Plant 47.2%

Clarifai

Human face 34.3%

Categories

Imagga
created on 2023-10-05

paintings art 53.9%
nature landscape 17.2%
streetview architecture 11.8%
beaches seaside 7.4%
cars vehicles 3%
interior objects 2.5%
pets animals 2.4%

Captions

Microsoft
created by unknown on 2018-05-10

an old photo of a cage 67.6%
old photo of a cage 61.2%
a black and white photo of a cage 55.8%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a man standing on a porch with a surfboard

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of a woman sitting on the steps of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This black-and-white photograph depicts a simple, weathered wooden house with a raised front porch. A young girl, dressed in a white garment, is sitting on the steps of the porch, appearing deep in thought or forlorn. The porch has uneven wooden boards, and the door in the background has a screen. To the right of the house is a cutout of a white figure, mounted on a base, holding its hand to its head in a gesture. Below the porch, a sign reads "Hot Boiled" with an arrow pointing towards the direction of the house, suggesting the sale of a specific item, possibly food. The ground is bare dirt, with scattered stones and debris around, giving the setting a rugged or impoverished appearance. The house next door shares similar features, underlining the humble nature of the surroundings. Overall, the photo captures a poignant, quiet scene of daily life.

Created by gpt-4o-2024-08-06 on 2025-06-13

The black and white image shows a scene in front of an old wooden house with a weathered exterior. The house is elevated slightly off the ground, supported by simple wooden and stone supports. On the left, a young girl is sitting on the steps leading to the front door, leaning her head on her hands and her elbows on her knees, giving an impression of deep thought or contemplation. The steps and the house appear worn and rugged.

In the center, below the porch, is a handmade wooden sign with the words “Hot Coffee” painted on it, with two arrows pointing to the left. To the right of the house, there is a cut-out figure of a person mounted on a stand, made from a single flat piece of wood. The figure appears to be looked up from the rear to the waist, standing next to a concrete base that helps it remain upright. In the background, another wooden building is partially visible.

The yard in front of the house is barren dirt, scattered with a few rocks and wooden debris. The overall tone of the image is quite stark and portrays a sense of rural or small-town life with an improvised aspect.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image depicts an old, dilapidated wooden building with a porch and steps. In the foreground, there is a person sitting on the steps, and in the background, there is a statue or sculpture of a figure. The scene appears to be in a rural or remote location, with a dirt or gravel surface in the foreground. The overall atmosphere of the image is one of decay and abandonment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph showing a run-down, dilapidated wooden house or building. There appears to be someone sitting on the front steps wearing light-colored clothing. The building has weathered wooden siding and appears to be in poor condition with what looks like a dirt yard or ground in front. On the right side of the image, there appears to be some kind of white cutout or figure mounted on a post. The overall scene suggests poverty or neglect, with the building showing clear signs of disrepair and minimal maintenance.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a woman sitting on the steps of a dilapidated wooden house, with a large white statue of a man in the foreground.

  • The woman is wearing a white dress and has dark hair. She is sitting on the steps of the house, which appears to be in disrepair. The house has a porch with a sign that reads "1st Ward" in white letters. The porch is supported by wooden beams and has a window on the right side.
  • To the right of the house, there is a large white statue of a man. The statue is standing upright and appears to be made of plaster or concrete. It is positioned on a small pedestal and has a hat on its head.
  • In the background, there are other houses and buildings that appear to be in similar states of disrepair. The overall atmosphere of the image suggests that it was taken in a poor or rural area during a time of economic hardship.

The image captures a moment in time, showing the struggles and challenges faced by people living in poverty. It also highlights the importance of preserving historical images and stories, as they can provide valuable insights into the past and help us understand the present.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a woman sitting on the steps of a wooden house, with a sign that reads "Hot Water" and a cutout of a man in the foreground. The woman is dressed in a white dress and has dark hair. She sits on the left side of the steps, facing downward, with her hands clasped together in front of her. The house behind her appears to be made of wood and has a porch with a sign that reads "Hot Water." To the right of the house, there is a cutout of a man standing on a pedestal. The background of the image shows a dirt road or yard in front of the house, with some rocks and debris scattered about. Overall, the image suggests a rural or small-town setting, possibly during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image shows a black-and-white photograph of a house in a rural area. The house is made of wood and has a porch with a wooden railing. There is a woman sitting on the steps of the porch, and a statue of a man is standing in front of the house. The ground in front of the house is covered in dirt and debris, and there are some plants growing on the side. The image has a vintage look, suggesting that it was taken in the past.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows a woman sitting on the steps of a house with a wooden structure. She is wearing a white dress and is holding her head with her left hand. There is a signboard with the text "HOT COPPER" on the front of the house. A statue of a man is standing on the right side of the house. The ground is covered with dirt and rocks.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

The black-and-white image shows a young girl sitting on the steps of a weathered wooden house. The house appears old, with faded paint and worn planks. Underneath the house, a sign with the words "HOT COPIES" is visible, pointing in a direction. To the right of the house, a flat, cutout figure of a person stands on a concrete base. The ground is uneven and dusty, and there is a general sense of neglect and disrepair. The girl is dressed in a light-colored dress and appears to be lost in thought.

Created by gemini-2.0-flash-lite on 2025-06-03

Here's a description of the image:

Overall Scene: The image is a black and white photograph. It shows a humble, weathered wooden building with a porch, and a dirt yard in front. The overall impression is one of rural poverty or hardship.

Main Elements:

  • Person on the Porch: A person, likely a woman, is sitting on the steps of the porch. They appear to be wearing a light-colored dress and are in a contemplative or sad pose, with their head lowered or hand to their face.
  • Building: The building is made of weathered wooden planks. It appears to be in poor condition, with missing or damaged sections. There is a door open, possibly a screen door. A sign reading "Hot Coffee" is pointing toward the building.
  • Cutout Figure: To the right of the building, there's a large, cut-out figure of a person. It's painted white and positioned as if it's standing. It's mounted on a concrete base.
  • Yard: The ground in front of the building is dirt or gravel. There are some scattered rocks and debris, suggesting the area isn't well-maintained.
  • Framing: The photograph has a white border.

Atmosphere/Interpretation: The image has a somber, melancholic feel. It evokes a sense of poverty, isolation, and perhaps the struggles of life in a rural setting. The "Hot Coffee" sign hints at a business or place of gathering, perhaps a small cafe or shop, but the overall scene suggests a hardscrabble existence.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a rustic scene featuring a wooden house with a porch. The house appears to be old and weathered, with visible signs of wear and tear on the exterior walls and steps.

On the porch, a young child is sitting on the steps, facing away from the camera. The child is dressed in light-colored clothing. The porch itself is elevated and supported by wooden posts, with a small sign hanging from one of the posts that reads "GET OFF."

To the right of the porch, there is a life-sized cutout of a person, possibly made from plywood or a similar material. This cutout is standing upright and appears to be wearing a hat and holding something in its hand. The cutout is mounted on a base, which is partially obscured by some rocks and debris.

The ground in front of the house is unpaved and covered in dirt, with some scattered rocks and patches of grass. The overall setting suggests a rural or semi-rural environment.

Qwen

No captions written

Text analysis

Amazon

HOT
HOT copie
copie