Human Generated Data

Title

Untitled (Natchez, Mississippi)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2589

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Natchez, Mississippi)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2589

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99
Adult 99
Male 99
Man 99
Architecture 98
Building 98
Outdoors 98
Shelter 98
Clothing 96
Hat 96
Window 95.4
People 89.4
Home Decor 57.4
Housing 57
Animal 56.8
Pet 56.8
Canine 56.7
Mammal 56.7
Curtain 56.5
Photographer 56.3
Vest 55.3
Shutter 55.3
Cap 55.3
Sitting 55

Clarifai
created on 2018-05-10

people 99.8
adult 98.9
one 97
group 96.5
man 96
two 95.8
wear 93.7
family 92.4
woman 92.4
portrait 90.6
home 89.7
facial expression 86.8
child 84.8
leader 84.4
furniture 83.2
vehicle 83.1
sit 80.4
building 80.3
group together 80.2
wood 78.9

Imagga
created on 2023-10-05

windowsill 35.5
sill 32.2
building 31.3
old 28.5
house 27.6
architecture 25.9
structure 24.9
structural member 24.3
wall 23.8
window 22.2
wooden 19.3
support 18.8
door 17
wood 16.7
city 15.8
balcony 14.8
wheeled vehicle 14.5
urban 14
device 13.3
exterior 12.9
home 12.8
windows 12.5
vehicle 12.4
graffito 12.3
roof 11.7
brick 11.4
window screen 11.4
glass 10.9
decoration 10.1
outdoor 9.9
sky 9.6
stone 9.3
tourism 9.1
paint 9
dirty 9
protective covering 8.9
closed 8.7
architectural 8.6
screen 8.6
hut 8.6
outside 8.6
construction 8.5
weathered 8.5
grunge 8.5
outdoors 8.2
vacation 8.2
aged 8.1
freight car 8
conveyance 7.9
billboard 7.8
travel 7.7
entrance 7.7
texture 7.6
frame 7.6
snow 7.5
step 7.5
town 7.4
man 7.4
street 7.4
design 7.3
board 7.1
stairs 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

building 99.9
outdoor 98.8
deck 85.3
black 70.3
porch 52.1
roof 36.9
step 25.6

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 44.2%
Disgusted 16.4%
Sad 12.9%
Surprised 11.8%
Happy 8%
Fear 6.7%
Angry 4.8%
Confused 3.1%

AWS Rekognition

Age 52-60
Gender Male, 98.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.2%
Confused 0.2%
Disgusted 0%
Angry 0%
Happy 0%

Microsoft Cognitive Services

Age 46
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Person 99.2%
Person 99%
Adult 99.2%
Adult 99%
Male 99.2%
Male 99%
Man 99.2%
Man 99%

Categories

Imagga

paintings art 77.8%
text visuals 21.9%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and a woman are looking out the window -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image shows two individuals leaning out of the open windows of a wooden building. The building features horizontal wooden planks as siding, and the window frames are simple and rectangular. The individual on the right is wearing a light-colored shirt, dark vest, and a hat. The structure has a weathered appearance, suggesting it may be older or rustic. The image is captured in black and white, adding to the historical or vintage feel.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts two individuals leaning out of a wooden-framed window of a building with horizontal siding. The individual on the left is wearing a patterned shirt, while the individual on the right is dressed in a white shirt and vest and is wearing a hat. The window consists of multiple panes of glass, and one pane appears to be missing or open, allowing the individuals to lean through. The scene has a vintage, historical feel, possibly indicative of an earlier time period.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows two older men sitting in a window frame of a wooden building. They appear to be looking out the window, with one man wearing a hat and the other man having a more weathered appearance. The building has a rustic, dilapidated look, with wooden slats and a simple frame structure. The overall scene conveys a sense of age and the passing of time.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white historical photograph showing two people looking out of a window of what appears to be a wooden building with horizontal siding. One person is wearing a hat and white shirt with what looks like a vest, and appears to be holding something in their hands, possibly a pipe or cigarette. Both individuals are framed within the window opening, creating an interesting compositional element. The photograph has the grainy, documentary quality typical of early to mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts an elderly Black couple peering out of a window of a wooden house. The man, wearing a hat, vest, and white shirt, is holding a cane in his right hand. The woman, with short hair and a plaid shirt, stands beside him. The window is open, and the couple appears to be looking outside.

The image is a black-and-white photograph, and the wooden house has a slanted roof and clapboard siding. The overall atmosphere of the image suggests that the couple is observing something outside, possibly a scene of everyday life or a significant event. The image provides a glimpse into the lives of the couple, who are likely experiencing a moment of quiet contemplation or observation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of two individuals, an elderly woman and a man, peering out of a window on the second floor of a wooden building. The woman, positioned on the left, has short white hair and wears a plaid shirt. The man, situated on the right, sports a hat, a white shirt, and a dark vest, while holding a cigar in his right hand.

The window, which is open, features two panes of glass, with the left pane being larger than the right. The surrounding wall is constructed from horizontal wooden planks, and the overall atmosphere of the image exudes a sense of nostalgia and simplicity.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image shows two people, a man and a woman, sitting in the window of a wooden house. The man is wearing a hat and a vest, while the woman is wearing a long-sleeved shirt. They are both looking out of the window, and the woman is holding the window frame with her left hand. The window has a wooden frame and is open, allowing light to enter the room. The house has a wooden exterior and is located in a rural area.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white photo shows two elderly men in a house. They are both leaning on the window sill, with one of them wearing a hat and a vest. The man on the left is wearing a plaid shirt and is looking at something on the left side. The man on the right is holding a cigar in his right hand. They are both looking at something outside the window.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-07

Here is a description of the image:

The image is a black and white photograph. The scene is focused on a wooden building's window, where two people are looking out. The window is open, and both individuals lean on the ledge.

On the left, an elderly woman with white hair peers out of the window. She wears a checkered shirt. Beside her, on the right, a man with a hat, a white shirt, and a vest looks straight ahead. He is holding something in his hands, seemingly gesturing.

The wooden siding of the building is visible around the window, and the angle suggests it may be an older structure. The overall impression is one of an intimate moment captured in a historical context.

Created by gemini-2.0-flash on 2025-05-07

The black and white photograph depicts two African-American individuals peering out from a window in a weathered wooden house. The house's exterior is constructed with horizontally aligned wooden planks.

To the left of the window is an elderly woman with gray hair. She is wearing a checkered shirt and rests her arms on the window ledge. Her expression seems somber and contemplative. To her right, a younger man stands beside her. He is dressed in a white shirt, a dark vest, and a hat, and he clasps his hands together. His expression is more serious.

The window is a multi-paned, rectangular frame with the upper portion open, revealing a view to the outside. Another window is visible to the right, also with panes.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring two individuals looking out of an open window of a wooden building. The building appears to be made of horizontal wooden planks.

  • The person on the left is an older individual with short, light-colored hair, wearing a patterned shirt. They are leaning on the window sill with their arms resting on it.
  • The person on the right is wearing a hat and a vest over a light-colored shirt. They are holding what appears to be a pipe in their hand.

The window is open, with the top part propped up, allowing the two individuals to look out. The overall setting suggests a rustic or rural environment, possibly from an earlier time period given the style of clothing and the black-and-white nature of the photograph.