Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4238

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4238

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97.8
Human 97.8
Person 96.7
Person 96.6
Person 93.6
Person 89.5
Building 79.1
Outdoors 74.8
Soil 70.5
Nature 65.5
Archaeology 65.5
Poster 64
Advertisement 64
People 60.1
Vehicle 59.3
Transportation 59.3

Clarifai
created on 2023-10-25

filmstrip 100
negative 100
slide 99.9
movie 99.9
cinematography 99.9
collage 99.8
noisy 99.8
emulsion 99.7
picture frame 99.7
exposed 99.3
blank 99.3
dirty 99.1
photograph 99
margin 98.9
retro 98.9
vintage 98.5
edge 98.3
desktop 97.7
dissonant sound 97.5
sooty 97.3

Imagga
created on 2022-01-08

hole 100
old 40.4
architecture 27.3
ancient 26.8
vintage 25.6
grunge 24.7
texture 22.9
antique 21.6
wall 21.4
building 20.7
retro 20.5
pattern 17.1
dirty 16.3
landmark 16.2
history 16.1
tourism 15.7
brown 15.5
historic 14.7
aged 14.5
sky 14
textured 14
brick 13.9
empty 13.7
stone 13.5
tower 13.4
rusty 13.3
weathered 13.3
structure 13
construction 12.8
art 12.4
surface 12.3
fortress 12.1
famous 12.1
travel 12
frame 11.7
material 11.6
rust 11.6
wooden 11.4
grungy 11.4
design 11.3
culture 11.1
paper 11
rough 10.9
wood 10.8
city 10.8
backdrop 10.7
castle 10.6
metal 10.5
iron 10.3
grain 10.2
film 9.8
damaged 9.5
door 9.5
wallpaper 9.2
backgrounds 8.9
detail 8.8
cinema 8.8
rustic 8.6
obsolete 8.6
blank 8.6
old fashioned 8.6
dark 8.3
window 8.2
style 8.2
border 8.1
scratched 7.8
black 7.8
color 7.8
ruins 7.8
stains 7.8
nobody 7.8
space 7.8
movie 7.8
decay 7.7
medieval 7.7
historical 7.5
monument 7.5
close 7.4
church 7.4
tourist 7.2
negative 7

Google
created on 2022-01-08

Photograph 94.3
Rectangle 90.5
Black 89.5
Line 82.1
Tints and shades 76.6
Snow 75.9
Font 75
Snapshot 74.3
Wood 73.4
Beige 69.4
Collectable 67.5
Paper product 67.4
History 66.5
Square 58.2
Composite material 57.7
Art 56.3
Negative 52.1

Microsoft
created on 2022-01-08

snow 85.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-10
Gender Female, 99.3%
Happy 88.9%
Calm 4.9%
Angry 1.8%
Sad 1.2%
Disgusted 1.1%
Surprised 1%
Fear 0.7%
Confused 0.3%

AWS Rekognition

Age 2-10
Gender Female, 90.7%
Happy 95.7%
Calm 1.1%
Sad 0.7%
Angry 0.7%
Confused 0.5%
Disgusted 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 11-19
Gender Female, 99.9%
Calm 45.6%
Happy 26%
Disgusted 15.9%
Angry 4.9%
Sad 3.9%
Confused 1.6%
Surprised 1.1%
Fear 0.9%

Feature analysis

Amazon

Person
Poster
Person 97.8%
Person 96.7%
Person 96.6%
Person 93.6%
Person 89.5%
Poster 64%

Categories

Imagga

paintings art 99.5%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a couple of people standing in front of a building -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image consists of three sepia-toned frames resembling negatives of photographs. The first frame captures a scene of discarded debris next to a building, including objects like wooden planks and debris piled near a grated area or vent. The second frame shows an open outdoor space, likely an urban lot, with two individuals toward the center standing on what might be dirt or gravel, surrounded by buildings. The third frame features three children standing on a sidewalk, next to a curb and buildings, with shadows indicating daylight. The settings are urban and evoke a historical or vintage feel.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a strip of film negatives, containing three separate photographs.

The first image depicts a scene where debris is piled on the ground against a building, possibly near a loading dock or entrance. Construction materials or refuse are visible against a brick or concrete backdrop.

The second image shows an open area bordered by tall buildings. Two figures stand in the middle of the open space, with a flat, paved or packed-dirt surface around them, while the surrounding buildings loom without much detail.

The third image captures a street scene, with three young children standing on the sidewalk. The street is lined with buildings and has a slightly worn appearance, indicating an urban environment. The children are dressed in clothing typical of the early to mid-20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a collage of three old, sepia-toned photographs.

The first photograph shows a group of people, possibly children, lying on the ground in what looks like a residential or urban setting.

The second photograph depicts a street scene with some people walking in the distance.

The third photograph shows three young children standing together in what seems to be an outdoor, urban environment.

The images have a vintage, historical feel to them, and they appear to be from the same time period, likely early to mid-20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a strip of vintage film negatives or photographs with three distinct images in a sepia or brownish tone. The film strip has the characteristic sprocket holes along the edges. From left to right:

  1. The first frame shows what appears to be some objects or materials against a wall with what might be a vent or grate visible.

  2. The middle frame shows a distant view of two small figures standing in what appears to be an open area or yard.

  3. The third frame shows three figures standing on what appears to be a sidewalk or path.

The overall quality and style of these photographs suggests they were taken many decades ago, possibly in the early 20th century, given the film format and sepia toning characteristic of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a sepia-toned photograph of three children standing on a sidewalk, with a large wall in the background. The photograph is divided into three sections, each showing a different scene.

  • The left section shows a child sitting on the ground, surrounded by trash and debris.
  • The middle section shows two children standing on the sidewalk, with one child holding a stick or broom.
  • The right section shows three children standing together, looking directly at the camera.

The overall atmosphere of the image suggests that it was taken in a poor or impoverished area, possibly during a time of economic hardship. The presence of trash and debris in the left section, as well as the children's casual attire, implies a lack of resources and opportunities. However, the children's smiles and playful demeanor in the right section suggest that they are resilient and able to find joy in difficult circumstances.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image is a sepia-toned photograph of three children standing on a sidewalk, with a building in the background. The photograph is divided into three sections, each showing a different scene.

In the first section, two children are sitting on the ground, looking at something in front of them. In the second section, a child is standing alone, looking down at the ground. In the third section, three children are standing together, looking at the camera.

The background of the photograph shows a building with a brick wall and a window. The overall atmosphere of the photograph suggests that it was taken in an urban setting, possibly in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-30

The image is a strip of film containing three photographs. The first photo shows a person lying on the ground, possibly in a backyard, with a brick wall and a fireplace in the background. The second photo shows a few people standing in an open area, with a building and a staircase in the background. The third photo shows three children standing on a sidewalk, with one of them holding a stick. The film strip has a brown border and a few holes in the middle.

Created by amazon.nova-pro-v1:0 on 2025-05-30

The image is a vintage photograph that consists of three smaller images. The images are arranged horizontally. The first image shows a person lying on the ground, with a pile of clothes and other items nearby. The second image shows two people standing on the sidewalk, with one of them holding a stick. The third image shows three children standing on the sidewalk, with one of them holding a stick.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a strip of three sepia-toned, vintage photographic prints. The prints appear to be frames from a film roll, bordered by the characteristic sprocket holes of the film.

In the first frame, there is a pile of what seems to be discarded or covered items against a wall or building. The wall has a section with brickwork that contains a metal grate.

The second frame features two figures in the distance, likely children or young people, standing on a patch of ground with a brick wall in the background. There is a taller building visible over the wall and a small figure walking on the far side.

The third frame shows three young children standing on a sidewalk. The child on the left is a boy with a long-sleeved shirt and knee-high stockings, holding a rope or string. The child in the middle is a girl with a sweater, a skirt, and a hat or beret. The child on the right is another boy with a sweater and shorts. All three are standing on a paved surface with buildings in the background.

Created by gemini-2.0-flash-lite on 2025-05-16

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage photograph, presented as a strip of film negatives. The sepia tone suggests it's an old photograph, likely from the early to mid-20th century. It appears to capture various scenes from a neighborhood.

Individual Frames/Sections:

  • Frame 1: The initial frame shows a concrete surface. There is a concrete wall on the left, and what appears to be a ventilation grate with a metal cover on the right side. Some cloth-like material is scattered across the surface.
  • Frame 2: This frame depicts an exterior view of a building with two people standing, presumably on the street. There is also another person in the distance, barely visible.
  • Frame 3: This is the most captivating frame as it shows three boys, of the same generation, standing in a pose on a street. They seem to be the focal point of this strip of photos.

Overall Style and Context:

Given the sepia tone, the quality of the picture, and the subjects, it appears to be a candid snapshot from a past era. It potentially portrays aspects of daily life from the neighborhood where the photos were taken.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image appears to be a vintage film strip containing three separate photographs. Here is a detailed description of each frame from left to right:

  1. First Frame: This frame shows a child lying on a snowy surface. The child appears to be wearing winter clothing, including a hat, and is holding a sled. The background includes a brick building with a small barred window.

  2. Second Frame: This frame depicts a child standing on a sidewalk or street. The child is wearing a coat and hat, and there is a dog next to them. The background shows a brick wall and what appears to be a residential area.

  3. Third Frame: This frame features three children standing on a sidewalk or street. The child on the left is wearing a coat and hat, the child in the middle is wearing shorts and a light-colored top, and the child on the right is wearing a sweater and shorts. The background includes a brick building and a staircase leading up to a door.

The overall tone of the images suggests they were taken during the early to mid-20th century, given the style of clothing and the sepia tone of the photographs. The film strip border adds to the vintage feel of the images.