Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4622.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4622.1-2

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Interior Design 100
Indoors 100
Human 99.4
Electronics 92.9
Display 92.9
Screen 92.9
Room 91.6
Theater 71
People 66.1
Cinema 62.9

Clarifai
created on 2023-10-25

movie 99.8
slide 99
negative 99
screen 98.8
art 98.3
retro 97.5
collage 97.4
filmstrip 97.4
analogue 97.3
picture frame 97.1
photograph 96.4
video 95.7
old 95.7
exposed 95.7
vintage 95.5
window 93.8
dirty 93.6
noisy 93.6
moment 93.1
analog 93

Imagga
created on 2022-01-08

monitor 93.4
electronic equipment 70.1
equipment 49.7
liquid crystal display 35.3
billboard 26.9
signboard 21.2
screen 20.8
film 20.2
border 19.9
vintage 19.8
structure 19.7
computer 19.5
digital 19.4
collage 19.3
frame 18.3
design 18
black 17.4
old 17.4
grunge 17
retro 16.4
text 15.7
movie 15.5
your 15.5
dirty 15.4
graphic 14.6
texture 14.6
business 14.6
art 14.3
city 14.1
space 14
noise 13.7
pattern 13.7
rough 13.7
scratch 13.7
car 13.5
rust 13.5
grungy 13.3
scratches 12.8
photographic 12.7
frames 12.7
slide 12.7
negative 12.7
strip 12.6
edge 12.5
damaged 12.4
hand 12.2
antique 12.1
entertainment 12
finance 11.8
designed 11.8
architecture 11.7
weathered 11.4
display 10.9
noisy 10.8
road 10.8
blackboard 10.6
detailed 10.6
office 10.6
mask 10.5
technology 10.4
television 10.3
camera 10.2
paint 10
highly 9.8
layered 9.8
mess 9.8
night 9.8
messy 9.7
layer 9.7
urban 9.6
dirt 9.5
closeup 9.4
paper 9.4
dollar 9.3
street 9.2
banking 9.2
close 9.1
modern 9.1
landmark 9
material 8.9
financial 8.9
projects 8.9
decoration 8.7
us 8.7
bridge 8.6
media 8.6
bill 8.6
destination 8.4
evening 8.4
element 8.3
global 8.2
symbol 8.1
bank 8.1
success 8
freight car 8
overlay 7.9
blank 7.7
money 7.7
cityscape 7.6
communication 7.6
sign 7.5
electronic 7.5
water 7.3
speed 7.3
building 7.2
color 7.2
currency 7.2

Google
created on 2022-01-08

Rectangle 86.3
Tree 84.3
Font 80.8
Display device 75.8
Multimedia 71.3
Monochrome photography 68.1
Event 67.3
Winter 67.3
Monochrome 66.6
Snow 62.8
Room 62.5
Twig 61.8
Visual arts 61.7
Media 56.2
City 56
Photographic paper 54.4
Freezing 53.1

Microsoft
created on 2022-01-08

screenshot 95.2
text 94.2
television 52.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 97.1%
Happy 85.6%
Sad 8.4%
Calm 1.6%
Fear 1.6%
Surprised 0.9%
Disgusted 0.8%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 83.1%
Happy 12%
Sad 1.2%
Disgusted 1.1%
Surprised 1.1%
Angry 0.6%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 98.5%
Sad 0.5%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 97.6%
Calm 70.1%
Sad 16.7%
Confused 7.7%
Happy 1.7%
Angry 1.4%
Disgusted 1.1%
Surprised 0.7%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Calm 71.1%
Happy 9.9%
Sad 9.6%
Confused 5.8%
Disgusted 1.2%
Surprised 0.9%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 16-24
Gender Female, 85.4%
Calm 84.2%
Sad 14.7%
Happy 0.4%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 43-51
Gender Male, 89.3%
Calm 93.8%
Happy 3.5%
Sad 1%
Disgusted 0.6%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 16-24
Gender Male, 89.9%
Calm 52%
Angry 27.7%
Sad 7.3%
Fear 4.8%
Disgusted 2.4%
Happy 2.1%
Surprised 2%
Confused 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Monitor

Clarifai

Clothing
Person
Human face
Window
Picture frame
Man

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 94.1%

AWS Rekognition

Person 79.7%

AWS Rekognition

Person 56.5%

AWS Rekognition

Person 52.1%

AWS Rekognition

Monitor 92.9%

Clarifai

Clothing 54.5%

Clarifai

Clothing 54.1%

Clarifai

Clothing 48.2%

Clarifai

Clothing 45.6%

Clarifai

Person 53.7%

Clarifai

Person 48.6%

Clarifai

Human face 52.8%

Clarifai

Human face 51.7%

Clarifai

Human face 49.5%

Clarifai

Human face 41.8%

Clarifai

Human face 40.6%

Clarifai

Human face 34.6%

Clarifai

Window 52.5%

Clarifai

Window 35.2%

Clarifai

Window 34.4%

Clarifai

Picture frame 49.5%

Clarifai

Man 49.3%

Categories

Imagga
created on 2022-01-08

text visuals 76.5%
interior objects 11.1%
paintings art 4.8%
nature landscape 4%
streetview architecture 2.4%

Captions

Microsoft
created by unknown on 2022-01-08

graphical user interface, website 96.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

photograph of the crowd gathered around the statue.

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a black and white photo of a group of people in a city

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image captures two black-and-white film frames featuring a street scene, likely during a festive event or parade. The street is lined with traditional architecture, and both frames prominently display decorative arches made of balloons and festive elements. Crowds of people are gathered, some dressed in formal attire, suggesting a ceremonial or celebratory occasion. Flags and other decorations add to the lively atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image is composed of two black-and-white frames from a film strip labeled "SUPER XX." Both frames capture a busy street scene likely during a festival or parade.

In the left frame, several people are gathered on the street. They are dressed formally, with some wearing suits. The street is lined with buildings, and there are decorations hanging overhead, possibly indicating a festive atmosphere.

In the right frame, the view shifts to show more of the street and crowd. A large arch made of garlands or similar decorative elements spans the street. The crowd is dense, with many people standing close together, and there are flags visible among the decorations. The buildings lining the street have fire escapes, adding to the urban setting. The overall scene conveys a sense of celebration and public gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a film strip containing two black and white photographs. The left photograph shows a crowd of people gathered on a city street, possibly for some kind of celebration or event. The right photograph depicts a street lined with buildings decorated with what looks like festive lighting or decorations, suggesting a celebratory atmosphere as well. The overall impression is of a lively, crowded urban scene from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage film strip or contact sheet containing two black and white photographs, labeled as frames 13 and 14. The images appear to be from what looks like a street celebration or festival, possibly in an urban setting like New York's Little Italy, given the architectural style and decorations. The street is adorned with elaborate archways or decorative structures made up of what appear to be balloons or round ornaments. There are crowds of people on the street, and the buildings visible are typical early 20th century urban architecture with fire escapes visible on their facades. The images have that characteristic grainy, vintage quality typical of older film photography. The film strip is marked "SUPER XX" which was a type of Kodak film popular in the mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a parade or celebration, captured on a Super XX film strip. The scene depicts a crowd of people gathered on the street, with buildings lining the background. The atmosphere appears festive, with balloons and other decorations visible in the scene.

Key Features:

  • Film Strip: The image is presented on a Super XX film strip, which was a type of film used for photography in the past.
  • Black-and-White Photography: The image is in black and white, which was a common format for photography before the advent of color film.
  • Parade or Celebration: The scene appears to be a parade or celebration, with a crowd of people gathered on the street and decorations such as balloons visible.
  • Buildings: The background of the image features buildings that line the street, adding context to the scene.
  • Atmosphere: The atmosphere of the image is festive, suggesting that the event is a joyful occasion.

Overall:

The image provides a glimpse into a past event or celebration, captured on film and preserved for future generations. The use of black and white photography adds a nostalgic touch to the image, while the festive atmosphere suggests that the event was a significant and enjoyable occasion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image presents a black-and-white film strip featuring two photographs of a street scene. The left photograph depicts a group of men in suits standing on the sidewalk, while the right photograph shows a crowd of people gathered in front of a building adorned with balloons and streamers.

Key Features:

  • Film Strip: The image is presented as a film strip, with the photographs separated by a thin black border.
  • Photographs: The two photographs are identical in size and composition, with the left photograph showing a group of men in suits and the right photograph showing a crowd of people in front of a building.
  • Street Scene: The street scene depicted in the photographs appears to be a celebratory event, with balloons and streamers decorating the building and a crowd of people gathered in front of it.
  • Black-and-White: The image is presented in black and white, which adds to the nostalgic and vintage feel of the film strip.

Overall Impression:

The image presents a charming and nostalgic view of a street scene, with the film strip format adding to the retro feel. The photographs appear to be from a bygone era, and the black-and-white color scheme enhances the sense of nostalgia.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The image shows a black-and-white photo of a film strip. It is divided into two sections, with the left side featuring a group of people standing in front of a building, while the right side shows a crowd of people gathered in front of another building. The left side of the film strip has a number "13" and the text "SUPER XX" printed on it, while the right side has a number "14" and the text "EL" printed on it.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The image is a black-and-white film strip with two frames. The left frame shows a group of people in formal attire, possibly gathered for an event. The individuals are dressed in suits and ties, suggesting a formal occasion. The right frame depicts a street scene with buildings and a crowd of people, possibly attending a parade or festival. The buildings have awnings and decorations, and the crowd appears to be engaged in the event.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely taken from film. It shows a scene that appears to be a street festival or procession. The image is composed of two frames, which likely would be different views from the same event.

Left Frame (13):

  • Focus: This frame focuses on a group of men dressed in suits, with some wearing bow ties and the other a regular tie. Some are looking directly at the camera.
  • Setting: Buildings line the street, with an arch made of balloons, indicating the event.
  • Activity: Several people in the street are looking in the same direction.

Right Frame (14):

  • Focus: This frame looks down the street, highlighting the decorations.
  • Setting: The buildings of this street are lined with fire escapes, suggesting a city setting. The balloon arches are visible.

Details:

  • Film Characteristics: The image is framed by the edges of the film strip, with the sprocket holes visible. The film type is marked "SUPER XX"

Potential Context:

Based on the formal attire, decorations and the architecture, the photo appears to be of a festival or celebration taking place in an urban setting, possibly in the mid-20th century.

Created by gemini-2.0-flash on 2025-05-16

The image is a scan of a black-and-white film negative strip. The strip contains two frames, numbered 13 and 14, and is labeled "SUPER XX" in the center. Each frame depicts a scene from what appears to be a parade or celebration in a city street.

In frame 13, several people are visible, dressed in suits and ties, possibly attending a formal event or part of the parade. A younger person in casual attire is also visible. The background shows buildings lining the street, and above the street are decorations, possibly balloon arches or garlands, adding to the festive atmosphere.

Frame 14 continues the street scene, showing a procession or crowd of people moving down the street. Arches adorned with what looks like balloons or other decorations span the street. The buildings in the background feature fire escapes and architectural details typical of older urban areas.

The overall impression is that these images capture a moment from a lively public event, possibly a cultural festival or parade, in a city neighborhood. The "SUPER XX" label suggests this is a medium-speed black and white film used for general photography purposes.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image appears to be a vintage photograph, possibly from the early 20th century, showing a street scene. Here are the details:

  1. Format: The photograph is in a negative strip format, with two frames labeled "13" and "14" at the bottom. The film type is marked as "SUPER XX."

  2. Content:

    • Left Frame (13): This frame shows a group of people gathered on a street. They are dressed in formal attire, including suits and hats, which suggests the photo might be from an earlier era. The people seem to be engaged in conversation or observing something off-camera.
    • Right Frame (14): This frame captures a wider view of the street, showing more of the surrounding architecture and additional people. The buildings have multiple stories and appear to be commercial or residential structures. The street is decorated with what looks like festive or celebratory decorations, possibly garlands or banners.
  3. Setting: The scene likely takes place in an urban area, given the architecture and the presence of a crowd. The decorations suggest that there might be a special event or celebration taking place.

  4. Quality: The photograph has some signs of aging, including scratches and slight discoloration, which is common for old film negatives.

Overall, the image captures a moment in time on a bustling street, possibly during a festive occasion, with people dressed in period attire.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image appears to be a scanned photograph of a film strip, with two adjacent frames displayed. The film strip has perforations along the top, which are typical of vintage film negatives or slides. Each frame shows a street scene.

In the left frame, there are several men in formal attire, including suits and ties, gathered together on a street decorated with a large archway adorned with balloons and decorations. The backdrop includes a multi-story building with windows and balconies, some of which have fire escapes. There is also a crowd of people in the background, suggesting a public event or celebration.

The right frame shows a similar street scene to the left, with the same archway and balloons in the background. The buildings and crowd are visible, but the focus is shifted slightly, showing a different angle of the same event. The watermark "SUPER XX" suggests the film type or brand used for the photograph.

The overall impression is that this is a historical or vintage photograph capturing a festive or public gathering in an urban setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This image appears to be a black-and-white film strip, specifically from a roll of Super XX film, showing two adjacent frames numbered 13 and 14. The scene depicted is a street parade with people in formal attire, likely men in suits, standing and observing the event. The background includes decorated floats adorned with balloons or other festive decorations, and buildings lining the street. The overall atmosphere suggests a celebratory or commemorative occasion, possibly from a past era given the style of clothing and the film type. The film strip itself shows the perforations typical of motion picture film.

Text analysis

Amazon

SUPER
14
13
SUPER XX
XX

Google

T0000 13 13 SUPER XX 14
T0000
13
SUPER
XX
14