Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4578

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4578

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.4
Outdoors 91.8
Nature 86
Snow 78.7
Screen 74.7
Electronics 74.7
LCD Screen 72.5
Monitor 72.5
Display 72.5
Ice 66.8
Text 62
People 59.6
Leisure Activities 59.5
Advertisement 58.4

Clarifai
created on 2023-10-25

collage 99
movie 98.3
people 97.9
slide 97.8
negative 96.5
street 96.1
art 95.3
screen 95.1
noisy 93.9
vintage 92.9
desktop 92.2
photograph 92.1
snow 91.9
old 91.8
winter 91.7
man 91
retro 90.4
filmstrip 89.6
analogue 89.4
urban 88.7

Imagga
created on 2022-01-08

case 52.4
monitor 41.4
television 33.3
electronic equipment 30.2
aquarium 26.8
equipment 21.4
architecture 20.3
broadcasting 19.7
screen 19.5
building 17.2
old 16.7
art 15.6
window 15.4
glass 14.8
black 14.4
telecommunication 14.2
frame 14.1
vintage 14
digital 13.8
collage 13.5
film 13.4
modern 13.3
retro 13.1
design 12.9
business 12.7
city 12.5
urban 12.2
windows 11.5
home 11.2
technology 11.1
grunge 11.1
house 10.9
sliding door 10.7
your 10.6
office 10.6
structure 10.4
texture 10.4
computer 10.4
antique 10.4
door 10.2
paint 9.9
interior 9.7
movie 9.7
light 9.3
water 9.3
space 9.3
negative 9.3
travel 9.1
global 9.1
dirty 9
photographic 8.8
frames 8.8
noise 8.8
medium 8.8
slide 8.8
strip 8.7
damaged 8.6
tech 8.5
hand 8.3
transport 8.2
pattern 8.2
rough 8.2
border 8.1
reflection 8.1
close 8
noisy 7.9
scratches 7.9
scratch 7.8
layer 7.7
telecommunication system 7.7
rust 7.7
edge 7.7
outdoor 7.6
grungy 7.6
camera 7.4
street 7.4
room 7.3
people 7.2
decoration 7.2
sky 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

screenshot 98.4
text 96.5
billboard 94.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.3%
Sad 98.4%
Calm 1.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%
Surprised 0%

AWS Rekognition

Age 18-26
Gender Male, 98.2%
Calm 91.7%
Sad 2.6%
Disgusted 1.5%
Angry 1.4%
Fear 0.9%
Happy 0.8%
Confused 0.7%
Surprised 0.4%

AWS Rekognition

Age 6-16
Gender Male, 99.7%
Sad 42.2%
Angry 23.1%
Calm 21.8%
Happy 8.1%
Fear 2%
Surprised 1.2%
Disgusted 0.9%
Confused 0.6%

AWS Rekognition

Age 20-28
Gender Male, 92.3%
Calm 90.3%
Sad 4.2%
Angry 2.8%
Happy 1.1%
Disgusted 0.6%
Fear 0.5%
Surprised 0.3%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Male, 96.1%
Calm 84.9%
Sad 13.4%
Disgusted 0.4%
Confused 0.4%
Surprised 0.3%
Angry 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Female, 51.4%
Calm 92.2%
Sad 4.6%
Angry 1.1%
Happy 0.7%
Surprised 0.5%
Disgusted 0.5%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Female, 84.2%
Confused 28.7%
Calm 25.4%
Sad 19.5%
Happy 11.3%
Surprised 6.4%
Angry 3.4%
Disgusted 3.1%
Fear 2.3%

AWS Rekognition

Age 21-29
Gender Male, 98%
Calm 95.8%
Happy 2.2%
Fear 0.9%
Disgusted 0.5%
Sad 0.3%
Angry 0.1%
Surprised 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster

Clarifai

No features identified

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 93.8%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 90.8%

AWS Rekognition

Person 83.1%

AWS Rekognition

Person 74%

AWS Rekognition

Person 68%

AWS Rekognition

Person 52.8%

AWS Rekognition

Person 52.1%

AWS Rekognition

Person 42.6%

AWS Rekognition

Poster 58.4%

Categories

Imagga
created on 2022-01-08

interior objects 74.1%
streetview architecture 13.7%
text visuals 8.5%
events parties 1.7%

Captions

Microsoft
created by unknown on 2022-01-08

graphical user interface 69.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing around a group of people

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image appears to be a photograph captured on film negative, showing a street scene in a crowded urban area. It depicts a marching band dressed in uniforms, including hats, walking through a narrow street lined with buildings, street vendors, and spectators. The band members are holding musical instruments such as drums and cymbals. Surrounding the band are people, some watching the procession while standing near market stalls selling food or goods. Decorative lights are visible hanging above the street, suggesting a festive event or celebration. The photo has vintage qualities and feels like it may have been taken in the mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a black-and-white photograph that appears to be part of a filmstrip, as indicated by the black border and the perforations along the top and bottom edges. The photograph itself depicts a bustling street scene, which seems to be from a parade or festival. In the center, there is a group of people wearing uniforms and hats, possibly a marching band. They are holding musical instruments, such as drums, and are in motion down the street. The street is crowded with people, with spectators lining the sides. On the left side, there is a food cart with what looks like fruit on display, and several men are standing around watching the scene. On the right side, more people are observing the parade, with some standing by a street vendor. The street is decorated with hanging lights or banners, suggesting a celebratory or festive event. The overall atmosphere is lively and busy.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a crowded street scene in what appears to be an urban setting. There are many people visible, some wearing hats and coats, gathered together on the street. The image has a vintage, black and white aesthetic, suggesting it is an older photograph. The framing of the image and the visible film strip border around the edges indicate this is a photograph taken from a film camera.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical black and white photograph, likely from the early 20th century, showing a crowded street scene. The image appears to be a film negative or contact sheet, as indicated by the black borders with numbers and text visible at the top and bottom. The scene captures a large crowd of people gathered on what looks like a city street. Many people are wearing hats typical of the era, and the crowd seems to be densely packed together. The urban setting is evident from the buildings visible in the background along the street. The overall quality and style of the photograph suggests it's a documentary or news photograph from that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a parade or procession, captured from behind the marchers. The photograph is framed by a film strip border, with the words "EASTMAN" and "24" visible at the top and bottom, respectively.

In the foreground, a group of people in uniform, likely a marching band or military unit, are walking down the street. They are dressed in dark-colored uniforms with white hats and are carrying instruments such as drums and trumpets. The crowd is watching them from the sidewalk, and some people are standing on the street, possibly waiting for the procession to pass by.

The background of the image shows a city street lined with buildings, including shops and houses. The sky is overcast, and there are trees and other foliage visible in the distance.

Overall, the image appears to be a historical photograph taken during a parade or celebration, possibly in the early 20th century. The presence of a marching band and military uniforms suggests that it may have been taken during a patriotic event or holiday.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image depicts a black-and-white film negative featuring a lively street scene, with a marching band at its center. The band members are dressed in uniforms and caps, each carrying a large drum or other instruments. They are positioned on a street lined with buildings, where people are gathered to watch the performance. The atmosphere appears festive, with the band's music likely drawing in the crowd.

The image is presented in a negative format, with the text "EASTMAN" visible at the top and the number "24" at the bottom. This suggests that the photograph was taken using an Eastman Kodak camera, which was a popular brand during the early 20th century. The overall effect of the negative is to create a sense of nostalgia and historical significance, as if the viewer is looking back at a moment from the past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image shows a black-and-white photo of a parade on a street. It appears to be a historical image, as it is presented as a film strip with film perforations. The parade features a group of people marching down the street, playing musical instruments and carrying flags. The people in the parade are dressed in uniforms and hats, and some are carrying drums and other musical instruments. The street is lined with buildings and streetlights, and there are people watching the parade from the sidewalks.

Created by amazon.nova-pro-v1:0 on 2025-06-16

The image is a black-and-white photograph of a street scene. It is a vintage photograph with a film strip on the top and bottom, indicating that it is a frame from a reel of film. The film strip has the number "24" at the bottom, suggesting that this is the 24th frame. The image depicts a parade or procession on a street, with a group of people marching in formation. The people are wearing uniforms and hats, and some of them are carrying musical instruments, such as drums and trumpets. There are also spectators on the side of the street, watching the procession. The street is lined with buildings on both sides, and there are flags and banners hanging from the buildings.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

The image appears to be a black and white photograph of a parade or march taking place on a city street. The photograph is displayed as a contact sheet strip, with the word "EASTMAN" visible along one side and the number "24" along the top and bottom edges.

In the scene, a group of people, many wearing what looks like military or uniformed attire, are moving down the street. Several individuals are wearing hats or caps, and some are carrying musical instruments, including a large drum. Along the sides of the street, there are buildings and what appear to be market stalls or vendors. Some people are standing on the sidewalks, watching the parade. The overall impression is that of a crowded urban event, likely taken sometime in the mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-08

Here is a description of the image:

This is a black and white photograph captured on film. It appears to be a snapshot taken during a street parade or festival, judging by the large crowd and the presence of a marching band. The image has a vintage quality due to the filmstrip borders.

Key elements:

  • The marching band: Visible in the midground, with men in military-style uniforms, and instruments like drums and possibly woodwinds.
  • The crowd: Lines the street, with a mix of people of various ages and attire.
  • The street scene: Buildings lining the street, possibly with banners and decorations, suggesting a festive event. There may be vendors or market stalls along the road.
  • The filmstrip edges: The image is framed by the edges of the film, with the "EASTMAN" label and frame numbers.

The overall impression is of a snapshot of a historical event, likely in a densely populated urban area.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a historical street scene, likely from the early to mid-20th century, given the style of clothing and the general atmosphere. The photograph appears to be a film negative or a contact sheet, as indicated by the black borders with the numbers "24" on both sides.

In the scene, a crowd of people is gathered on a city street, possibly during a parade or public event. Many individuals are wearing hats, which was common attire for the period. Some people are carrying umbrellas, suggesting that it might be raining or that rain was expected. A few individuals are seen holding drums and other musical instruments, indicating that there might be a marching band or some form of musical performance taking place.

The street is lined with buildings, some of which have awnings and decorative elements. There are also streetlights and other urban fixtures visible. The overall mood of the image is lively and bustling, with many people engaged in the event. The photograph captures a moment of community gathering and celebration in an urban setting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image is a black and white photograph that appears to be a snapshot from an old film strip, as indicated by the perforations at the top and bottom of the image. The photo captures a lively street scene, likely from a parade or public event. The central focus is a group of marching individuals, possibly a band, as one person is carrying a drum. The participants are dressed in formal attire, suggesting a ceremonial or formal occasion.

In the background, there are spectators watching the event, and various stalls or shops can be seen, one of which has a sign that reads "HAT," indicating a possible clothing or accessory vendor. The street is lined with buildings, and the overall atmosphere suggests a bustling, yet organized event, common in historical parade scenes. The film strip itself has "Eastman 24" printed on the top, which likely refers to the film brand and the exposure number.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This is a black-and-white image, presented as a film strip frame (with "EASTMAN" and the frame number "24" visible). The scene depicts a lively street gathering that appears to be a parade or public event. There are a group of uniformed individuals, possibly a marching band or military personnel, with some carrying musical instruments such as drums. They are walking in formation on the street, surrounded by a crowd of spectators on either side. The spectators are dressed in a variety of outfits, suggesting a casual or festive atmosphere. Some individuals in the crowd are standing on objects like barrels to get a better view. The street is lined with buildings, and there are awnings and signs visible, indicating a commercial area. The overall setting suggests a historical or mid-20th-century urban environment.

Text analysis

Amazon

24
EASTMAN
DE
NO

Google

NG 24 24 EASTMAN
NG
24
EASTMAN