Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4598

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4598

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.9
Electronics 69.1
Display 69.1
Screen 69.1
People 64.2
Outdoors 62.1

Clarifai
created on 2023-10-25

movie 99
art 98.2
people 96.9
collage 96.8
analogue 96.7
negative 96.6
slide 96.4
filmstrip 94
picture frame 93.1
window 92.8
dirty 92.1
wall 91.5
no person 91.3
screen 90.9
vintage 90.9
margin 90.9
exposed 90.9
old 90.9
retro 90.9
wear 90.4

Imagga
created on 2022-01-08

sequencer 100
apparatus 100
equipment 100
electronic equipment 31
technology 24.5
amplifier 20
computer 20
digital 19.4
business 17
data 16.4
industry 16.2
black 16.2
film 16
connection 15.5
network 13.9
cinema 13.7
old 13.2
office 12.8
negative 12.5
sound 12.2
grunge 11.9
equalizer 11.9
music 11.7
movie 11.6
information 11.5
vintage 10.7
retro 10.6
audio 10.5
media 10.5
electronic 10.3
device 10.2
texture 9.7
button 9.7
card 9.3
camera 9.2
entertainment 9.2
frame 9.1
close 9.1
border 9
filmstrip 8.9
object 8.8
slide 8.8
strip 8.7
video 8.7
electrical 8.6
cable 8.6
electronics 8.5
screen 8.5
word 8.5
art 8.5
finance 8.4
communication 8.4
plastic 8.3
paper 7.8
plug 7.8
folder 7.8
panel 7.7
blank 7.7
tape 7.7
studio 7.6
security 7.3
design 7.3
industrial 7.3
success 7.2
financial 7.1
server 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 75.7%
Happy 86.9%
Calm 9.5%
Surprised 0.9%
Sad 0.8%
Fear 0.8%
Disgusted 0.4%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 82.9%
Calm 97%
Sad 2.2%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 57.7%
Calm 91.7%
Happy 4.2%
Sad 1.4%
Angry 1.1%
Confused 0.6%
Surprised 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Female, 64.1%
Calm 92.7%
Happy 5.3%
Sad 1.4%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 7-17
Gender Male, 51.7%
Calm 94%
Confused 2.1%
Happy 1.6%
Sad 1.2%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Monitor

Clarifai

Clothing
Picture frame
Footwear
Human face
Man
Wheel

AWS Rekognition

Person 99.9%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 93.7%

AWS Rekognition

Person 88.2%

AWS Rekognition

Person 85.5%

AWS Rekognition

Person 65.2%

AWS Rekognition

Monitor 69.1%

Clarifai

Clothing 84.2%

Clarifai

Clothing 71.6%

Clarifai

Clothing 63.5%

Clarifai

Clothing 62%

Clarifai

Clothing 54.9%

Clarifai

Clothing 41.4%

Clarifai

Clothing 36.8%

Clarifai

Picture frame 71.4%

Clarifai

Footwear 67.9%

Clarifai

Footwear 66.3%

Clarifai

Footwear 60.1%

Clarifai

Footwear 47.4%

Clarifai

Footwear 44.7%

Clarifai

Footwear 43%

Clarifai

Footwear 41.2%

Clarifai

Footwear 33.5%

Clarifai

Footwear 33%

Clarifai

Human face 55.1%

Clarifai

Human face 46.4%

Clarifai

Human face 46.1%

Clarifai

Human face 45.3%

Clarifai

Human face 41.1%

Clarifai

Man 53.2%

Clarifai

Man 46.7%

Clarifai

Wheel 42.8%

Categories

Imagga
created on 2022-01-08

cars vehicles 91.8%
interior objects 5.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

a photograph of actor in a scene from the film.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a white shirt is holding a camera

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image appears to be a black-and-white photographic film negative of a street scene. Several people are gathered in an outdoor area, possibly a marketplace or urban location. Individuals are dressed in mid-20th-century attire, with women wearing dresses and men in shirts and trousers. Surrounding them are structures, vehicles, and stalls, suggesting a bustling environment. The presence of pedestrians and objects on the ground further emphasizes the active street atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image appears to be a black and white film negative showing a busy street scene possibly from the mid-20th century. Several people are gathered on the sidewalk and street, with some carrying bags or other items. There's a mix of clothing styles suggesting a typical day with different individuals going about their activities. The backdrop includes a street with vehicles parked along the side and buildings typical of a city environment. Numerous people are visible in the scene, including a couple of children. The scene captures an everyday urban moment, with people seemingly engaged in casual conversations or tasks.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph captured on a film strip. It shows a crowded street scene with several people visible. The people appear to be engaged in some kind of activity or interaction, though the details are not entirely clear. The image has a vintage, historical feel to it.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white image shows a busy street scene, likely from the early to mid 20th century based on the clothing styles and surroundings. People are gathered on the sidewalk, some conversing in small groups. Vendor stalls or small shops line the street. The frame of the image has numbers along the top and bottom, possibly from a film negative or print. Overall, it captures a slice of everyday life from a past era in an urban setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white film negative or contact print showing what appears to be a street scene. Several people are gathered in what looks like an outdoor market or street fair setting. The image shows people standing around, with one person in particular captured in a stance that suggests movement or dancing. The photo has the characteristic film frame borders with sprocket holes visible along the edges, indicating it's from a roll of 35mm film. The frame numbers "33" can be seen on the film border. The overall quality and style suggests this may be a vintage or historical photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a street scene, captured on film and presented in a negative format. The photo shows a group of people gathered on the sidewalk, with some standing and others sitting on benches or chairs. A man in a white shirt and dark pants is walking towards the left side of the image, while a woman in a long skirt and dark jacket stands near the right edge. In the background, buildings and cars are visible, adding context to the scene.

The photograph has a distinctive look, with visible film sprocket holes along the top and bottom edges, and a number "33" printed in the corners. The overall atmosphere of the image is one of everyday life, with people going about their daily activities in a bustling urban setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image depicts a black and white photograph of a man and a young girl walking down a street, surrounded by other people. The photo is framed by a film strip with numbers and symbols, indicating that it was taken from a roll of film. The scene appears to be set in an urban environment, with buildings and vehicles visible in the background.

Key Elements:

  • A man and a young girl walking together
  • Other people standing or walking in the background
  • Buildings and vehicles visible in the distance
  • A film strip with numbers and symbols framing the photo

Context:

  • The image suggests a casual, everyday scene
  • The presence of a film strip implies that the photo was taken using a film camera
  • The black and white color scheme gives the image a nostalgic or vintage feel

Overall Impression:

  • The image conveys a sense of normalcy and routine
  • The use of a film strip adds a touch of nostalgia and authenticity to the photo
  • The black and white color scheme enhances the overall aesthetic of the image.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

A black-and-white photograph of a street scene with people standing around. The man in a white shirt is holding the girl's shoulder, while the girl is looking at something on the right. There are two men standing near the car, and one of them is wearing a hat. The woman in a black jacket is standing near the man in a white shirt. There are buildings on the right side.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph of a street scene from the past. It is captured on a film strip, which is evident from the visible sprocket holes and film numbers. The photograph shows a group of people gathered on a street, with a few individuals standing out prominently. A man in a white shirt is seen holding a young girl in his arms, while another man, dressed in a hat and a jacket, appears to be engaging in conversation with him. In the background, there are more people, some standing and others walking, along with a car parked on the side of the street. The image has a nostalgic and historical feel, capturing a moment in time from the past.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression: The image is a black and white photograph captured on a film negative strip. It depicts a street scene, likely from the mid-20th century, given the style and appearance. The scene is busy with people, suggesting a public marketplace or street fair.

Key Elements and Details:

  • Central Figure: A man is in the foreground. He is walking or moving in the middle of the road, facing towards the left of the image. He's wearing a white shirt and dark pants.
  • Children: Two young children, a girl and a young boy, are standing near the man, partially obstructing their faces.
  • Background Activity: There are many other people on the sidewalk and in the background. Some are standing or walking, while others seem to be interacting with vendors.
  • Setting: The scene is in a city street. There appear to be market stalls, a building facade, and street signs (though they are blurry). The presence of a corner building suggests an urban environment.
  • Other Details: In the foreground, there are some things laying on the ground. On the right, there is a side of a building with a sign, with the word "FAUBOURG" at the top, and some illegible words below it.

Overall Style: The photo has a candid, snapshot-like quality, emphasizing the everyday lives of people in the city.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a black and white photograph of a strip of film. The filmstrip is surrounded by a gray paper border.

The photograph appears to be taken on a busy street. A crowd of people can be seen in the background, some standing on a sidewalk and others on the street. There are also some structures resembling market stalls or small shops. In the foreground, a man in a light-colored shirt and dark pants is walking towards the right side of the frame. A young girl in a dress and cardigan is standing beside him. Another person, partially obscured, is standing next to the girl.

The image is grainy and has a vintage feel. The contrast is quite high, with deep blacks and bright whites. The overall composition suggests a candid street scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image appears to be a black-and-white photograph taken in a busy urban street scene. Here are some detailed observations:

  1. People and Activity:

    • The photograph shows a group of people engaged in various activities.
    • In the foreground, a man in a white shirt and dark pants is walking towards the right side of the image. He appears to be carrying a bag or briefcase.
    • A child, dressed in a light-colored jacket and skirt, is walking closely behind the man, possibly accompanying him.
    • Several other individuals are visible in the background, some standing and some walking. They appear to be engaged in conversation or other activities.
  2. Setting:

    • The setting looks like a bustling market or street scene.
    • There are various stalls or shops on the left side of the image, with people gathered around them.
    • The ground is littered with debris, indicating a busy and possibly crowded area.
    • On the right side, there is a building with a sign that is partially visible. The sign reads "FURNITURE," suggesting that it might be a furniture store.
  3. Photographic Details:

    • The photograph is framed by a filmstrip border, indicating that it was taken with a film camera.
    • The numbers "33" appear on both the top and bottom of the filmstrip, suggesting that this is the 33rd frame on the roll of film.
    • The image has a vintage feel, possibly from the mid-20th century, given the clothing styles and the black-and-white nature of the photograph.

Overall, the image captures a moment in a lively urban environment, with people going about their daily activities in a market or street setting.

Qwen

No captions written

Text analysis

Amazon

33
M

Google

33
33