Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4586.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4586.1-4

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.3
Person 98.9
Person 98.8
Person 98.3
Person 97.8
Person 97.6
Person 96.3
Person 95
Person 94.6
Person 93.9
Person 92.6
Funeral 87.2
Car 85.5
Transportation 85.5
Vehicle 85.5
Automobile 85.5
Person 85
Person 84.8
Person 84.6
Person 83.1
Person 83
Person 82.9
Military 81.5
Military Uniform 80.9
Person 74.4
People 73.1
Person 71
Crowd 59.2
Officer 59.1
Monitor 57.7
Electronics 57.7
Screen 57.7
Display 57.7
Wheel 57.1
Machine 57.1
Army 56.2
Armored 56.2
Person 54.7
Person 43.1

Clarifai
created on 2023-10-25

people 99.6
movie 97.7
group 96.3
man 94.1
woman 93
train 90.4
adult 89.1
many 89.1
group together 87.2
transportation system 84.5
railway 84.3
wear 82
vehicle 81.3
military 81.3
war 80.8
leader 80.3
uniform 78.1
soldier 77.9
screen 77.7
street 77.4

Imagga
created on 2022-01-08

television 51.7
barbershop 51.2
shop 51
mercantile establishment 38.3
place of business 25.5
telecommunication system 25.2
case 25.2
people 16.7
business 16.4
black 15.6
broadcasting 14.5
building 13.7
city 13.3
architecture 13.3
man 12.8
establishment 12.7
light 12.7
glass 12.4
urban 12.2
monitor 11.5
interior 11.5
modern 11.2
office 10.6
equipment 10.4
technology 10.4
telecommunication 10.1
silhouette 9.9
window 9.9
transportation 9.9
night 9.8
information 9.7
digital 9.7
counter 9.4
finance 9.3
travel 9.1
transport 9.1
computer 8.8
chair 8.5
place 8.4
display 8.4
back 8.3
indoor 8.2
working 7.9
design 7.9
public 7.8
men 7.7
waiting 7.7
media 7.6
screen 7.5
restaurant 7.2
passenger 7.2
adult 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.1
person 91.4
screenshot 89.5
man 87.5
clothing 81.5
billboard 77.6
poster 55.3
picture frame 51.2
kitchen appliance 12.6
subway 12

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 91.4%
Disgusted 4.3%
Confused 2.4%
Sad 0.7%
Angry 0.4%
Surprised 0.4%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Calm 87.1%
Happy 10.1%
Confused 0.7%
Sad 0.6%
Surprised 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 64.6%
Angry 25.7%
Sad 3.5%
Confused 2.7%
Disgusted 1.3%
Surprised 1%
Fear 0.6%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 97.9%
Sad 61.9%
Calm 22.3%
Angry 3.7%
Confused 3.3%
Disgusted 3.2%
Happy 2.5%
Surprised 1.8%
Fear 1.5%

AWS Rekognition

Age 13-21
Gender Female, 99.4%
Calm 99.4%
Sad 0.4%
Confused 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 98.4%
Disgusted 48%
Confused 16.8%
Happy 15%
Angry 13.2%
Surprised 3.5%
Sad 1.6%
Calm 1.3%
Fear 0.6%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 91.3%
Disgusted 3.6%
Sad 1.7%
Surprised 1.2%
Angry 1.1%
Confused 0.7%
Happy 0.4%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 88.3%
Disgusted 3.7%
Sad 2.9%
Happy 1.5%
Surprised 1.3%
Confused 1%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Calm 42.7%
Angry 41.5%
Sad 5.7%
Fear 2.6%
Happy 2.4%
Disgusted 2.3%
Confused 2%
Surprised 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 91.7%
Sad 4.5%
Angry 0.8%
Confused 0.8%
Happy 0.8%
Disgusted 0.6%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Male, 95.3%
Calm 92.1%
Sad 1.9%
Surprised 1.5%
Confused 1.5%
Disgusted 1.5%
Angry 0.6%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 13-21
Gender Male, 73.8%
Calm 71.2%
Happy 8.7%
Sad 6.6%
Angry 5.1%
Disgusted 4.3%
Surprised 2.4%
Fear 1.2%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Male, 72.4%
Calm 62.2%
Happy 16.1%
Sad 15.6%
Angry 1.5%
Fear 1.4%
Disgusted 1.3%
Surprised 1%
Confused 1%

AWS Rekognition

Age 13-21
Gender Male, 99.7%
Calm 39.4%
Sad 29.1%
Angry 12.6%
Fear 10.5%
Disgusted 3%
Happy 2.8%
Confused 1.3%
Surprised 1.2%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Calm 92.4%
Sad 2.7%
Disgusted 1.3%
Fear 0.9%
Angry 0.9%
Surprised 0.6%
Happy 0.6%
Confused 0.5%

AWS Rekognition

Age 16-24
Gender Male, 86.6%
Calm 98.8%
Angry 0.7%
Sad 0.2%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 10-18
Gender Male, 88.5%
Calm 91%
Sad 3.6%
Disgusted 1.6%
Fear 0.9%
Angry 0.8%
Happy 0.8%
Confused 0.8%
Surprised 0.5%

AWS Rekognition

Age 18-24
Gender Male, 99.8%
Calm 81.7%
Angry 11.7%
Sad 4.5%
Surprised 0.7%
Disgusted 0.5%
Confused 0.4%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 88.5%
Disgusted 64.2%
Sad 12.5%
Happy 5.1%
Fear 4.2%
Confused 4%
Calm 3.9%
Angry 3.4%
Surprised 2.7%

AWS Rekognition

Age 19-27
Gender Male, 91.4%
Calm 71.2%
Sad 18.3%
Fear 6.9%
Angry 1.8%
Disgusted 0.9%
Surprised 0.4%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Male, 99.3%
Calm 84.4%
Sad 6.5%
Angry 3.4%
Fear 3.1%
Confused 0.9%
Disgusted 0.6%
Happy 0.6%
Surprised 0.4%

AWS Rekognition

Age 16-24
Gender Male, 91.2%
Calm 67.2%
Angry 8.6%
Confused 7.4%
Sad 7.2%
Disgusted 4.3%
Surprised 2.1%
Happy 1.8%
Fear 1.4%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 40%
Angry 34%
Disgusted 8.4%
Happy 6%
Confused 4%
Sad 3.4%
Surprised 2.2%
Fear 2%

AWS Rekognition

Age 23-33
Gender Female, 60.6%
Sad 50.2%
Confused 31.3%
Calm 9.3%
Disgusted 3.3%
Happy 1.8%
Surprised 1.4%
Fear 1.4%
Angry 1.3%

AWS Rekognition

Age 4-10
Gender Male, 78.6%
Calm 94.9%
Happy 1.8%
Sad 1.6%
Disgusted 0.5%
Angry 0.4%
Confused 0.3%
Fear 0.3%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Male, 84.8%
Calm 83.4%
Happy 4.8%
Sad 3.9%
Angry 3.1%
Fear 1.9%
Surprised 1.2%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 6-12
Gender Male, 86.3%
Calm 65.2%
Sad 22%
Fear 4.1%
Happy 3.3%
Angry 2.1%
Disgusted 1.5%
Confused 1.1%
Surprised 0.6%

AWS Rekognition

Age 6-14
Gender Female, 87.4%
Calm 48.4%
Happy 43.1%
Angry 3.3%
Surprised 1.5%
Disgusted 1.2%
Sad 1.1%
Confused 0.7%
Fear 0.6%

AWS Rekognition

Age 25-35
Gender Male, 100%
Angry 96.6%
Calm 1.9%
Sad 0.7%
Happy 0.5%
Confused 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 4-12
Gender Male, 98.9%
Calm 62.7%
Sad 18.7%
Disgusted 5.6%
Angry 4.8%
Fear 2.5%
Surprised 2.1%
Happy 1.8%
Confused 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Car
Monitor
Wheel
Person 99.5%
Person 99.3%
Person 98.9%
Person 98.8%
Person 98.3%
Person 97.8%
Person 97.6%
Person 96.3%
Person 95%
Person 94.6%
Person 93.9%
Person 92.6%
Person 85%
Person 84.8%
Person 84.6%
Person 83.1%
Person 83%
Person 82.9%
Person 74.4%
Person 71%
Person 54.7%
Person 43.1%
Car 85.5%
Monitor 57.7%
Wheel 57.1%

Captions

Microsoft
created by unknown on 2022-01-08

graphical user interface, website 99.7%

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people walking down a street -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This image is a black-and-white photographic film strip depicting a formal gathering or event. It features a group of well-dressed individuals in suits and formal attire standing near vintage cars on a city street. Some frames include ornate decorations and what appears to be a bustling urban environment with additional figures in the background. The architecture and vehicles suggest a mid-20th century time period. Toward the right, a couple in formal attire is visible, walking near the cars.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a strip of black and white film negatives depicting a sequence of events in an urban setting. Several people, dressed in formal attire including suits and dresses, are captured in a city street environment. The scenes include classic cars parked along the street, suggesting a mid-20th-century time period. The architecture of buildings in the background and the style of the parked vehicles contribute to this impression. The people appear to be participating in a formal occasion, possibly a wedding or significant social event, given their attire and the general atmosphere. Pedestrians and bystanders can be seen observing or participating in the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a contact sheet or film strip containing several black and white photographs. The photographs depict various scenes from what seems to be a formal event or gathering, possibly a social gathering or celebration.

The first frame shows a group of men in suits, likely attendees of the event. The second frame shows a couple, possibly the hosts or guests of honor, posing in front of a car. The third frame shows a larger crowd of people on a city street, and the fourth frame shows a street scene with various people and vehicles.

Without being able to identify any specific individuals, the overall impression is of a historical event or gathering captured through a series of candid and posed photographs.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image appears to be a film strip or contact sheet showing different scenes from what looks like a busy city street in the mid-20th century, likely the 1950s based on the clothing styles and car models visible. The scenes depict crowds of well-dressed people, possibly at some kind of event or gathering, with classic cars parked along the street. Men are wearing suits and hats, while women are in dresses typical of that era's fashions. The multiple frames provide snapshots of the lively urban atmosphere and activity on the sidewalks and road during this time period in America's past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a strip of black and white film negatives, appearing to be from a wedding or formal event from what looks like the 1950s or 1960s. The strip contains four frames showing various scenes from the event, including people in formal attire like suits and a wedding dress, vintage automobiles parked along a street, and groups of people gathered outside what appears to be a church or venue. The film strip has frame numbers visible and appears to be labeled as "SUPER XX" which was a type of Kodak film. The images capture the classic formal style and atmosphere of a mid-20th century special occasion.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image presents a black-and-white contact sheet featuring five photographs of a wedding procession. The first photograph depicts three men in suits standing beside a car, while the second shows a woman in a white dress holding flowers and standing next to a car. The third photograph captures a group of people walking down the street, with cars parked along the sidewalk. The fourth image is similar to the third, but with a different perspective. The fifth photograph shows a couple in formal attire standing on the sidewalk, with cars parked behind them.

The contact sheet has a white border around it, and the photographs are arranged horizontally across the center. The overall atmosphere of the image suggests a formal and celebratory occasion, likely a wedding.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white film strip featuring a series of photographs depicting a wedding procession. The film strip is divided into five sections, each containing a unique scene from the wedding.

  • Section 1:
    • A man in a suit and tie stands beside a car, with a crowd of people in the background.
    • The man is holding a bouquet of flowers.
    • The car is parked on the street, with a building visible in the background.
  • Section 2:
    • A woman in a wedding dress walks down the street, accompanied by a man in a suit and tie.
    • The couple is surrounded by a crowd of people, including men in suits and women in formal attire.
    • The scene appears to be taking place on a busy street, with cars and buildings visible in the background.
  • Section 3:
    • A group of men in suits and ties stand together, looking at something off-camera.
    • One of the men is holding a bouquet of flowers.
    • The scene appears to be taking place in a courtyard or other enclosed space.
  • Section 4:
    • A woman in a wedding dress walks down the street, accompanied by a man in a suit and tie.
    • The couple is surrounded by a crowd of people, including men in suits and women in formal attire.
    • The scene appears to be taking place on a busy street, with cars and buildings visible in the background.
  • Section 5:
    • A group of people, including men in suits and women in formal attire, stand together and look at something off-camera.
    • One of the men is holding a bouquet of flowers.
    • The scene appears to be taking place in a courtyard or other enclosed space.

Overall, the film strip provides a glimpse into a wedding procession, showcasing the joy and celebration of the occasion. The images capture the excitement and happiness of the couple and their guests as they make their way through the streets.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image shows a black-and-white film strip featuring three separate photographs. The film strip has a black border and white edges. The photographs depict a wedding procession. The first photograph shows a bride and groom standing in front of a car, with several people in formal attire standing behind them. The second photograph shows a bride and groom walking down the street, with several people in formal attire following them. The third photograph shows a bride and groom walking down the street, with several people in formal attire following them.

Created by amazon.nova-pro-v1:0 on 2025-06-01

The image is a strip of four black-and-white photographs. Each photograph depicts a scene from what appears to be a formal event or parade, with people dressed in formal attire. The photographs show individuals standing and walking in the street, with some individuals appearing to be part of a procession. The background includes buildings and vehicles, suggesting an urban setting. The photographs are arranged in a horizontal strip, with each image separated by a thin black border.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

This appears to be a strip of black and white negatives from a roll of film, likely taken in the mid-20th century, judging by the style. The film strip captures several moments that seem to be part of a special event, possibly a wedding or important gathering.

Here's a breakdown of what's visible:

  • Scene 1: A group of men in tuxedos are exiting a black car in front of some building.
  • Scene 2: A newly married couple posing in front of a black car while being photographed by a crowd.
  • Scene 3: A long procession of men in tuxedos walking down a street.
  • Scene 4: A couple, likely the newlyweds, are walking in the middle of the street, surrounded by people and vintage cars. The woman is wearing a long wedding dress.

Based on the presence of formal wear, vintage cars, and a significant number of people, it seems like this is an event such as a wedding, a special celebration, or some type of parade.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a strip of four black and white negatives of a photograph on a white background. The negatives are numbered 9 through 12 along the top edge, with "SUPER XX" printed below number 9 and "SAFETY FILM" above numbers 10 and 11. The background is a plain white color, with the black negatives standing out against it.

The first negative (number 9) shows a group of men in suits and bow ties in front of a vintage car. The men appear to be dressed formally, possibly for an event or gathering.

The second negative (number 10) features a woman in a light-colored dress with a bouquet of flowers, accompanied by a man in a suit. They stand in front of another vintage car, and there are onlookers in the background. The scene has a celebratory atmosphere, perhaps a wedding or special occasion.

The third negative (number 11) depicts a procession of men in suits, carrying what appears to be a platform or a decorated object. They are walking down a street lined with vintage cars and onlookers. The event seems to be a parade or a formal procession.

The fourth negative (number 12) shows a couple standing in the middle of a street with vintage cars parked on either side. The woman is wearing a long, light-colored gown, and the man is in a suit with a sash or ribbon. They are surrounded by onlookers, and the scene has a romantic or ceremonial feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a strip of black-and-white film containing four consecutive frames, likely from a mid-20th-century event. Here's a detailed summary of each frame:

  1. First Frame (Frame 9):

    • Several men dressed in formal attire (suits and hats) are standing in front of a building. They appear to be engaged in conversation or waiting. The building has a sign that reads "BANK."
  2. Second Frame (Frame 10):

    • A man and a woman are standing next to a classic car. The man is wearing a suit and hat, while the woman is dressed in a formal gown. They seem to be posing for a photograph.
  3. Third Frame (Frame 11):

    • A group of people, mostly men in suits and hats, are gathered on a street. Some are standing near a car, while others are in the background. The scene appears to be part of a larger event or gathering.
  4. Fourth Frame (Frame 12):

    • A man and a woman are standing near a car on a street. The man is in a suit and hat, and the woman is in a formal gown. They seem to be engaged in conversation or posing for a photograph. Other people and cars are visible in the background.

The film strip is labeled "SUPER XX SAFETY FILM" and has frame numbers (9, 10, 11, 12) along the edges. The scenes suggest a formal or celebratory event, possibly a wedding or a significant public gathering, given the attire and the presence of classic cars.

Text analysis

Amazon

12
FILM
9
SUPER
10
SUPER XX
XX
FILM SAFETYA
SAFETYA
12 ١٨+
OI
-
THE
- THE
١٨+
CURR

Google

SAFETYA FILM SUPER XX 10
SAFETYA
FILM
SUPER
XX
10