Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4635

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4635

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 99.2
Person 98.2
Interior Design 97.9
Indoors 97.9
Person 95.4
Person 94.2
Person 93.2
Person 91.8
Person 89
Person 85.5
Screen 75
Electronics 75
Person 74.3
Text 66.9
Monitor 65
Display 65
Person 58.9
Person 47.6

Clarifai
created on 2023-10-25

art 97.8
movie 96.5
analogue 95.6
people 93.9
slide 93.6
negative 93
window 91.7
no person 91.5
retro 91.4
old 90.8
picture frame 90.8
dirty 90.7
filmstrip 90.6
vintage 88.7
screen 88.3
wall 87.4
analog 85.3
photograph 85.2
painting 85
woman 84.5

Imagga
created on 2022-01-08

equipment 98.5
sequencer 86.8
apparatus 69.1
electronic equipment 57.5
equalizer 37.5
amplifier 26.2
technology 25.2
computer 20.8
data 19.2
digital 18.6
card 17
business 15.8
information 15.1
connection 14.6
network 13.9
industry 13.7
office 13.7
music 13.5
electronic 13.1
board 12.8
device 12.7
old 12.5
hardware 12.5
retro 12.3
sound 12.2
folder 11.7
close 11.4
electronics 11.4
word 11.3
memory 11.1
paper 11
register 10.9
audio 10.5
control 10.5
finance 10.1
speed 10.1
black 9.6
film 9.6
synthesizer 9.4
grunge 9.4
vintage 9.1
chip 8.9
object 8.8
cinema 8.8
transfer 8.8
radio 8.7
system 8.6
media 8.6
save 8.5
showing 8.4
entertainment 8.3
modem 8.2
dirty 8.1
button 7.9
switch 7.8
circuit 7.8
paperwork 7.8
speaker 7.8
movie 7.7
video 7.7
panel 7.7
tape 7.7
electrical 7.7
texture 7.6
cable 7.6
storage 7.6
tech 7.6
electronic instrument 7.6
electric 7.5
economy 7.4
closeup 7.4
plastic 7.3
metal 7.2
financial 7.1
server 7

Microsoft
created on 2022-01-08

text 98.5
screenshot 74.9
picture frame 73.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 84%
Happy 9%
Confused 3.2%
Sad 1.9%
Disgusted 0.8%
Fear 0.5%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 94.8%
Sad 2.6%
Confused 1%
Angry 0.5%
Disgusted 0.4%
Surprised 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 97.9%
Confused 0.8%
Angry 0.3%
Sad 0.3%
Disgusted 0.2%
Happy 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.4%
Calm 48.4%
Angry 30.8%
Sad 10.7%
Confused 7.2%
Disgusted 1.2%
Surprised 0.8%
Happy 0.5%
Fear 0.5%

AWS Rekognition

Age 16-22
Gender Male, 98.4%
Calm 91.8%
Sad 4.2%
Confused 1.9%
Angry 0.9%
Surprised 0.4%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 36-44
Gender Male, 98.5%
Disgusted 46.1%
Happy 23.3%
Sad 12.9%
Calm 6.4%
Angry 5.4%
Fear 3.1%
Confused 1.8%
Surprised 1%

AWS Rekognition

Age 22-30
Gender Male, 97.1%
Calm 99.8%
Surprised 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Male, 98.9%
Calm 73.5%
Sad 9.9%
Disgusted 3.9%
Confused 3.5%
Angry 3.2%
Fear 2.7%
Happy 2.2%
Surprised 1.1%

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 95.4%
Angry 1.5%
Fear 0.6%
Happy 0.5%
Confused 0.5%
Sad 0.5%
Disgusted 0.5%
Surprised 0.5%

AWS Rekognition

Age 21-29
Gender Male, 93.7%
Calm 95.5%
Happy 1.1%
Sad 1.1%
Angry 0.6%
Confused 0.5%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 88.6%
Fear 3.5%
Surprised 2.7%
Sad 2.5%
Disgusted 0.9%
Happy 0.8%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 97.8%
Sad 1.5%
Happy 0.3%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 13-21
Gender Male, 79%
Sad 55%
Calm 35.5%
Angry 2.6%
Confused 2.3%
Fear 1.9%
Surprised 1%
Disgusted 0.9%
Happy 0.8%

AWS Rekognition

Age 7-17
Gender Male, 87.9%
Calm 69.4%
Sad 7.6%
Fear 6.6%
Angry 5.3%
Disgusted 4.9%
Happy 3.8%
Confused 1.3%
Surprised 1%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Calm 72.5%
Sad 11.2%
Angry 9%
Happy 5.2%
Surprised 0.6%
Confused 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 23-33
Gender Female, 65.9%
Calm 44.3%
Happy 30.1%
Fear 16.2%
Sad 2.8%
Confused 2.6%
Disgusted 1.4%
Surprised 1.3%
Angry 1.3%

AWS Rekognition

Age 18-24
Gender Female, 73.3%
Sad 69.8%
Calm 20.6%
Fear 2.2%
Confused 1.9%
Happy 1.6%
Angry 1.6%
Surprised 1.2%
Disgusted 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Person 99.4%
Person 99.2%
Person 98.2%
Person 95.4%
Person 94.2%
Person 93.2%
Person 91.8%
Person 89%
Person 85.5%
Person 74.3%
Person 58.9%
Person 47.6%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people in uniform standing in front of a building -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image is a vintage black-and-white photograph featuring a group of people participating in a street procession. They are dressed formally, with some wearing suits and hats. In the center of the procession, there is a decorated statue or religious icon surrounded by an ornate floral arch. The street is lined with multi-story buildings, and banners or flags are visible hanging above. This appears to be a cultural or religious event in an urban neighborhood setting.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image depicts a street scene during a parade or procession. A group of men is walking down the street, dressed formally in suits and ties. They appear to be part of a solemn or ceremonial event. In the center of the image, there is a float or cart adorned with an arch made of flowers. Alongside the procession, buildings line the street with various signs and decorations visible on their exteriors. The atmosphere suggests a community gathering or celebration, as evidenced by what appears to be a crowd on the sidewalks observing the event. Flags or banners hang from the buildings, contributing to the festive environment. The photo itself resembles a film negative, with black borders and film strip holes visible around the edges.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph captured on film. It shows a crowded street scene, with a large group of people gathered together. In the center of the image, there is a decorative arch or structure, possibly a float or parade float, adorned with what looks like floral arrangements or garlands. The people in the image appear to be dressed in formal attire, suggesting this may be some kind of ceremonial or celebratory event taking place on the street.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph, appearing to be from a film negative strip, showing what looks like a religious procession on a city street. There's an ornate floral or decorative arch-shaped structure being carried through the street, likely as part of a Catholic or religious festival. The scene shows a group of people, many wearing formal dark suits, walking in formation along what appears to be an urban street with buildings on either side. The architecture and style of the photograph suggests this may be from the mid-20th century. The street appears to be in a dense urban area with multi-story buildings visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a parade, likely taken in the early 20th century. The photo is framed by a black border with holes along the top and bottom edges, indicating that it was taken on film.

In the foreground, a group of men in suits and ties are walking down the street, some carrying flags or banners. Behind them, a large float is decorated with white balloons and flowers, featuring a statue or figure at its center. The float appears to be a religious or cultural symbol, possibly representing a specific community or organization.

The background of the image shows a city street lined with buildings, including storefronts and apartments. People can be seen standing on the sidewalk, watching the parade pass by.

Overall, the image captures a moment of celebration and community pride, with the parade serving as a way to showcase cultural heritage and identity.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a parade, with a large crowd of people walking down a street. The photo appears to be taken from a film strip, as indicated by the sprocket holes along the top and bottom edges.

In the foreground, a group of men in suits are walking together, some carrying objects that are not clearly visible. Behind them, a large float or vehicle is decorated with flowers and other ornaments, although the details are difficult to discern due to the low resolution of the image.

The background of the photo shows a row of buildings lining the street, with signs and awnings visible above the storefronts. The overall atmosphere suggests a festive or celebratory event, possibly a religious procession or cultural festival.

The image has a nostalgic feel, with the grainy texture and faded colors evoking a sense of age and history. Despite the lack of clear details, the photo captures a moment in time that is both intriguing and captivating.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photo of a funeral procession shows a crowd of people walking in a row, possibly in a street. The people are wearing formal attire, with some wearing ties. The procession is carrying a float with a statue on top, which is decorated with white balloons. The float is surrounded by people holding sticks, possibly flags. The photo is taken from a low angle, and the film strip is visible at the top and bottom of the image.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of a street scene. In the foreground, a procession of people is moving along the street. The procession includes individuals dressed in formal attire, including suits and ties, suggesting a formal or ceremonial event. At the front of the procession, there is a large, ornate structure adorned with flowers and other decorations. This structure appears to be a float or a shrine, possibly part of a religious or cultural parade. The street is lined with buildings, and there are people standing along the sides, watching the procession. The buildings have various signs and awnings, indicating commercial establishments. The overall atmosphere suggests a community event or celebration.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a black and white photograph of a religious procession in a city street. The photo is bordered by a strip of 35mm film negatives, indicating it is a scan from a film roll. The entire photograph is mounted on a white or light gray backing.

In the scene, a large group of men, mostly dressed in dark suits, are carrying a statue or figure on a platform through a street lined with buildings. The statue is adorned with what appears to be a large, elaborate floral arrangement.

To the left of the procession, a man in a suit and tie stands out slightly from the rest, his hand resting on his hip. He seems to be observing or supervising the event. The buildings in the background appear to be older, with signs above storefronts indicating various businesses, such as "Delicatessen."

The overall atmosphere of the photograph suggests a traditional or cultural celebration taking place within an urban environment.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, appearing to be a film negative print. It captures a street scene with a religious procession. The photograph has a vintage feel, likely from the mid-20th century.

Details:

  • Subject: A religious procession or parade is taking place down a narrow street. A large, ornate structure adorned with flowers and possibly a statue or religious figure is being carried or paraded down the street.

  • People: A large group of men in suits are walking in the procession. Several other people are gathered on the sidewalks, watching the event.

  • Setting: The scene takes place on a city street, lined with tall buildings. Some storefronts with awnings and signage are visible, suggesting a commercial district.

  • Atmosphere: The photograph conveys a sense of community and tradition. The event seems to be a significant occasion, possibly a religious festival or celebration.

  • Composition: The photographer captures the scene from a street-level perspective, giving a good view of the procession and the surroundings. The structure being carried is the focal point.

  • Technical Aspects: The photo is a film negative print. The frame is marked with a frame number "35".

In summary, the image is a historical document, capturing a moment in time of a religious procession in a bustling city.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph showing a street procession. The scene appears to be from a historical period, possibly the early to mid-20th century, given the clothing styles and the architecture.

In the center of the image, a group of men is carrying a large, ornate float adorned with flowers. The float seems to be part of a religious or cultural celebration. The men carrying the float are dressed in formal attire, including suits and hats, suggesting the significance of the event.

The street is lined with buildings that have signs in what appears to be Italian, indicating that this might be taking place in an Italian neighborhood or city. The buildings are multi-story and have a traditional European architectural style.

Spectators can be seen on the sidewalks, watching the procession. The overall atmosphere seems festive and solemn, characteristic of religious or cultural parades. The image is framed with a filmstrip border, indicating that it might be a still from a roll of film.

Text analysis

Amazon

35
DELICATESSEN
LAUWOR
CHOICE
Coca-Cola

Google

35\ 35
35\
35