Human Generated Data

Title

Untitled (Stephen Dimitroff and other Artists' Union and Artists' Committee of Action members at a demonstration for job relief and a municipal art gallery, West Eighteenth Street, New York City)

Date

October 27, 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3914

Human Generated Data

Title

Untitled (Stephen Dimitroff and other Artists' Union and Artists' Committee of Action members at a demonstration for job relief and a municipal art gallery, West Eighteenth Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 27, 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3914

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 99.4
City 96.4
Urban 92.6
Metropolis 92.3
Face 84.6
Head 84.6
Clothing 73.1
Coat 73.1
Outdoors 68.6
Hat 57.7
Batman 57.6
Road 57.6
Architecture 57.1
Building 57.1
Spire 57.1
Tower 57.1
Text 56.9
Parade 56.8
Protest 56.8
Street 56.3
Canopy 55.7
Shelter 55.5
Hood 55.2

Clarifai
created on 2018-05-10

people 99.5
one 98
adult 97.5
man 95
room 93.9
furniture 93.8
group 93
wear 93
two 89.7
chair 89.2
indoors 88.8
no person 88.3
monochrome 86.6
administration 86.4
military 85.7
war 85.4
woman 85.1
home 85
leader 84.2
many 83.2

Imagga
created on 2023-10-06

newspaper 31.6
person 25.7
people 24.5
office 21.8
product 21.7
computer 21.5
business 20.6
work 20.4
businessman 20.3
man 19.5
table 17.8
laptop 17.4
corporate 17.2
creation 16.9
room 16.4
adult 15.8
suit 14.6
paper 14.4
desk 14.4
home 14.4
worker 14.3
male 14.2
professional 14
notebook 13.4
working 13.3
black 12.6
job 12.4
executive 12.2
manager 12.1
sitting 12
happy 11.9
indoors 11.4
education 11.3
indoor 11
success 10.5
portrait 9.7
reading 9.5
lifestyle 9.4
successful 9.2
attractive 9.1
piano 9.1
technology 8.9
pen 8.8
employee 8.8
smiling 8.7
career 8.5
student 8.3
scholar 8.3
school 8.1
grand piano 8.1
iron 8
smile 7.8
book 7.7
hand 7.6
document 7.6
intellectual 7.6
relaxation 7.5
learning 7.5
keyboard 7.5
stringed instrument 7.3
businesswoman 7.3
handsome 7.1
women 7.1
face 7.1
interior 7.1

Microsoft
created on 2023-10-30

text 99.7
black and white 86.7

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 21-29
Gender Female, 60.9%
Calm 93.2%
Surprised 6.4%
Fear 5.9%
Sad 3.3%
Happy 2%
Confused 0.5%
Disgusted 0.4%
Angry 0.4%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Baby

Clarifai

Clothing
Human face
Flag
Poster
Person

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 95.5%

AWS Rekognition

Person 94.3%

AWS Rekognition

Person 91.1%

AWS Rekognition

Person 83.8%

AWS Rekognition

Person 72%

AWS Rekognition

Adult 98.2%

AWS Rekognition

Adult 97.1%

AWS Rekognition

Adult 72%

AWS Rekognition

Male 98.2%

AWS Rekognition

Male 97.1%

AWS Rekognition

Male 72%

AWS Rekognition

Man 98.2%

AWS Rekognition

Man 97.1%

AWS Rekognition

Man 72%

AWS Rekognition

Baby 83.8%

Clarifai

Clothing 90.6%

Clarifai

Clothing 78.4%

Clarifai

Clothing 64.9%

Clarifai

Clothing 59.6%

Clarifai

Clothing 50.1%

Clarifai

Clothing 35.3%

Clarifai

Clothing 34.9%

Clarifai

Human face 72.7%

Clarifai

Human face 60.3%

Clarifai

Human face 49%

Clarifai

Human face 42.1%

Clarifai

Flag 54.6%

Clarifai

Flag 38.5%

Clarifai

Flag 35.6%

Clarifai

Poster 47.8%

Clarifai

Poster 38%

Clarifai

Person 44%

Categories

Imagga
created on 2023-10-06

paintings art 83.5%
interior objects 11.6%
food drinks 2.5%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This is a black-and-white negative image of a street scene featuring a group of people, likely participating in a parade, protest, or public gathering. The people are holding large triangular flags or banners that dominate the image. In the foreground, the back of a vehicle is visible, suggesting it is parked or moving as part of the scene.

The surrounding environment includes signs and buildings, some with legible text such as "White" and "Venetian Restaurant,” offering clues to the location. The architecture suggests an urban setting, possibly in a major city. The photograph appears to capture a moment of public demonstration or activity with a focus on the crowd and their flags.

Created by gpt-4o-2024-08-06 on 2025-06-10

This image is a negative photograph depicting a street scene, which likely dates back to the early 20th century, possibly the 1930s or 1940s. The photograph shows a group of people gathered, possibly for a protest or march, as they are holding various flags. Since it is a negative, the colors are inverted: dark areas appear light, and light areas appear dark.

The scene takes place in what seems to be an urban environment, as there are buildings on either side of the street. Visible on one of the buildings are signs for businesses, including "White" at a specific address (320 Fifth Ave, suggesting New York City), and a "Venetian Restaurant". Other signs mention electricians and express services.

The people in the image are wearing clothing typical of the era, including hats and coats. A vehicle is partially visible in the foreground, suggesting the event is taking place on a roadway or street.

Given the era and the presence of flags, this could be a scene related to a labor demonstration or political rally, which were common during this time period in major cities. The specific nature of the flags and the event is not clear due to the negative format of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a crowded street scene in what appears to be an urban area. There are several people holding flags or banners, suggesting some kind of protest or demonstration taking place. The buildings and storefronts in the background indicate a commercial district. The image has a black and white, vintage aesthetic, suggesting it is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white historical photograph that appears to be taken inside a shop or workspace. In the background, there are various signs visible, including one that reads "WHITE" and another advertising "ELECTRICIANS" and "EXPRESS MOVING." The most striking feature of the image is a series of pointed, cone-shaped objects or decorations arranged in a row, which appear to be some kind of display pieces or merchandise. The image has the characteristic grainy quality of early photography, and according to the credit line, it's from the Harvard University Art Museums collection. The overall scene suggests this might be a commercial or retail space from an earlier era, possibly the early 20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of people marching in the street, likely during a protest or demonstration. The photograph is taken from the perspective of a car, with the hood and windshield visible in the foreground.

In the background, several buildings line the street, including a sign that reads "WHITE" and another that says "SPRING ELECTRIC & ELECTRICIANS." The sky is not visible due to the angle of the photograph.

The people in the image are dressed in clothing from the early 20th century, suggesting that the photograph was taken during this time period. They appear to be holding flags and banners, which are blowing in the wind.

Overall, the image captures a moment in time when people were coming together to express their views and advocate for change. It is a powerful reminder of the importance of collective action and the role that individuals can play in shaping society.

Answer: A black-and-white photograph of a group of people marching in the street, likely during a protest or demonstration, taken from the perspective of a car.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of a group of people holding flags and marching down a street. The individuals are dressed in formal attire, including suits, hats, and ties, and are carrying flags with dark-colored fabric. The flags appear to be folded or draped over poles, creating a sense of movement and energy.

In the foreground, the back of a car is visible, suggesting that the photograph was taken from a vehicle following the procession. The background of the image shows a city street lined with buildings, including storefronts and signs. The overall atmosphere of the image conveys a sense of celebration, protest, or commemoration, although the specific context or purpose of the event is unclear.

The image has a vintage quality, with a faded and grainy texture that suggests it may have been taken in the early 20th century. A copyright notice in the bottom-left corner reads "President and Fellows of Harvard College (Harvard University Art Museums)," indicating that the image is part of a collection held by the Harvard University Art Museums.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The black-and-white image shows a group of people marching in a parade, possibly a protest. They are wearing white hoods and carrying flags. The hoods have pointed tops and are tied around the neck. Some of the flags are triangular and have a white background with black writing. The image is blurry, and it is difficult to make out the details of the people or the buildings in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white photo depicts a crowd of people gathered on a street. They are wearing conical hats and carrying flags. Some of them are wearing ties and suits. The crowd is gathered in front of a building with signs on the wall. One of the signs reads "White" and "Sparks Electrics Electricians". A car is parked in front of the crowd.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

The image is a black and white photographic negative. It depicts a street scene, likely in a city, filled with people holding flags. The flags are numerous and obscure much of the background details. The view is partially obstructed by a car in the foreground.

In the background, the facades of buildings are visible, with signs for businesses such as "J.G. White & Co.," "Sparks Electric & Electricians," "Express Moving," and a "Vegetarian Restaurant."

The people in the image appear to be participating in a parade or demonstration.

The overall image quality suggests it's an older photograph, possibly from the early to mid-20th century. The negative format inverts the tones, making light areas dark and vice versa.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression:

The image appears to be a historical photograph, likely from the early to mid-20th century. It is in negative, meaning the light and dark values are reversed. The scene depicts a street demonstration or parade with people holding flags and banners. The setting is an urban environment, suggested by the buildings and signs.

Key Elements:

  • Flags and Banners: A prominent feature is the presence of numerous flags and banners. Their shape suggests a parade or protest.
  • People: People are visible in the crowd. The negative style makes their features and clothing appear as white rather than the usual black.
  • Buildings and Signs: The background includes buildings. Signs advertising "Vegetarian Restaurant", "Express Moving", and "Sparks Electric" and "White" are visible, indicating the location is likely a commercial street.
  • Vehicles: A car is visible in the foreground, partially obscuring some of the scene.

Style and Tone:

The photograph's negative style gives it a surreal, somewhat dreamlike or ghostly quality. The overall composition suggests movement and action, likely documenting a public event. It's likely a snapshot of an historical moment.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image appears to be a black-and-white photograph capturing a street scene, likely from the early to mid-20th century. The photograph shows a group of people, possibly in a parade or a public event, as they are gathered around what looks like a vehicle adorned with large, dark fabric or flags. The people are dressed in formal attire, with suits and hats, suggesting the event might be of some significance or formality.

In the background, there are several signs and storefronts, indicating the setting is an urban area. The visible signs include advertisements for businesses such as "To Let," "White," "Express," and "Vermont Restaurant," among others. The architecture of the buildings and the style of the signs suggest a historical context.

The image is credited to the "President and Fellows of Harvard College (Harvard University Art Museums)" and has a reference number "P1970.3914.0000," indicating it is part of an archival collection. The overall scene suggests a moment captured in time, providing a glimpse into the social and cultural atmosphere of the period.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a group of individuals in a parade or public demonstration. The individuals are predominantly dressed in light-colored clothing, with some wearing white coats or suits, which may suggest a uniform or specific affiliation. They are carrying dark flags, which could be part of a protest, rally, or public event.

The background shows urban architecture, including buildings with visible storefronts and signs, one of which reads "JO WHITE 320 FIFTH AVE." There is also a sign for "VEGETARIAN RESTAURANT," suggesting the location might be within a city with some commercial activity. The overall atmosphere and style of the photograph suggest it was taken in the early 20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white historical photograph showing a crowd of people participating in a parade or demonstration. The participants are holding large, dark-colored flags that appear to be waving in the wind. The people are dressed in formal attire, suggesting this event may have taken place in the early 20th century. The background shows tall buildings and storefronts, indicating an urban setting. There are several signs on the buildings, one of which reads "J.O. WHITE" and another "EXPRESS." The photograph has a grainy texture and some wear, indicating its age. The bottom of the image has a caption that reads "© President and Fellows of Harvard College (Harvard University Art Museums) P1970.3914.0000."

Text analysis

Amazon

College
and
Art
University
FIFTH
WHITE
(Harvard
Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
of
Fellows
ELECTRICIANS
Museums)
EXPRESS
AVE
CLOTHING
President
SPARKS
ANT
P1970.3914.0000
320 FIFTH AVE
J.G
VEG
320
WHITE <00
MOVING
SPARKS e
RES
DE
JULEI
e
<00
AC
CON AC
icune
CON
CHAKERING
the

Google

40 WHITE AV ELECTRICIANS EXPRESS ANT @ President and Fellows of Harvard College (Harvard University Art Museums) P1970.3914.0000
40
WHITE
AV
ELECTRICIANS
EXPRESS
ANT
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.3914.0000