Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs House, New York City)

Date

December 1933-March 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3982

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3982

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Sun Hat 100
People 97.2
Face 92.8
Head 92.8
Crowd 81.4
Audience 55.3

Clarifai
created on 2018-05-10

people 99.9
many 99.6
veil 99.3
wear 98.7
man 98.3
crowd 98.3
group 97.7
group together 97.4
monochrome 97.2
lid 97.2
adult 96
woman 95.7
audience 94.4
uniform 93.6
recreation 92.8
stadium 92.2
fedora 91.8
war 90
religion 89.9
spectator 88.7

Imagga
created on 2023-10-07

seat 43.3
chair 38.2
cowboy hat 36.7
hat 29.3
support 28.1
headdress 22.6
clothing 19.2
device 18.3
bell 16.8
travel 15.5
row 14.9
tourism 14.8
building 12.8
acoustic device 11.7
empty 11.3
covering 11.3
landscape 11.2
industry 11.1
event 11.1
vacation 10.6
new 10.5
architecture 10.1
island 10.1
people 10
water 10
city 10
group 9.7
summer 9.6
sea 9.4
consumer goods 9.3
hall 9.3
town 9.3
stone 9.3
coast 9
outdoors 9
furniture 8.9
scenic 8.8
headrest 8.7
rock 8.7
signaling device 8.7
holiday 8.6
rest 8.4
shore 8.4
house 8.4
sky 8.3
pattern 8.2
plane seat 8.1
roof 8
modern 7.7
equipment 7.6
beach 7.6
room 7.4
many 7.4
lake 7.3
business 7.3
industrial 7.3
sun 7.2
rural 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

indoor 89.3
posing 40.4
crowd 1.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 57-65
Gender Male, 84.2%
Fear 97.1%
Surprised 6.3%
Calm 4.7%
Sad 2.4%
Happy 0.4%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.5%
Calm 49.2%
Fear 16.9%
Disgusted 12.9%
Surprised 8.5%
Happy 6.8%
Sad 4%
Confused 3.5%
Angry 1.7%

AWS Rekognition

Age 38-46
Gender Male, 70.4%
Calm 94.7%
Surprised 6.8%
Fear 6.1%
Sad 2.8%
Angry 0.6%
Confused 0.4%
Disgusted 0.4%
Happy 0.3%

Feature analysis

Amazon

Adult
Male
Man
Person
Baby
Hat

Clarifai

Human face
Man
Clothing
Hat
Human nose
Human head

AWS Rekognition

Adult 98.3%

AWS Rekognition

Adult 97.5%

AWS Rekognition

Adult 97.3%

AWS Rekognition

Adult 97.2%

AWS Rekognition

Adult 96.8%

AWS Rekognition

Adult 92.2%

AWS Rekognition

Male 98.3%

AWS Rekognition

Male 97.5%

AWS Rekognition

Male 97.3%

AWS Rekognition

Male 97.2%

AWS Rekognition

Male 96.8%

AWS Rekognition

Male 92.2%

AWS Rekognition

Man 98.3%

AWS Rekognition

Man 97.5%

AWS Rekognition

Man 97.3%

AWS Rekognition

Man 97.2%

AWS Rekognition

Man 96.8%

AWS Rekognition

Man 92.2%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 92.9%

AWS Rekognition

Person 92.6%

AWS Rekognition

Person 92.2%

AWS Rekognition

Person 91%

AWS Rekognition

Person 83.9%

AWS Rekognition

Person 83.4%

AWS Rekognition

Person 82.9%

AWS Rekognition

Person 76.3%

AWS Rekognition

Person 72.6%

AWS Rekognition

Person 67.9%

AWS Rekognition

Person 67.5%

AWS Rekognition

Person 65.7%

AWS Rekognition

Person 61.1%

AWS Rekognition

Baby 92.6%

AWS Rekognition

Baby 83.4%

AWS Rekognition

Baby 82.9%

AWS Rekognition

Baby 76.3%

AWS Rekognition

Hat 83.2%

AWS Rekognition

Hat 58.5%

Clarifai

Human face 95%

Clarifai

Human face 90.5%

Clarifai

Human face 85.8%

Clarifai

Human face 83.8%

Clarifai

Human face 79.2%

Clarifai

Human face 68.3%

Clarifai

Human face 65.7%

Clarifai

Human face 64.4%

Clarifai

Human face 60.2%

Clarifai

Human face 54.1%

Clarifai

Human face 52%

Clarifai

Human face 49.9%

Clarifai

Human face 49.1%

Clarifai

Human face 47.8%

Clarifai

Human face 39.3%

Clarifai

Human face 35.5%

Clarifai

Human face 33%

Clarifai

Man 83.7%

Clarifai

Man 83.7%

Clarifai

Man 83.2%

Clarifai

Man 82.5%

Clarifai

Man 68.5%

Clarifai

Man 66.4%

Clarifai

Man 65.1%

Clarifai

Man 64.9%

Clarifai

Man 55.1%

Clarifai

Man 54.8%

Clarifai

Man 47.6%

Clarifai

Man 43.7%

Clarifai

Man 40.6%

Clarifai

Man 38.7%

Clarifai

Man 38.2%

Clarifai

Clothing 78.4%

Clarifai

Clothing 42.1%

Clarifai

Clothing 40.3%

Clarifai

Hat 48.1%

Clarifai

Hat 47.7%

Clarifai

Hat 44.5%

Clarifai

Hat 43.3%

Clarifai

Hat 41%

Clarifai

Hat 40.9%

Clarifai

Hat 36.6%

Clarifai

Hat 35.1%

Clarifai

Hat 34.1%

Clarifai

Human nose 38.2%

Clarifai

Human head 36.6%

Categories

Imagga
created on 2023-10-07

paintings art 77.7%
streetview architecture 14.2%
interior objects 2.8%
people portraits 2.5%
food drinks 1.2%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-04

a crowd of people wearing hats and holding signs

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a large group of men in white hats and hats

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This is a black-and-white negative image of a densely packed crowd, consisting primarily of men wearing suits, ties, and a variety of hats, such as fedoras and flat caps. The image captures an organized gathering or protest, as the background shows signs with messages, although the inverted colors make the text challenging to read clearly. The atmosphere suggests a historical context, such as a labor movement or political demonstration. The image has a striking and dramatic tone due to its negative format, highlighting contrasts and textures in the clothing and hats.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a photographic negative showing a large crowd of people gathered together, appearing to be at some kind of demonstration or protest. Most of the individuals are wearing suits, overcoats, and fedora-style hats, typical attire of an earlier 20th-century period. The composition is packed with people, suggesting a dense gathering. Various signs or placards are visible being held up above the crowd, with inscriptions such as "WORKERS LEAGUE," "BOUND BROOK LOCAL 14," and "WE WORK FOR [numbers not clear]."

The use of a negative image inverts the colors, giving a surreal quality to the scene. The negative effect makes the skin tones dark, while the hats and clothes appear in light shades. Despite being a negative, you can detect a sense of camaraderie and solidarity in the crowd, inferred from the close proximity of the individuals and the presence of the placards advocating for rights or recognition.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a large crowd of people gathered together, with many of them wearing hats or other headwear. The crowd appears to be in a public space, possibly at a protest or demonstration. The image is in black and white, giving it a historic feel. The people in the crowd are closely packed together, creating a dense and chaotic visual effect. Overall, the image conveys a sense of a large gathering of people, likely for some kind of social or political purpose.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a striking black and white photograph that appears to be from an earlier era, likely the 1930s or 1940s. It shows a dense crowd of people wearing fedoras and other period hats along with what appear to be light-colored overcoats or suits. The image creates a fascinating pattern of repeating shapes from the hats and shoulders of the crowd members. In the background, there appear to be some protest or demonstration signs, though their text is only partially visible. The photograph has a powerful compositional quality, with the sea of hats creating an almost abstract pattern across the frame. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a crowd of men, likely taken in the early 20th century. The men are dressed in suits and hats, with some holding signs that appear to be related to labor or union issues. The overall atmosphere suggests a protest or rally, with the men gathered together to express their views or demands.

The image is a historical document that provides insight into the social and political climate of the time. It may have been taken during a significant event or movement, such as the labor rights movement or the Great Depression. The presence of signs and banners indicates that the men are advocating for change or reform, and the image may have been used to raise awareness about their cause.

The image is a valuable resource for historians, researchers, and anyone interested in understanding the past. It offers a glimpse into the lives and experiences of people from a different era, and can help to inform our understanding of the present day.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image depicts a black-and-white photograph of a crowd of people, predominantly men, gathered together. The majority of the individuals are wearing hats, and some are holding signs that appear to be related to labor or worker's rights issues. The overall atmosphere suggests a protest or rally, with the crowd likely advocating for better working conditions or higher wages. The image conveys a sense of unity and determination among the protesters as they come together to express their concerns and demands.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph depicting a large crowd of people gathered in an outdoor setting. The individuals are dressed in suits and hats, suggesting a formal or serious occasion. The crowd is densely packed, with many people standing closely together, creating a sense of unity and purpose. Some individuals in the crowd are holding signs with slogans or messages, indicating that they are participating in a protest or demonstration. The photograph captures a moment of collective action, with the crowd's energy and determination palpable in the image.

Created by amazon.nova-pro-v1:0 on 2025-06-10

A black-and-white photo shows a crowd of people gathered in an outdoor area. They are all wearing hats, and some of them are wearing glasses. They are standing in front of a signboard with some text written on it. The crowd seems to be engaged in a protest, as they are holding up signs and banners. The image has a watermark in the bottom left corner.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

Certainly! Here's a description of the image:

Overall Impression:

The image is a high-contrast black and white photograph, potentially a negative. It depicts a dense crowd of men, mostly wearing hats, likely participating in some kind of demonstration or gathering. There are signs visible within the crowd, suggesting that it is some kind of labor protest or rally.

Key Elements:

  • Crowd: The majority of the frame is filled with a densely packed crowd. The faces of the people are mostly obscured by hats.
  • Hats: A wide variety of hats are worn by the men, including fedoras, newsboy caps, and other styles typical of the mid-20th century.
  • Signs: Several signs are held up within the crowd. One sign reads "WORKERS LEAGUE BRONX LOCAL" and another reads "3,000 WE WORK FOR $13.44 WAGES SKILLED".
  • Clothing: The men appear to be dressed in suits or jackets and ties, typical attire for the time period.

Context and Interpretation:

Based on the visible signs and the style of clothing, it appears this image depicts a labor protest or rally, likely from the mid-20th century. The signs highlight concerns regarding wages and worker's rights. The dense crowd and the uniform dress code suggest a sense of solidarity among the participants.

Overall, the image likely intends to document and convey the atmosphere of a labor rights gathering, possibly highlighting the economic struggles and unified spirit of workers during that era.

Created by gemini-2.0-flash-lite on 2025-06-03

This black and white photograph presents a large crowd of men, predominantly dressed in suits and fedora hats. The men are tightly packed together, suggesting a gathering or demonstration. In the background, signs are visible, suggesting that the men are part of some protest or demonstration. One of the signs mentions "WE WORK FOR $13.44," indicating concerns about wages. The image has a strong historical feel, likely dating back to the mid-20th century, given the clothing style and the presence of printed signs. The overall composition is dense, with a sea of hats and faces filling the frame, emphasizing the scale of the gathering.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This black-and-white photograph depicts a large crowd of people, primarily men, gathered closely together. Many of the individuals are wearing hats, which was a common fashion of the time, and some are dressed in suits or work clothes. The image appears to be taken from a slightly elevated angle, capturing a dense and expansive view of the crowd.

In the background, there are signs and banners, one of which reads "WORKERS LEAGUE" and "WE WORK FOR $13.44 A WEEK ON W.P.A." This suggests that the gathering is likely a protest or rally, possibly related to labor rights or economic conditions during the Great Depression era. The attire and the nature of the signs indicate that this event took place in the mid-20th century.

The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums), indicating it is part of a historical or archival collection. The image conveys a sense of collective action and solidarity among the participants.

Qwen

Text analysis

Amazon

Harvard
College
and
Museums)
Art
University
(Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
of
WORK
Fellows
WE WORK FOR
13.
FOR
WE
13. 44
44
LOCAL
WORKERS
President
WAGES
LEAGUE
P1970.3982.0000
LINES
TOR
BRONX LOCAL
NOCOAL LINES
BRONX
NOCOAL
EGRODAL TOR
III
UNTOR WAGES
RELIEF
SKILLE
EVERY P
MALL
EGRODAL
AC
koz
WACE CUB
10.000
UNTOR
SUP
ma
6PD

Google

WE WORK FOR P1970.3982.0000 @ President and Fellows of Harvard College (Harvard University Art Museums)
WE
WORK
FOR
P1970.3982.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)