Human Generated Data

Title

Untitled (Civil Works Administration demonstration, near the United States Customs House, New York City)

Date

December 1933-March 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5588

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, near the United States Customs House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5588

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Clothing 100
Apparel 100
Hat 99.7
Human 99.5
Person 99.5
Person 98.3
Person 98.3
Person 98.1
Hat 97
Person 95.8
Sun Hat 94.8
Hat 94.4
Person 94.1
Hat 93.9
Person 91
Person 85.3
Hat 85.3
Person 84.8
Person 84.5
Hat 82.9
Cowboy Hat 82.2
Person 81.7
Person 79.2
Person 78.2
Hat 72.6
Hat 71.9
Hat 70.3
Person 63.4
Crowd 61.9
Hat 60.7
Person 48.5

Clarifai
created on 2019-11-11

people 99.9
many 99.9
veil 99.7
group 99.6
group together 99.4
crowd 98.9
man 98.6
lid 98.2
adult 97.5
audience 97.2
spectator 95.8
leader 95.6
military 94.8
fedora 94.5
wear 94.4
outfit 92.9
war 91.7
uniform 90.1
administration 89.4
woman 89.4

Imagga
created on 2019-11-11

cowboy hat 100
hat 100
headdress 100
clothing 70.6
consumer goods 38.1
covering 37.7
food 16.3
coins 15.4
money 15.3
business 15.2
market 14.2
currency 13.5
close 13.1
many 12
bank 11.6
banking 11
cash 11
wealth 10.8
group 10.5
metal 10.5
dinner 10.2
treasure 9.6
pattern 9.6
coin 9.5
finance 9.3
drink 9.2
objects 8.7
table 8.6
restaurant 8.6
savings 8.4
banquet 8.4
investment 8.2
meal 8.2
closeup 8.1
financial 8
breakfast 7.9
change 7.7
eat 7.5
tea 7.5
coffee 7.4
china 7.4
beverage 7.3
success 7.2
concepts 7.1
summer 7.1

Google
created on 2019-11-11

Microsoft
created on 2019-11-11

hat 98.9
person 97.6
clothing 96.2
man 84.8
fedora 83.5
fashion accessory 80.2
cowboy hat 79.8
sun hat 73.8
group 58
crowd 6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 33-49
Gender Male, 98.5%
Angry 0%
Calm 99.9%
Happy 0%
Fear 0%
Surprised 0%
Disgusted 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 34-50
Gender Male, 54.9%
Angry 45%
Disgusted 45%
Surprised 45%
Happy 45.1%
Sad 45.2%
Fear 45%
Confused 45%
Calm 54.6%

AWS Rekognition

Age 24-38
Gender Male, 55%
Sad 45.3%
Fear 45.1%
Angry 45.4%
Happy 45.2%
Disgusted 45.1%
Calm 53.8%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Angry 45%
Sad 53.6%
Calm 46.3%
Confused 45%
Fear 45%
Surprised 45%
Happy 45%
Disgusted 45%

AWS Rekognition

Age 34-50
Gender Male, 92.1%
Disgusted 0%
Fear 0%
Calm 99.8%
Sad 0.1%
Happy 0%
Angry 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 33-49
Gender Male, 54.7%
Sad 46.1%
Calm 48.8%
Angry 49.8%
Happy 45%
Disgusted 45.1%
Fear 45%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 26-40
Gender Male, 55%
Disgusted 45.1%
Fear 45%
Sad 45.6%
Happy 45%
Angry 45.1%
Calm 54.1%
Confused 45%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Male, 53.7%
Fear 45%
Calm 53.2%
Happy 46.4%
Sad 45.3%
Surprised 45%
Disgusted 45%
Angry 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Male, 54%
Happy 45.4%
Calm 46.7%
Sad 45.3%
Fear 45.4%
Disgusted 45%
Surprised 45.6%
Confused 45.1%
Angry 51.4%

AWS Rekognition

Age 21-33
Gender Female, 50.8%
Disgusted 45.1%
Angry 45.4%
Calm 49.8%
Happy 48.2%
Fear 45.1%
Confused 45.1%
Sad 45.9%
Surprised 45.4%

AWS Rekognition

Age 22-34
Gender Male, 98%
Disgusted 1.9%
Calm 82.4%
Confused 1.1%
Happy 0.3%
Fear 0.7%
Angry 0.8%
Sad 11.8%
Surprised 1.1%

AWS Rekognition

Age 23-35
Gender Male, 51%
Calm 46.3%
Sad 52%
Fear 46.1%
Confused 45.1%
Angry 45.2%
Disgusted 45.2%
Happy 45%
Surprised 45%

AWS Rekognition

Age 30-46
Gender Male, 54.8%
Happy 45%
Disgusted 45.1%
Surprised 45%
Calm 47.6%
Fear 45%
Sad 52.3%
Confused 45%
Angry 45%

AWS Rekognition

Age 21-33
Gender Male, 52.2%
Surprised 45.1%
Sad 45.4%
Angry 45.3%
Calm 53.2%
Fear 45%
Disgusted 45.9%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 32-48
Gender Male, 54.9%
Confused 45%
Sad 45%
Angry 45%
Happy 45%
Fear 45%
Disgusted 45%
Surprised 45%
Calm 55%

AWS Rekognition

Age 29-45
Gender Male, 52.5%
Disgusted 45.1%
Calm 50.9%
Angry 45%
Confused 45%
Fear 45%
Sad 45.1%
Happy 48.7%
Surprised 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54.5%
Happy 45.1%
Disgusted 45.2%
Confused 45.1%
Fear 45%
Surprised 45.1%
Sad 45.7%
Calm 53.6%
Angry 45.2%

AWS Rekognition

Age 21-33
Gender Male, 54.6%
Angry 45.3%
Surprised 45%
Calm 49%
Confused 45.1%
Happy 45.1%
Disgusted 45%
Sad 50.5%
Fear 45%

AWS Rekognition

Age 26-40
Gender Male, 54.5%
Calm 54.2%
Fear 45%
Sad 45.8%
Angry 45%
Surprised 45%
Happy 45%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 33-49
Gender Male, 54.1%
Calm 45.1%
Disgusted 45%
Confused 45%
Fear 45.1%
Happy 45%
Angry 45.2%
Surprised 45%
Sad 54.6%

AWS Rekognition

Age 30-46
Gender Male, 52.4%
Happy 45%
Sad 45%
Disgusted 45%
Confused 45%
Calm 54.9%
Angry 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 16-28
Gender Male, 54.7%
Calm 45.6%
Fear 45.3%
Disgusted 45.1%
Happy 45.6%
Angry 45.5%
Sad 52.5%
Confused 45.3%
Surprised 45.2%

AWS Rekognition

Age 29-45
Gender Male, 52.9%
Disgusted 45%
Angry 45.1%
Calm 54.6%
Surprised 45.1%
Fear 45%
Happy 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 44-62
Gender Male, 54.9%
Confused 45%
Angry 45%
Fear 45%
Disgusted 45%
Calm 55%
Surprised 45%
Happy 45%
Sad 45%

AWS Rekognition

Age 28-44
Gender Male, 53.7%
Disgusted 45%
Calm 46.3%
Surprised 45.1%
Fear 45.1%
Angry 45.1%
Confused 45%
Sad 53.3%
Happy 45%

AWS Rekognition

Age 49-67
Gender Male, 55%
Angry 45.1%
Calm 45.9%
Surprised 45%
Fear 45.2%
Happy 45%
Confused 45%
Disgusted 45%
Sad 53.7%

AWS Rekognition

Age 36-54
Gender Male, 54.8%
Calm 46.6%
Disgusted 45.1%
Angry 46.9%
Fear 45.3%
Sad 50.5%
Confused 45.1%
Surprised 45.1%
Happy 45.4%

AWS Rekognition

Age 23-37
Gender Male, 60%
Disgusted 0.1%
Fear 37.5%
Sad 30.1%
Calm 0.9%
Angry 30.8%
Confused 0.2%
Happy 0.1%
Surprised 0.3%

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Fear 45.4%
Confused 45.4%
Sad 50.3%
Happy 45.1%
Disgusted 45.2%
Calm 47.8%
Angry 45.9%
Surprised 45.1%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Surprised 45%
Sad 45.5%
Angry 45%
Disgusted 45%
Calm 54.4%
Confused 45%
Fear 45%
Happy 45%

AWS Rekognition

Age 39-57
Gender Male, 54.2%
Angry 45.3%
Disgusted 47.4%
Confused 45.2%
Sad 50.8%
Calm 45.5%
Surprised 45.1%
Fear 45.5%
Happy 45.1%

AWS Rekognition

Age 49-67
Gender Female, 50%
Calm 50.2%
Sad 46.1%
Confused 45%
Fear 45%
Surprised 45%
Disgusted 45%
Happy 48.6%
Angry 45%

AWS Rekognition

Age 32-48
Gender Male, 51.5%
Calm 50.6%
Sad 48.6%
Angry 45.3%
Fear 45.2%
Disgusted 45%
Surprised 45%
Confused 45.1%
Happy 45.2%

AWS Rekognition

Age 13-25
Gender Female, 54.2%
Fear 45.5%
Sad 49.5%
Disgusted 45.1%
Surprised 45.1%
Happy 48.2%
Angry 45.9%
Confused 45.1%
Calm 45.6%

AWS Rekognition

Age 17-29
Gender Female, 54.4%
Surprised 50.2%
Fear 45.4%
Calm 48.7%
Confused 45.1%
Sad 45.1%
Angry 45.3%
Disgusted 45%
Happy 45.1%

AWS Rekognition

Age 24-38
Gender Male, 54.6%
Happy 46.5%
Sad 45.9%
Fear 45.1%
Confused 45.1%
Disgusted 45.1%
Calm 51.8%
Surprised 45.1%
Angry 45.6%

AWS Rekognition

Age 3-9
Gender Male, 52.6%
Sad 45.4%
Calm 54.1%
Surprised 45.2%
Confused 45%
Fear 45.1%
Happy 45.1%
Disgusted 45%
Angry 45.1%

AWS Rekognition

Age 32-48
Gender Male, 53.8%
Fear 45%
Disgusted 45%
Sad 45.1%
Angry 45%
Happy 45%
Calm 54.8%
Surprised 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Male, 50.3%
Surprised 49.5%
Sad 49.8%
Angry 49.5%
Calm 50.2%
Fear 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 18-30
Gender Male, 50.2%
Angry 50.4%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 39-57
Gender Female, 51.5%
Calm 48.4%
Angry 45.7%
Disgusted 45.1%
Surprised 45.1%
Happy 45.8%
Fear 45.3%
Confused 45.1%
Sad 49.5%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Feature analysis

Amazon

Hat
Person
Hat 99.7%
Hat 97%
Hat 94.4%
Hat 93.9%
Hat 85.3%
Hat 82.9%
Hat 72.6%
Hat 71.9%
Hat 70.3%
Hat 60.7%
Person 99.5%
Person 98.3%
Person 98.3%
Person 98.1%
Person 95.8%
Person 94.1%
Person 91%
Person 85.3%
Person 84.8%
Person 84.5%
Person 81.7%
Person 79.2%
Person 78.2%
Person 63.4%
Person 48.5%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a large group of people standing around a crowd -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a large gathering or crowd of men, with most of them wearing hats and overcoats, suggesting a historical context, possibly in the early- to mid-20th century. They appear to be attending an event, rally, or protest as placards are visible in the background. The overall mood seems participatory and serious. The attire indicates cold weather or a formal setting.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows a large crowd of people, primarily men, wearing suits and a variety of hats, such as fedoras and bowler hats. The gathering seems to be an event, possibly a rally or a protest, given the presence of signs or placards being held up among the crowd. The photograph appears to be in black and white, suggesting it is from an earlier time period, likely the early to mid-20th century. The overall atmosphere is that of a densely packed crowd, indicating a significant public gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a large crowd of people, mostly men, wearing hats and coats. The crowd appears to be gathered in an outdoor setting, possibly a public square or street. The people in the image are wearing clothing typical of the early to mid-20th century, suggesting this is an historical photograph. The image has a sepia-toned quality, further indicating its age. Overall, the image conveys a sense of a bustling, crowded scene from the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-12

The black and white photograph depicts a large crowd of men, likely at some kind of public gathering or event. They are all wearing hats and coats, suggesting it may be a cooler time of year. The men appear to be closely packed together, filling the frame, with many of their faces visible as they look towards the camera or off to the side. There seems to be a sense of seriousness or purpose to the gathering based on their expressions and the density of the crowd. The sepia tones and style of dress give the image a distinct vintage feel, likely dating back many decades. Without more context it's difficult to say exactly what has brought this sizable group together, but the image captures a fascinating snapshot of a crowd from a bygone era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a striking black and white historical photograph showing a large crowd of men all wearing fedora-style hats. The image appears to be from the early 20th century, given the style of dress and photographic quality. What's particularly notable is the uniformity of the headwear - almost every single person in the frame is wearing a similar dark-colored fedora or bowler hat. The men are dressed formally in what appears to be winter coats or suits. The crowd is densely packed, creating an interesting pattern of hat brims that extends throughout the frame. This kind of image is representative of the fashion norms of the era, when men rarely appeared in public without a hat.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black and white photograph of a large crowd of men, likely from the early 20th century.

The crowd is densely packed, with men standing shoulder to shoulder. They are all wearing coats and hats, with many of them wearing fedoras or other types of soft felt hats. Some of the men are also wearing suits and ties.

In the background, there are signs visible, but they are not legible. The overall atmosphere of the image suggests that the men are gathered for a protest or rally, possibly related to labor rights or social justice issues.

The image has a vintage feel to it, with the black and white photography and the style of clothing giving it a sense of nostalgia and historical significance.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image depicts a large crowd of men gathered together, all wearing hats. The men are dressed in coats and appear to be standing in a public area, possibly during a protest or rally. The atmosphere seems tense, with the men's faces set in determined expressions.

In the background, several signs can be seen, although the text is not legible. The overall mood of the image suggests a sense of urgency and importance, as if the men are gathered to address a pressing issue or demand change. The use of hats as a uniform element adds a sense of unity and solidarity among the group, emphasizing their shared purpose and commitment to their cause.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a monochromatic photograph depicting a large crowd of people gathered outdoors, possibly for a protest or rally. The people are dressed in hats and coats, suggesting that the event took place in a colder climate. The crowd is tightly packed, with many people standing shoulder to shoulder, and the image captures a sense of unity and shared purpose among the attendees.

The photograph has a vintage look, with a sepia tone and a slightly grainy texture, which suggests that it was taken several decades ago. The image is cropped tightly, focusing on the faces and upper bodies of the people in the crowd, and the background is mostly out of focus, which adds to the sense of anonymity and collective identity of the participants.

Overall, the image conveys a sense of social activism and collective action, with the people in the crowd appearing to be united in their cause and determined to make their voices heard. The photograph serves as a powerful reminder of the power of collective action and the importance of standing up for one's beliefs.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image shows a black-and-white photograph of a crowd of people. The crowd consists of men, all wearing hats and coats. The hats are of different styles, including fedora, bowler, and trilby. The men appear to be gathered in an outdoor area, possibly for a protest or rally. Some of the men are holding placards with slogans written on them, while others are simply standing and observing. The image captures a moment in time, showcasing the diversity of the crowd and their shared purpose.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

The image shows a large crowd of men, most of whom are wearing hats, seemingly gathered in a public space. The photograph has a vintage, sepia-toned appearance, likely taken in the early to mid-20th century.

Here are some observations:

  • Density: The crowd is packed tightly together, suggesting a significant event or gathering.
  • Attire: The men's clothing, with the prevalence of hats and overcoats, reinforces the historical context of the photo.
  • Signs: There are signs held up by some individuals, though the text is not entirely clear. It appears one sign might say "WORK FOR $13".
  • Facial expressions: The men's expressions range from serious to pensive, offering a glimpse into their thoughts and feelings.
  • Composition: The shot is taken from a relatively close angle, giving a sense of the size and energy of the crowd.

Overall, it's likely a scene from a protest or demonstration, maybe even a labor movement event, possibly from the Great Depression era, considering the sign and the social context of the time.

Created by gemini-2.0-flash on 2025-04-30

The sepia-toned photograph captures a large crowd of people, mostly men, wearing hats, which suggests a historical setting, likely from the early to mid-20th century. The dense gathering of individuals, shoulder to shoulder, indicates a protest or rally of some kind.

In the distance, signs can be seen held up by some members of the crowd, although the exact wording is somewhat difficult to discern without higher resolution. However, the text "WE WORK FOR $13" can be made out.

The overall impression is of a group of people assembled to voice their concerns, likely related to their employment or economic conditions. The uniformity in dress, with many wearing similar hats and coats, could suggest a common profession or social status among the crowd.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image depicts a large crowd of people gathered outdoors, likely at a public event or rally. The majority of the individuals are wearing hats, which appear to be fedoras, bowler hats, and other styles typical of the early to mid-20th century. The attire of the people, including overcoats and suits, suggests that the event took place during a cooler season. The crowd is densely packed, with people standing close together, and many are looking in the same direction, possibly towards a speaker or a focal point of interest.

In the background, there are signs and banners, though the text on them is not clearly legible. The overall atmosphere seems to be one of attention and anticipation, indicating that the gathering might be for a significant event, such as a political rally, protest, or public announcement. The sepia tone of the photograph suggests it is an older image, possibly from the early to mid-20th century.

Text analysis

Amazon

Cha,

Google

Cho 40 ORI
Cho
40
ORI