Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

Date

April 20, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.3

Human Generated Data

Title

Untitled (Artist Union demonstration, College Art Association offices, 137 E 57th Street, New York City, against work regulations and layoffs at the Lenox Hill Settlement House artist teaching work-relief Project 259)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 20, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2003.27.3

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Parade 98.8
Protest 98.8
People 98.5
Transportation 94.3
Vehicle 94.3
Clothing 84.7
Coat 84.7
Face 81.4
Head 81.4
Text 78.4
Machine 70.5
Body Part 57.5
Finger 57.5
Hand 57.5
Jacket 55.4

Clarifai
created on 2018-05-11

people 98.4
crowd 94.5
man 94.5
group 92.8
street 91.9
action 91.4
retro 90.7
support 90.4
bill 90.3
movie 90.3
newspaper 90
woman 89.3
banner 86.4
adult 85.4
coverage 85.3
monochrome 84.5
military 83.8
flag 79.6
demonstration 79.5
business 79.1

Imagga
created on 2023-10-05

flag 32
emblem 22.4
man 20.8
male 18.4
business 18.2
black 18
silhouette 17.4
newspaper 16.9
person 16.8
money 14.5
product 14.1
slick 13.9
barbershop 13.7
megaphone 13
daily 13
currency 12.6
people 12.3
shop 11.8
bill 11.4
creation 11.3
design 11.2
old 11.1
cash 11
finance 11
symbol 10.8
hand 10.6
acoustic device 10.6
sign 10.5
financial 9.8
businessman 9.7
mercantile establishment 9.4
device 9.4
dollar 9.3
portrait 9.1
bank 9
success 8.8
conceptual 8.8
billboard 8.8
art 8.7
world 8.7
letter 8.2
group 8.1
graphic 8
information 8
to 8
signboard 7.9
architecture 7.8
hundred 7.7
men 7.7
modern 7.7
close 7.4
religion 7.2

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

text 91.1
sale 26

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 50-58
Gender Female, 97.9%
Calm 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 1.3%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Female, 98.2%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Car
Hat
Wheel

Clarifai

Man
Clothing
Human face
Human hair
Human hand
Human arm

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 98.2%

AWS Rekognition

Adult 96.9%

AWS Rekognition

Adult 96.5%

AWS Rekognition

Female 99.1%

AWS Rekognition

Female 98.5%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 81%

AWS Rekognition

Person 67%

AWS Rekognition

Woman 99.1%

AWS Rekognition

Woman 98.5%

AWS Rekognition

Male 98.2%

AWS Rekognition

Male 96.9%

AWS Rekognition

Male 96.5%

AWS Rekognition

Man 98.2%

AWS Rekognition

Man 96.9%

AWS Rekognition

Man 96.5%

AWS Rekognition

Car 94.3%

AWS Rekognition

Car 83.9%

AWS Rekognition

Car 55.8%

AWS Rekognition

Hat 73.6%

AWS Rekognition

Hat 66.7%

AWS Rekognition

Wheel 70.5%

AWS Rekognition

Wheel 59.6%

Clarifai

Man 94.5%

Clarifai

Man 84%

Clarifai

Clothing 90.4%

Clarifai

Clothing 85.6%

Clarifai

Clothing 41.7%

Clarifai

Clothing 40%

Clarifai

Human face 89.1%

Clarifai

Human face 85.4%

Clarifai

Human face 51.6%

Clarifai

Human hair 43.4%

Clarifai

Human hair 40.2%

Clarifai

Human hand 38.4%

Clarifai

Human arm 36.1%

Categories

Imagga
created on 2023-10-05

paintings art 83.1%
text visuals 16.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-30

a photograph of a group of people holding signs that read stop all of us

Created by general-english-image-caption-blip-2 on 2025-07-06

a black and white photo of people holding signs

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This black-and-white image depicts a protest or rally scene with people holding signs advocating for various causes related to labor and art. One sign reads "TOP ALL LAYOFFS, ARTISTS UNION," with a listed address of "60 West 15th St." Another sign states, "HUNDREDS OF PUBLIC BUILDINGS NEED DECORATION MURALS." The background contains a cityscape with vintage cars and buildings, suggesting the image is from an earlier era. The atmosphere conveys civic engagement and advocacy for artists and public works projects.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a street scene that is part of a protest or demonstration involving individuals carrying signs. The signs contain messages related to the arts and employment, with phrases such as "TOP ALL LAYOFFS" and "Artists Union 60 West 15th Street" and another message urging "Hundreds of Public Buildings Need Decoration Murals." The background shows a cityscape with buildings and classic cars, suggesting it is set in a historical context, likely mid-20th century. The style of clothing and vehicles supports this time period.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting a street scene with a group of people holding protest signs. The signs include slogans such as "Top All Ayoffs Artists Union" and "Hundreds of Public Need Decoration Murals". The people in the image seem to be engaged in some form of public demonstration or protest. The background shows buildings and vehicles typical of an urban setting. The overall scene conveys a sense of social activism and political engagement.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph showing what appears to be a protest or demonstration. The image shows protesters holding signs, with one clearly visible sign reading "TOP ALL LAYOFF! ARTISTS UNION" and another partially visible sign mentioning "HUNDREDS" and "DECORATION MURALS." The scene appears to be from an urban setting, with some old cars visible in the background. The protesters are wearing clothing that appears to be from around the 1930s, suggesting this may be from the Great Depression era when artists and other workers were advocating for employment opportunities and rights. The photo has the characteristic look of period photography, with film sprocket holes visible at the edges of the frame.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a group of people holding signs and protesting on a city street.

In the foreground, several individuals are visible, each holding a sign with a message. The signs are the primary focus of the image, with one sign reading "TOP ALL PAYOFFS ARTISTS UNION 60 WEST 15-ST." Another sign is partially visible, but it appears to say "HUNDREDS PUNK BUILDING NEED DECORATION MURALS." A third sign is not fully visible, but it seems to be related to the protest.

The background of the image shows a city street with buildings and cars. The overall atmosphere of the image suggests a sense of activism and protest, with the group of people gathered together to express their concerns and demands.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a group of people participating in a protest or demonstration. The individuals are holding signs with various messages, including "TOP ALL AYOFFS" and "HUNDREDS PUBLIC BUILDINGS NEED DECORATION MURALS." The scene appears to be set in an urban environment, with buildings and cars visible in the background. The overall atmosphere suggests a sense of activism and advocacy for a particular cause.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

A black-and-white image shows people holding placards and walking on the street, which seems like a protest. The placards have some text on them, such as "TOP ALL LAYOFFS ARTISTS UNION" and "ANY HUNDREDS PUBLIC BUILDING NEED DECORATION MURALS." The person in front is wearing a hat and a coat. A car is moving on the road behind them. The buildings are on either side of the road.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph showing a group of people marching in a protest. The individuals are holding placards with various slogans and messages. The woman in the foreground holds a placard that reads "TOP ALL PAYOFFS," while the man behind her holds a placard that reads "AN HUNDREDS PUBLIC BUILDINGS NEED DECORATION MURALS." They are walking down a street lined with buildings, and there are other people and vehicles in the background. The image has a vintage look, suggesting it was taken in the past.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

The photograph captures a street scene during what appears to be a protest. Several people are seen holding signs with various slogans.

In the foreground, a woman holds a sign that reads "TOP ALL AYOFFS ARTISTS UNION 60 WEST 15% ST." She is dressed in a jacket and has a stern expression on her face. Behind her, another woman is holding a sign that's partially obscured.

To the right, a sign reads "HUNDREDS PUBLIC BUILDNINGS NEED DECORATION MURALS". A man wearing a suit holds this sign, with his back to the camera.

In the background, there are other protesters, as well as buildings and parked cars lining the street. The image is in black and white, and the film frame around the edges is visible, with the number "8" at the top right corner.

Created by gemini-2.0-flash-lite on 2025-05-29

This is a black and white photograph of a protest in the style of a vintage news photo. The photo is cropped with the edges of the film strip showing. The main subject is a group of people holding signs with different messages.

The sign in the foreground, held by a woman, reads "TOP ALL AYOFFS" followed by "ARTISTS UNION 60 WEST 15 ST." The woman is facing the camera, and she and the woman behind her seem to be the focus of the photo. The man in the middle ground carries a sign which says "HUNDREDS PUBLIC BUILDINGS NEED DECORATION MURALS". Other people are carrying signs too, but their messages are not fully visible.

The photo has a classic, somewhat grainy quality, consistent with older photographic techniques. The background suggests a city street with buildings and several vintage cars parked along the curb. The overall tone of the photo suggests a social commentary or historical documentation of an artist's union's protest.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a group of people participating in a protest or demonstration, likely from the mid-20th century. The demonstrators are holding signs with bold, hand-painted messages.

One sign reads:
"HUNDREDS OF PUBLIC BUILDINGS NEED DECORATION MURALS"

Another sign reads:
"STOP ALL PAYOFFS! ARTISTS UNION 60 WEST 15th ST."

The demonstrators are dressed in formal attire typical of the era, with men wearing suits and hats, and women wearing dresses and coats. The scene appears to be set in an urban environment, with buildings and vehicles visible in the background. The demonstrators seem to be advocating for better pay or conditions for artists, possibly in relation to public art projects or murals. The presence of a police officer suggests that the demonstration is orderly and being monitored.

Qwen

No captions written

Text analysis

Amazon

ALL
TOP
DECORATION
MURALS
8
PUBLIC
HUNDREDS
AYOFFS
60
NEED
AY
ING
UNION
ST.
WEST
RTISTS UNION
A
60 WEST 15 ST.
RTISTS
B
U
ONS"
PUBLIC BULLING
15
BULLING

Google

8 ALL AYOFF RTISTSUNION NG NS 8 Ay
8
ALL
AYOFF
RTISTSUNION
NG
NS
Ay