Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4114

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4114

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Arch 98.1
Architecture 98.1
Crowd 97.5
Silhouette 96.6
City 93.2
Metropolis 93.2
Urban 93.2
People 91
Face 88.2
Head 88.2
Outdoors 72.6
Audience 65.7
Bridge 62.1
Concert 56.9
Nature 56.3
Night 56.3

Clarifai
created on 2018-05-10

people 99.4
monochrome 96.5
music 95.6
adult 95.5
group together 95.4
many 94.7
group 94.4
man 93.9
war 93.5
vehicle 91.5
crowd 91.5
wear 91.2
theater 90.6
military 85.8
no person 83.4
recreation 82.9
stage 82.6
transportation system 82.6
child 81.4
woman 79.6

Imagga
created on 2023-10-07

stage 33.9
tunnel 30.7
platform 25.3
passageway 23.2
night 19.5
passage 18.2
light 18.2
sky 17.8
old 17.4
dark 15.9
city 15.8
architecture 14.9
travel 14.8
black 13.8
grunge 13.6
landscape 13.4
texture 13.2
design 12.9
art 12.7
way 12.1
building 11.9
graphic 11.7
structure 11.2
film 11
tourism 10.7
mine 10.5
flame 10.3
smoke 10.2
heat 10.2
silhouette 9.9
rock 9.5
power 9.2
fireplace 9.1
negative 9.1
digital 8.9
pattern 8.9
bonfire 8.9
water 8.7
stone 8.4
fire 8.4
energy 8.4
famous 8.4
hot 8.4
danger 8.2
theater curtain 8.1
dirty 8.1
urban 7.9
color 7.8
culture 7.7
wallpaper 7.7
dusk 7.6
clouds 7.6
spectator 7.5
curtain 7.4
element 7.4
lights 7.4
symbol 7.4
entertainment 7.4
warm 7.3
historic 7.3
industrial 7.3
landmark 7.2

Google
created on 2018-05-10

white 96.4
black 96.1
photograph 96.1
black and white 95.4
monochrome photography 94.3
night 93.2
darkness 91.8
text 88.6
photography 86.4
light 84.6
architecture 83.1
structure 82.7
snapshot 81.8
atmosphere 80.6
monochrome 80.2
stage 76.7
phenomenon 75.5
crowd 74.5
religion 63.3
history 61.3

Microsoft
created on 2018-05-10

building 93.7
bridge 54.8
crowd 29.8
arch 17.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Female, 55.5%
Sad 68.6%
Calm 53.2%
Fear 7.1%
Happy 6.9%
Surprised 6.7%
Disgusted 1.5%
Confused 1.5%
Angry 1%

Feature analysis

Amazon

Person
Adult
Male
Man
Building

Clarifai

Clothing
Tree
Human face
Person
Human head
Building

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 60.7%

AWS Rekognition

Person 55.2%

AWS Rekognition

Adult 96.9%

AWS Rekognition

Adult 95.6%

AWS Rekognition

Male 96.9%

AWS Rekognition

Male 95.6%

AWS Rekognition

Man 96.9%

AWS Rekognition

Man 95.6%

AWS Rekognition

Building 89.4%

Clarifai

Clothing 75.7%

Clarifai

Clothing 52.8%

Clarifai

Clothing 52.5%

Clarifai

Clothing 39.9%

Clarifai

Tree 72.2%

Clarifai

Tree 67.3%

Clarifai

Tree 38.5%

Clarifai

Human face 61.6%

Clarifai

Human face 61%

Clarifai

Human face 39.9%

Clarifai

Person 54.3%

Clarifai

Human head 45.1%

Clarifai

Building 34.7%

Categories

Imagga
created on 2023-10-07

pets animals 36.5%
interior objects 22.1%
streetview architecture 17.6%
paintings art 14.1%
text visuals 2.9%
food drinks 2.7%
nature landscape 2.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man in a suit and tie is holding a camera

Created by general-english-image-caption-blip-2 on 2025-07-05

a crowd of people are gathered around a bridge

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This black-and-white negative image depicts a group of people gathered outdoors, with a large bridge in the background. The bridge features a complex steel structure and connects to buildings on either side. In the foreground, individuals appear seated or standing, with details suggesting a communal activity or event taking place. On one side, there is a prominent building with arched windows, blending with trees and other structures in the scene. The inverted tones add to the dramatic effect of the composition.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image appears to be a negative photograph showing a large gathering of people outdoors. In the background, there is a prominent bridge structure with a lattice design, spanning across the scene. Below the bridge, to the right, there is a large building with arched windows. The scene is likely taking place in an urban setting, given the presence of the bridge and the architecture visible in the image. The people are arranged in rows, suggesting some form of organized event or gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a large crowd gathered at night in front of a bridge or structure with an arched design. The crowd appears to be a large gathering of people, with many individuals visible in the image. The scene is captured in black and white, giving it a dramatic and atmospheric quality. The bridge or structure in the background is illuminated, creating a striking contrast against the dark night sky.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical black and white photograph showing a large crowd gathered near what looks like the Harvard Bridge (also known as the Massachusetts Avenue Bridge) in Boston/Cambridge. The image has an interesting negative or inverted quality to it, where the people in the crowd appear as silhouettes or glowing figures. In the background, you can see the distinctive steel truss structure of the bridge spanning across what would be the Charles River. The photo credit indicates this is from the Harvard University Art Museums collection. The ethereal quality of the image, with its reversed tones, gives it an almost ghostly or supernatural appearance.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a crowd of people gathered in front of a bridge and a building.

The crowd appears to be made up of men, women, and children, all dressed in casual clothing. They are standing in a large open area, possibly a park or plaza, with some of them facing towards the camera and others looking away.

In the background, there is a large bridge that spans across the top of the image. The bridge has a metal structure with a series of arches and supports, and it appears to be a suspension bridge. To the right of the bridge, there is a large building with a flat roof and several windows. The building appears to be a government or institutional building, possibly a courthouse or a university building.

The overall atmosphere of the image suggests that it was taken at some point in the past, possibly in the early 20th century. The clothing and hairstyles of the people in the crowd suggest that it was taken before the mid-20th century. The quality of the photograph also suggests that it was taken using an older camera technology.

The image has a copyright notice at the bottom that reads "© President and Fellows of Harvard College (Harvard University Art Museums)". This suggests that the image is part of a collection of photographs owned by Harvard University, and that it was taken by a photographer who was affiliated with the university.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a large group of people gathered in front of a bridge. The people are dressed in formal attire, with men wearing suits and hats, and women wearing dresses and hats. They appear to be standing on a grassy area or a lawn, with trees and buildings visible in the background.

In the foreground, there is a man standing out from the crowd, wearing a suit and holding a hat in his hand. He appears to be looking at the camera, while the others in the group seem to be engaged in conversation or simply standing together.

The bridge in the background is a large steel structure with a series of arches and supports. It spans a body of water, which is not visible in the photograph. The overall atmosphere of the image suggests a formal event or gathering, possibly a wedding or a social function.

The image has a copyright notice at the bottom, which reads "© President and Fellows of Harvard College (Harvard University Art Museums)". This suggests that the photograph is part of a collection held by the Harvard University Art Museums.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image depicts a black-and-white photograph of a large gathering of people outdoors. The crowd is assembled on a grassy area, likely a park or open space. The scene is set against a backdrop of a bridge, which is prominently visible in the upper part of the image. The bridge is a suspension bridge with a complex steel framework. The bridge's cables and supports are visible, and it spans a considerable distance, suggesting it is a significant structure.

In the foreground, the people are seated or standing in various positions, some facing the camera while others are engaged in conversation or activities. There is a sense of movement and interaction among the crowd. The atmosphere appears to be lively and possibly celebratory, given the number of people gathered.

In the background, the bridge is the focal point, with its intricate design and towering presence. The bridge's architecture is notable for its use of steel, which was a modern material at the time this photograph was taken. The bridge's cables and supports create a visually striking contrast against the dark sky.

The image has a watermark in the bottom left corner that reads "President and Fellows of Harvard College (Harvard University Art Museums)." This indicates that the photograph is part of the Harvard University Art Museums' collection. The watermark also includes a reference number, "P1970.4114.0000," which is likely used for cataloging and identification purposes.

Overall, the image captures a moment of public gathering with a significant architectural feature in the background, showcasing the blend of human activity and engineering marvel.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The image is a black-and-white photograph featuring a large crowd of people gathered outdoors. The setting appears to be a public space, possibly a park or a street, with a prominent bridge in the background. The bridge is a suspension bridge with a series of cables and supports, suggesting it is a significant landmark. The crowd is dense, with people standing and sitting, some facing the camera and others turned away. The image has a vintage feel, possibly from the early to mid-20th century, indicated by the clothing styles and the overall atmosphere. The lighting suggests it might be dusk or dawn, as the sky is dark and the crowd is illuminated by artificial light, possibly from street lamps or event lighting. The photograph captures a moment of communal gathering, possibly for an event or celebration.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-02

Here's a description of the image:

Overall Impression:

The image appears to be a negative, as the colors are inverted. The scene shows a large group of people in what looks like a public space. A bridge is visible in the background.

Key Elements:

  • People: A large crowd of people is lined up or gathered in the foreground. The people appear to be wearing dark clothing, and the scene has a slightly formal feel to it.
  • Bridge: A large bridge dominates the upper portion of the image. Its design features a prominent lattice structure.
  • Building: A building with several arches and large pillars can be seen at the right side of the image. It's adjacent to the bridge, which adds to the structural elements of the scene.
  • Background Details: There are glimpses of other structures and some greenery in the background, which appear to be somewhat obscured due to the overall negative format.

Composition:

The composition is fairly balanced, with the large bridge providing a horizontal element across the top. The crowd of people leads the eye toward the buildings.

Overall, this photograph is likely a historic image of a crowd gathered beneath a bridge.

Created by gemini-2.0-flash on 2025-06-02

Here is a description of the image:

The image appears to be an inverted black and white photograph depicting a crowd of people gathered in front of a building or structure, with a large bridge spanning above in the background.

In the foreground, a large group of people are present, although their details are obscured due to the photo's inversion and possibly the age of the image. They seem to be facing forward, possibly watching an event or gathering.

Behind the crowd, there's a large building or structure, with what appears to be arched windows or openings. To the left of the crowd and the building, there are trees and what looks like another building in the distance.

Overhead, a substantial bridge structure is visible. The bridge's design includes intricate truss work, and it appears to be a prominent feature of the background.

The overall impression is of a historical or archival image capturing a moment in time, possibly a community gathering or event taking place near a landmark building and bridge. The quality of the image suggests it is from an older photograph or negative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image appears to be a black and white photograph of a large gathering of people, likely participating in a public event or demonstration. The scene is set outdoors, with a prominent bridge structure in the background, possibly indicating a well-known location. The crowd consists of numerous individuals, many of whom appear to be seated or standing in groups. Some people are holding signs or banners, suggesting that the event may have a political or social cause.

The architecture in the background includes a building with arched windows, which might be a significant landmark or part of an institutional building. The overall atmosphere suggests a moment of collective action or assembly. The photograph is credited to the President and Fellows of Harvard College, indicating it might be part of a historical or archival collection from Harvard University Art Museums. The image number "P1970.4114.0000" is noted at the bottom right corner, which can be used for further reference or identification within the collection.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image appears to be a black-and-white photograph with a strong artistic, almost ethereal quality. It features a large group of people gathered in what looks like an outdoor setting, possibly a square or a public space. The individuals are silhouetted in the foreground, creating a dramatic contrast with the background. The background includes a large structure that resembles a bridge or a part of a stadium with arched windows, and there is a bright, dramatic light source to the left, possibly a fire or an explosion, adding to the intense and somewhat chaotic atmosphere of the scene. The overall impression is one of a historical or significant event, possibly a protest, a rally, or a public gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This image is a black-and-white photograph with a negative effect, which gives it an inverted appearance. It depicts a large crowd of people gathered on what appears to be a grassy area. In the foreground, there is a person holding a camera or a similar object, and another person holding what looks like a newspaper. In the background, there is a large truss bridge spanning across the scene, and some buildings with arched windows are visible under the bridge. The overall atmosphere of the image suggests it might be a historical photograph of a public event or gathering. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums) and has a catalog number P1970.4114.0000.

Text analysis

Amazon

College
and
University
Art
(Harvard
Fellows
Museums)
of
President and Fellows of Harvard College (Harvard University Art Museums)
Harvard
President
P1970.4114.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4114.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4114.0000