Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

Date

1934-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2810

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2810

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 99.7
Apparel 99.7
Human 98.7
Person 98.7
Hat 98.3
Person 94.3
Coat 74.6
Face 73.7
Overcoat 70.9
Wood 66.2
Cap 60.1
Sun Hat 59.6
Hat 57.9

Clarifai
created on 2018-03-23

people 100
adult 99.1
one 98.8
wear 96.6
man 96.1
portrait 95.6
two 94.7
veil 93.5
lid 92.9
administration 91.5
woman 91.1
outfit 90.7
leader 90.1
military 89.4
actor 88.6
elderly 86.1
three 85.8
soldier 84.6
uniform 83.9
war 83.3

Imagga
created on 2018-03-23

crutch 100
staff 94.7
stick 71.7
man 24.9
statue 22.9
old 21.6
religion 17.9
sculpture 17.2
person 16.5
art 16.3
people 15.6
male 15.6
portrait 14.9
adult 13.6
god 13.4
black 13.2
face 12.8
culture 12
history 11.6
city 10.8
prayer 10.6
holy 10.6
travel 10.6
ancient 10.4
historical 10.3
building 10.3
church 10.2
architecture 10.1
brass 10.1
clothing 10
vintage 9.9
uniform 9.5
religious 9.4
monument 9.3
historic 9.2
holding 9.1
hat 9.1
helmet 8.7
military uniform 8.7
spiritual 8.6
golden 8.6
men 8.6
stone 8.4
trombone 8.4
fashion 8.3
tourism 8.2
one 8.2
figure 8.1
worker 8
indoors 7.9
work 7.8
worship 7.7
faith 7.6
human 7.5
famous 7.4
gold 7.4

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.4
man 94.3
old 64.4
older 21.9

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 57-77
Gender Male, 68.6%
Calm 60.9%
Sad 13.5%
Confused 2.4%
Disgusted 9.7%
Happy 3.4%
Surprised 3.7%
Angry 6.4%

AWS Rekognition

Age 26-43
Gender Male, 51.4%
Sad 7.4%
Confused 2.4%
Happy 3.2%
Disgusted 27.7%
Angry 28.1%
Surprised 4%
Calm 27.1%

Microsoft Cognitive Services

Age 39
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Hat
Person 98.7%
Person 94.3%
Hat 98.3%
Hat 57.9%

Captions

Microsoft
created by unknown on 2018-03-23

a man sitting on a bench 72.2%
a man sitting on a suitcase 72.1%
a man sitting in front of a building 72%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and woman sitting on a porch -100%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-30

The image shows two elderly individuals seated on a set of stairs or steps. They appear to be an older man and woman, both wearing heavy coats and hats to protect against the cold. The man is holding onto a wooden cane or walking stick, suggesting he may have mobility issues. The woman is sitting with her arms folded, her weathered face and expression conveying a sense of hardship or struggle. The black and white photograph gives the image a somber, historic feel, capturing a glimpse of a bygone era and the difficult lives of those it depicts.

Created by claude-3-opus-20240229 on 2024-12-30

The black and white image shows two elderly women sitting together on what appears to be a stoop or steps outside a building. Both women are wearing dark, heavy coats and hats typical of the early 20th century. One woman is looking straight ahead while the other looks down, deep in thought or perhaps resting. Next to them are some crutches or walking sticks, suggesting mobility issues. The weathered facade of the building behind them and their careworn faces and clothing convey a sense of hardship and the passage of time. It's a poignant, candid portrait capturing a moment in the lives of these two anonymous women from a bygone era.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This is a historical black and white photograph that appears to be from the early 20th century. It shows two elderly individuals sitting outside what appears to be a building. They are both dressed in dark winter clothing, including coats, and one is wearing a hat and glasses. One of the individuals has crutches or walking sticks leaning nearby. The image has a sepia tone quality typical of photographs from that era, and captures what seems to be a moment of quiet contemplation or rest. The composition and vintage quality of the photograph makes it an interesting historical document of everyday life from that time period.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

This is a sepia-toned photograph of two elderly African American women sitting side-by-side on what appears to be the steps of a building. Both women are dressed in formal attire, suggesting a special occasion or an era when dressing up was more common for public appearances.

On the left, the woman is wearing a dark, buttoned coat and a fedora-style hat. Her hands are clasped in her lap, and she appears to be holding or resting them on a set of metal crutches that are propped up beside her. Her gaze is directed downwards, and her expression is somewhat somber.

The woman on the right is wearing a dark dress, a dark cape draped over her shoulders, and a similar hat. She also wears glasses and a delicate necklace. Her arms are crossed, and her expression seems more alert and perhaps a little stern as she gazes off to the side.

The background includes a door with a glass panel to the left, and the stone facade of the building provides a neutral backdrop. The overall tone of the photograph suggests a historical period, likely from the early to mid-20th century. The sepia tone enhances the vintage feel of the image.

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Impression: The image is a sepia-toned, vintage photograph depicting two elderly African American women seated side-by-side on what appears to be steps. The style and tone suggest it may be from the early to mid-20th century.

Key Details:

  • Subject: Both women are wearing hats and long dresses or coats, indicating a formal or modest style of dress. They have expressions that appear contemplative. The woman on the left has a series of metal bars in front of her, possibly crutches. The woman on the right is wearing eyeglasses and a necklace.
  • Composition: The photo is a medium shot, focusing on the two women. The setting seems to be a building exterior, possibly a church or public building, given the presence of a door and architectural details.
  • Lighting and Tone: The sepia tone gives the image a warm, nostalgic feel. The lighting is likely natural, with shadows indicating the time of day.
  • Atmosphere: The image has a quiet, dignified atmosphere. The women's poses and expressions create a sense of reflection and possibly resilience.