Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2840

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2840

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.2
Human 99.2
Person 98.8
Apparel 98.4
Clothing 98.4
Person 98.2
Sleeve 80.6
Overcoat 63.2
Coat 63.2
Face 60.1
Column 59.9
Building 59.9
Pillar 59.9
Architecture 59.9
Hair 59.6
Crypt 59.3
Long Sleeve 59
Sitting 55.9
Evening Dress 55.6
Robe 55.6
Fashion 55.6
Gown 55.6

Clarifai
created on 2018-03-23

people 100
adult 99
one 98.3
woman 97.5
man 96.2
two 95.8
group together 94.9
wear 94.7
group 93.9
administration 92.2
portrait 89.4
elderly 87.6
music 86.6
military 84.8
leader 83.9
three 83.1
four 82.5
recreation 81.8
instrument 81
outfit 79.5

Imagga
created on 2018-03-23

musical instrument 42.6
black 30.5
person 30.5
accordion 26.5
people 26.2
adult 24.8
wind instrument 24.1
model 23.3
keyboard instrument 23.2
sexy 22.5
man 20.9
portrait 20.1
guitar 19.7
male 18.5
body 18.4
attractive 18.2
style 17.1
fashion 16.6
posing 16
dark 15.9
one 15.7
sensuality 15.4
music 15.3
hair 14.3
human 14.3
passion 14.1
performer 13.9
stringed instrument 13.9
lady 13.8
world 13.2
sax 13.1
dress 12.7
musician 12.6
pretty 12.6
rock 12.2
silhouette 11.6
lifestyle 11.6
studio 11.4
elegant 11.1
sensual 10.9
stage 10.7
hand 10.6
dancer 10.6
face 9.9
dance 9.8
musical 9.6
instrument 9.1
pose 9.1
art 8.9
night 8.9
guitarist 8.9
love 8.7
performance 8.6
sitting 8.6
erotic 8.5
elegance 8.4
singer 8.3
makeup 8.2
make 8.2
gorgeous 8.2
fitness 8.1
women 7.9
couple 7.8
play 7.8
party 7.7
desire 7.7
grunge 7.7
youth 7.7
player 7.6
skin 7.6
relax 7.6
stylish 7.2
suit 7.2
device 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 98.7
outdoor 94.5
man 93.7
posing 63.7
old 47.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 48-68
Gender Female, 89.4%
Sad 75%
Angry 8.6%
Happy 2.5%
Calm 4.9%
Surprised 2.9%
Disgusted 3.7%
Confused 2.4%

AWS Rekognition

Age 38-59
Gender Female, 99.5%
Disgusted 26.3%
Confused 5.2%
Calm 17.8%
Surprised 4.2%
Angry 14.4%
Sad 26.6%
Happy 5.4%

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Person 99.2%
Person 98.8%
Person 98.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-14

a photograph of a woman sitting on a stepladher in front of a man -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows two individuals dressed in dark clothing standing and seated outside a building. The seated individual leans against a column with ornate carved details, while the standing individual appears to hold an object, possibly a clutch or purse. A decorative architectural feature is visible to the left, including detailed woodwork. Part of a third person is seen on the right, wearing a vest and trousers. The overall setting appears to be the front stairway of a historic building.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a vintage black-and-white photograph of three people standing on a set of stone steps outside a building. The individuals are dressed in early 20th-century attire.

On the left side of the image, a person is seated on a step, leaning against a post with a twisted design. This person is wearing a dark dress and button-up shoes. The architecture visible consists of a wooden panel with some decorative floral elements.

To the right, another person stands beside them, holding a black object, possibly a clutch bag, close to their chest. This person is also wearing a dark dress and buttoned footwear.

Partially visible on the far right is a third person standing with their arm bent at the elbow, wearing a suit with a vest and shirt that appears to be rolled up at the sleeves.

The overall atmosphere is formal and antiquated, reflective of photographic styles from the early 1900s.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image appears to be a black and white photograph depicting two women sitting on a set of steps or stairs. The woman on the left is seated in a chair, wrapped in a dark shawl or blanket, while the woman on the right is standing and has her arms crossed. The background suggests an older, urban setting with architectural elements visible. The image has a somber, contemplative mood.

Created by claude-3-opus-20240229 on 2024-12-31

The black and white photograph shows two older women sitting on stone steps in front of an ornate wooden door or entryway. They are wearing dark, floor-length dresses typical of the early 20th century. One woman has her hands clasped in her lap while the other has her arms crossed. Their expressions appear serious. The detailed woodwork and scrolling on the door behind them suggests this may be the entrance to a stately home or building from that era.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This is a black and white photograph that appears to be from the early 20th century. It shows two women in dark dresses standing and sitting on what appears to be the front steps of a building. There's a decorative carved column visible on the left side of the image, which suggests this might be the entrance to a townhouse or apartment building. The women are wearing typical working-class clothing of the era - long, dark dresses with simple styling. The image has the documentary-style quality characteristic of early 1900s urban photography, possibly taken to document living conditions or daily life in a city setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of two women and a man standing on the steps of a building. The woman on the left is seated on the step, while the woman on the right stands with her hands clasped in front of her. A man stands behind them, partially visible.

The woman on the left wears a dark dress and has her hair pulled back. She holds a small object in her hand, possibly a figurine or a piece of jewelry. The woman on the right also wears a dark dress and has her hands clasped together in front of her. The man behind them is dressed in dark clothing, with only his torso and legs visible.

The background of the image features a building with a wooden door and a stone pillar. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s. The style of the clothing and the architecture of the building support this conclusion.

The image appears to be a candid shot, capturing a moment in time rather than a posed photograph. The women's expressions are neutral, and the man's presence is subtle, adding to the sense of realism. Overall, the image provides a glimpse into the lives of people from a bygone era, frozen in time for our observation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of three individuals standing on the steps of a building. The person on the left is seated, wearing a dark dress and shoes, with their hands resting in their lap. The middle individual stands with their arms crossed, dressed in a dark dress and shoes, while the person on the right is partially visible, wearing a white shirt, dark vest, and dark pants.

The background features a wooden door and a window, accompanied by a decorative column to the left. The overall atmosphere suggests that this photograph was taken during the early 20th century, likely in the 1920s or 1930s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

This is a black-and-white photograph of three people standing on the steps of a building. The woman sitting on the left side is looking at the camera, while the woman standing on the right side is looking to the left. The man standing behind the woman is looking down. The woman sitting is wearing a necklace, and the woman standing is wearing a ring. The man is wearing a vest and a tie.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white image depicts three people standing on the steps of a building. Two women are seated on the steps, and one man is standing. The woman on the left is wearing a dress, while the woman on the right is wearing a dress and a necklace. The man on the right is wearing a long-sleeved shirt, a vest, and pants. There is a handrail on the left side of the steps.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

The grayscale photo captures three individuals on the front steps of a building. On the left, a stout woman is seated, with her arm resting on a textured, sturdy-looking pillar. Her dark, voluminous dress falls to the steps, and she gazes directly at the camera. To her right, another woman stands with her hands clasped in front of her. She is dressed in a similar dark, full-length dress, and her gaze also meets the viewer's. Behind and slightly to the right of the standing woman, a third figure is partially visible. This individual, seemingly a man, wears a light-colored shirt with a dark vest and tie. The lower half of his body is visible, clad in dark trousers and shoes, as he stands on the steps. The backdrop is a dark doorway, providing a stark contrast to the lighter shades of the clothing and the weathered façade of the building. The composition suggests a candid, documentary-style photograph, capturing a moment in time.

Created by gemini-2.0-flash-lite on 2025-06-04

Here's a description of the image:

Overall Impression: The image is a vintage black and white photograph featuring three people on the steps of what appears to be a building or home. The photograph has a somewhat serious, formal tone, likely from the early to mid-20th century, given the style and attire.

Composition and Setting:

  • Location: The scene is outdoors, likely a doorway or entrance to a building, with the steps leading up.
  • Lighting: The lighting suggests a cloudy day or diffused light, as there are no harsh shadows.
  • People: There are three figures positioned on the steps. The individual on the left is sitting, and the woman in the middle is standing with her arms crossed in front of her. A man is partially visible standing next to the woman on the right.
  • Details: An ornamented column is a key part of the frame on the left, which is another architectural feature of the door frame and building.

People and Attire:

  • First Woman: The woman sitting on the steps is wearing a dark dress with a gathered or flowing skirt. She has a necklace and a ring. She is holding a small object in her hand.
  • Second Woman: The woman standing, slightly behind the sitting woman, is also wearing a dark, knee-length dress and shoes with short heels. She holds a bag or purse.
  • Man: The man on the right is wearing a vest, white shirt, and dark pants.
  • Style: The clothing suggests a time period likely in the first half of the 20th century, with simple, functional dresses.

Overall Mood: The expressions of the two women are somber.

Potential Interpretations: It is a portrait-style photograph that captures the lives of the people in this scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph depicting three individuals, two women and one man, standing on the steps of a building. The women are dressed in black attire, with the woman on the left sitting on the steps and the woman on the right standing beside her. The man, partially visible on the right side of the image, is also dressed in dark clothing. The setting appears to be urban, with architectural elements such as a decorative iron railing and stone steps visible. The expressions of the individuals are not clearly discernible due to the monochrome nature of the photograph. The overall atmosphere suggests a candid moment captured in a possibly historical or older urban environment.