Human Generated Data

Title

Untitled (New York City)

Date

1929

People

Artist: Paul Grotz, American 1902 - 1990

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, P1998.49

Human Generated Data

Title

Untitled (New York City)

People

Artist: Paul Grotz, American 1902 - 1990

Date

1929

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, P1998.49

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 98.7
Clothing 97.9
Apparel 97.9
Helmet 87.7
Handrail 85.2
Banister 85.2
Railing 74.3
Hat 67.6
Porch 66.1
Wood 62.9
Overcoat 62.2
Coat 62.2
Vehicle 58.7
Transportation 58.7
Cap 58.2
Spoke 55.4
Machine 55.4

Clarifai
created on 2023-10-25

people 99.9
adult 98.7
two 97.1
man 96.4
one 93.9
street 93.6
group 93.1
group together 92.7
woman 91.8
administration 90.6
veil 89.4
monochrome 88.2
child 87.6
three 87.3
leader 83.6
portrait 83.4
wear 82.6
furniture 82.5
boy 81.9
vehicle 81

Imagga
created on 2022-01-08

man 41
worker 31.9
male 31.2
person 30.8
work 29
engineer 25.7
people 24
industry 23.9
working 23.8
job 23
adult 21.2
men 20.6
helmet 20.2
industrial 18.1
equipment 17.7
occupation 17.4
safety 16.6
professional 15.4
black 14.4
business 14
construction 12.8
businessman 12.3
protection 11.8
labor 11.7
uniform 11.6
lifestyle 11.6
office 11.4
hat 11.3
building 11.3
portrait 11
machine 10.9
factory 10.8
indoors 10.5
repair 10.5
computer 10.5
one 10.4
device 10.1
happy 10
city 10
hardhat 9.8
profession 9.6
clothing 9.3
laptop 9.2
looking 8.8
sax 8.7
women 8.7
sitting 8.6
foreman 8.1
light 8.1
suit 8.1
success 8
active 8
urban 7.9
winter 7.7
hand 7.6
seller 7.5
site 7.5
businesswoman 7.3
musical instrument 7.3
forklift 7.3
tool 7.2
home 7.2

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

outdoor 99.1
text 97
clothing 94.8
person 90.1
man 85.9
black and white 62.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 96.2%
Calm 97%
Surprised 1.9%
Fear 0.5%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 97.9%
Calm 99.2%
Sad 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet
Person 99.7%
Person 98.7%
Helmet 87.7%

Categories

Imagga

paintings art 85.7%
people portraits 8.9%
food drinks 4.9%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a man and woman sitting on the sidewalk -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This black-and-white image captures a scene depicting two individuals seated and standing on the pavement beside a staircase and wrought iron railing. One is dressed in a light top and skirt while the other wears a light shirt and flat cap. The setting has a textured brick wall in the background, and the ironwork exhibits intricate decorative detailing. Lighting highlights the contrast and depth of the architectural elements. The photograph is signed "Paul Strö" with the year "'29" written.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image features two individuals sitting on the steps of a building, which are adorned with ornate wrought-iron railings. The woman on the left is wearing a headscarf and a long skirt, while the person on the right is dressed in a long-sleeve shirt and pants, with a cap. The setting appears to be a city street with an urban backdrop. The image has a vintage aesthetic, reflecting a moment in everyday life. There is a signature that reads "Paul STRAND" followed by the year '29 in the bottom right corner, indicating it is likely a historical photograph by the notable photographer.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph depicting two individuals sitting on steps outside of a building. One person is seated on the steps, while the other is standing next to them. Both individuals are wearing clothing and headwear that suggests they may be from a different time period or cultural background. The background includes a wrought-iron railing and a brick building facade. The overall scene conveys a sense of a historical or documentary-style photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph from what appears to be the 1920s or 1930s. The image shows two people on what looks like the front steps or stoop of a building. One person is seated and wearing a white head covering and light-colored dress or skirt, while the other is standing and wearing casual work clothes including a cap. The architectural details include decorative iron railings with scrollwork patterns and a cast iron newel post. The photograph has strong contrasts between light and shadow, typical of the street photography style of that era. At the bottom of the image, there appears to be a signature or photographer's mark.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

This image is a black-and-white photograph of a woman and a boy sitting on the steps of a building. The woman is wearing a head covering, a dark shirt, and a long skirt. She is holding a small object in her right hand. The boy is wearing a cap, a light-colored shirt, and dark pants. He is holding a cane in his right hand.

The steps are made of concrete, and there is a decorative metal railing on either side. In the background, there is a brick wall and a window with a decorative metal grate. The overall atmosphere of the image suggests that it was taken in an urban setting, possibly in the early 20th century.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image is a black-and-white photograph of two men sitting on a concrete stoop, with a wrought iron railing in the background. The man on the left is wearing a white turban and a dark shirt, while the man on the right is wearing a cap and a light-colored shirt. Both men are looking at the camera.

  • The man on the left is sitting on a concrete stoop, with his legs crossed and his hands resting on his lap. He is wearing a white turban and a dark shirt.
  • The man on the right is standing next to the railing, with his hands in his pockets. He is wearing a cap and a light-colored shirt.
  • In the background, there is a wrought iron railing with a decorative design. The railing is attached to a brick wall, which appears to be part of a building.
  • The overall atmosphere of the image suggests that the two men are taking a break or enjoying some time together on the stoop. The fact that they are both looking at the camera implies that they may be posing for the photograph.

The image provides a glimpse into the lives of two men who may have been friends or acquaintances. The fact that they are sitting together on a stoop suggests a sense of camaraderie and companionship. The image also highlights the importance of taking breaks and enjoying time with others, even in the midst of a busy day.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

A black-and-white photo shows a woman sitting on the steps of a house. She is wearing a white bonnet and a white dress. She is holding a bottle in her hand. A boy is standing on the steps, holding onto the railings. He is wearing a hat and a long-sleeve shirt. There is a bowl on the steps. The photo has a watermark on the bottom right.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of two people, a man and a woman, sitting on a concrete stoop. The woman is sitting on the left side, wearing a long dress and a head covering. She is holding something in her hand, possibly a piece of cloth or fabric. The man is standing on the right side, leaning against a railing. He is wearing a hat and a long-sleeved shirt. The photograph appears to have been taken in a residential area, possibly in a city. The image has a vintage feel, suggesting that it was taken in the past. The photograph is signed by the photographer, possibly indicating that it is a professional or artistic work. Overall, the image captures a moment of everyday life, showcasing the simplicity and beauty of ordinary people in their surroundings.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

The image is a black and white photograph that appears to be a candid shot of two people in an urban setting.

On the left side of the image, a woman is seated on what looks like a concrete step or platform. She is wearing a head covering, a long-sleeved top, and a long skirt. She has something in her hand and seems to be looking towards the viewer. Beside her are a pair of sandals.

To the right of the woman, a man is standing and leaning against an ornate iron railing. He's wearing a cap and a light-colored shirt with suspenders. A long pole or cane is in his hand.

Behind both figures, there's a dark entryway or basement access point set into a brick wall. The area is surrounded by decorative ironwork that may be part of the building's facade. The photo seems to have been taken in natural light, creating contrasting shadows. A signature and date are visible in the lower right corner.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

This is a black and white photograph depicting two people on a stoop or ledge, likely in an urban setting. The woman is seated, wearing a head covering, a dark long-sleeved shirt, and a long, light-colored skirt. She appears to be holding something in her hand. Next to her, standing, is a man wearing a flat cap, a long-sleeved white shirt, suspenders, and possibly holding a cane or walking stick. They are positioned near a decorative wrought-iron railing and the entrance to what appears to be a basement or cellar. The scene is strongly lit with clear shadows cast by the sunlight, suggesting a bright day. The photograph has a vintage feel, and the bottom right corner is signed by "Paul Strand, '29."

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image is a black-and-white photograph featuring two individuals on a sidewalk near a building with ornate iron railings. The person on the left is seated on a step, wearing a headscarf, a dark top, and a light-colored skirt. They appear to be looking directly at the camera. The person on the right is standing, wearing a cap, a light-colored shirt, and dark pants. They are leaning against the railing and looking slightly away from the camera. The background includes a brick wall and the shadows cast by the railings. The photograph is signed "Paul Strand 1929" in the bottom right corner, indicating it was taken by the photographer Paul Strand in that year. The scene appears to be candid and captures a moment of everyday life.

Text analysis

Amazon

'29
Reccl get '29
get
Reccl

Google

Recel Gob,
Recel
Gob,