Human Generated Data

Title

Untitled (elderly man sitting on city bench)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16096.1

Human Generated Data

Title

Untitled (elderly man sitting on city bench)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16096.1

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.8
Furniture 99.7
Clothing 97.5
Apparel 97.5
Sitting 96.3
Footwear 96
Transportation 87.7
Vehicle 87.7
Automobile 87.7
Overcoat 82.4
Coat 82.4
Park Bench 77.9
Pedestrian 76.4
Path 63.4
Dating 58
Suit 56.4
Female 55.4
Face 55.2

Clarifai
created on 2023-10-29

street 99.9
city 99.5
bench 99.5
people 99
portrait 98
urban 98
couple 96.7
girl 95.9
woman 95.1
square 94.6
man 94.1
cinematic 93.9
sit 92.7
elder 91
chair 89.9
adult 89.7
road 88.7
light 87.8
landscape 87.3
bridge 85.4

Imagga
created on 2022-02-11

man 30.9
people 28.5
person 26.6
building 25
male 23.4
city 23.3
silhouette 23.2
business 21.9
urban 18.4
adult 17.2
alone 15.5
architecture 15.3
street 14.7
musical instrument 14.6
office 14.4
travel 12.7
modern 12.6
businessman 12.4
black 12
sunset 11.7
lifestyle 11.6
life 11.5
couple 11.3
scholar 10.8
outdoor 10.7
fashion 10.6
window 10.4
corporate 10.3
sky 10.2
town 10.2
outdoors 9.9
attractive 9.1
vacation 9
intellectual 8.9
looking 8.8
standing 8.7
sitting 8.6
walking 8.5
old 8.4
men 7.7
crowd 7.7
walk 7.6
suit 7.6
happy 7.5
human 7.5
world 7.5
professional 7.5
stringed instrument 7.4
shadow 7.2
women 7.1
portrait 7.1
working 7.1
spectator 7
glass 7

Google
created on 2022-02-11

Shoe 95.6
Building 91.5
Sky 84.6
Street fashion 84.2
Adaptation 79.4
Travel 79.1
Morning 78.9
Rectangle 78.5
Luggage and bags 78.2
Tints and shades 77.4
Beauty 75.3
Suit 75.3
Road 75
Leisure 74.8
Bag 73.2
Formal wear 71.2
Sidewalk 69.6
City 69.4
Bench 67.4
Street 65.9

Microsoft
created on 2022-02-11

bench 99.5
outdoor 99
footwear 97.2
clothing 97
street 95.1
person 95
text 91.6
woman 90.5
skyscraper 84.7
sky 72.4
man 72.3
park 64.7
city 53.5
building 50.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Female, 68.6%
Calm 56.6%
Happy 14.5%
Sad 8.8%
Angry 7%
Surprised 5.7%
Confused 3.5%
Disgusted 2.3%
Fear 1.6%

AWS Rekognition

Age 49-57
Gender Female, 90.8%
Sad 39.7%
Calm 29.2%
Disgusted 9.5%
Angry 7.6%
Happy 5.4%
Confused 3.8%
Surprised 3.3%
Fear 1.6%

AWS Rekognition

Age 23-33
Gender Female, 100%
Angry 24.4%
Happy 20.6%
Sad 18.2%
Calm 15.7%
Surprised 8.6%
Disgusted 6.5%
Fear 3.4%
Confused 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Car
Bench

Clarifai

Footwear
Tree
Man
Woman
Building
Furniture
Human face
Umbrella
Plant
Human arm

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.7%

AWS Rekognition

Shoe 96%

AWS Rekognition

Car 87.7%

AWS Rekognition

Bench 75.2%

Clarifai

Footwear 92.6%

Clarifai

Footwear 86.7%

Clarifai

Footwear 84.1%

Clarifai

Footwear 81.7%

Clarifai

Footwear 80%

Clarifai

Footwear 70%

Clarifai

Footwear 51.2%

Clarifai

Footwear 37.5%

Clarifai

Footwear 36.3%

Clarifai

Tree 77.7%

Clarifai

Man 69.6%

Clarifai

Man 48.6%

Clarifai

Woman 63.5%

Clarifai

Woman 58.3%

Clarifai

Building 62.4%

Clarifai

Building 41.2%

Clarifai

Building 35.7%

Clarifai

Building 34.3%

Clarifai

Furniture 39.1%

Clarifai

Human face 37.8%

Clarifai

Umbrella 34.7%

Clarifai

Plant 34.4%

Clarifai

Human arm 33.7%

Categories

Imagga
created on 2022-02-11

streetview architecture 81%
events parties 10.8%
paintings art 3.1%
people portraits 1.9%
nature landscape 1.1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a woman sitting on a bench.

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a man sitting on a bench in a city

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This image depicts an urban street scene with people engaging in daily activities. In the foreground, an elderly man sits on a green park bench, holding a cane and a hat, and appears to be resting. The sidewalk stretches out along a bustling city area, with two women walking by, carrying handbags. The background reveals tall buildings, including a prominent structure with pointed architecture, possibly a hotel or office building. Additional signage, storefronts, and advertisements indicate typical elements of a downtown area. The scene is captured on a sunny day, with green foliage visible on the left.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a street scene in a city, possibly from the mid-20th century based on the style of clothing and architecture. In the foreground, an elderly man is sitting on a green park bench with a wooden cane resting on his lap. The bench is positioned along a sidewalk that stretches parallel to a street. The man appears to be wearing a suit, and beside him is another individual seated, also in a suit.

In the background, two women are walking down the sidewalk towards the camera. One woman is wearing a dark dress and holding a large straw purse, while the other is in a light blue patterned dress, carrying a white object that looks like a purse or clutch.

The street is lined with buildings that feature mid-century architectural elements. There are signs visible for businesses, such as a store on the right that has 'ROCK HALL' visible on its signage. In the distance, a large building with a pointed roof and a tall sign is prominently featured. An advertisement stand on the sidewalk displays a poster for a city event or location, labeled "ST. LOUIS AVE". The sky is clear and the scene is well-lit, suggesting a sunny day. There is a tree providing shade on the left side of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image depicts a busy urban street scene in what appears to be a city. In the foreground, there is an elderly man sitting on a bench, wearing a hat and suit. Behind him, there are two women walking down the sidewalk, one wearing a dark dress and the other a light-colored dress. In the background, there are tall buildings, including what looks like a skyscraper with signage. The overall scene suggests a lively, bustling city environment.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The image shows an elderly man sitting on a bench in an urban setting, with two young women walking by in the background. The man appears to be resting and people-watching on a city street lined with shops and businesses. A tall building, possibly an office tower or hotel, can be seen in the background. The scene has an everyday, slice-of-life feel capturing a moment in a bustling city environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage photograph from what looks like the 1950s, showing a city street scene. An elderly man in a dark suit is sitting on a green park bench, holding what appears to be a hat and cane. In the background, two women are walking down the sidewalk wearing typical 1950s fashion - one in a navy dress and the other in a blue patterned dress. The urban setting includes tall buildings, including what appears to be a hotel or office building, and there's a yellow phone booth visible in the background. The image has the characteristic color quality of photographs from that era, and there are signs for businesses including one advertising loans. There's also some greenery from trees visible on the left side of the image.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a vintage photograph of a city street scene, likely taken in the mid-20th century. The photograph features a green wooden bench on the left side, where two elderly men are seated. One of the men is wearing a dark suit jacket and pants, while the other is dressed in a lighter-colored suit. A cane leans against the bench next to them.

In the background, two women are walking down the sidewalk, one wearing a dark dress and the other a blue skirt with a white blouse. The street is lined with buildings, including a tall skyscraper and a sign that reads "ROCK H" in green letters. A yellow sign on the sidewalk advertises "Beneficial Loans." The sky above is bright and clear, suggesting a sunny day.

Overall, the image captures a moment in time on a bustling city street, with people going about their daily lives amidst the urban landscape.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a vintage photograph of a city street scene, likely taken in the 1950s or 1960s. The photo features a group of people on the sidewalk, with a prominent green bench in the foreground.

On the left side of the image, an elderly man sits on the bench, wearing a dark suit jacket, brown pants, and a hat placed on his lap. He holds a cane in his right hand. To his right, another person sits on the bench, but their face is not visible.

In the background, two women walk along the sidewalk. The woman on the left wears a dark dress and carries a basket, while the woman on the right wears a white shirt and a blue skirt. She also carries a basket.

The street behind them is lined with buildings, including a tall skyscraper in the distance. A yellow sign with a poster advertising the US Army is visible on the right side of the image. The overall atmosphere of the photo suggests a quiet, everyday moment in a bustling city.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

On a sunny day, a man with a cane is sitting on a green bench in an outdoor area. He is looking at two women walking on the sidewalk. The women are wearing glasses and carrying handbags. Behind them, there is a yellow stand with a poster. Across the street, there are buildings, trees, and streetlights. On the left side, there is a tree, and on the right side, there is a trash bin.

Created by amazon.nova-lite-v1:0 on 2025-06-02

An old man is sitting on a bench on the sidewalk. He has a cane and a hat on his lap. Two women are walking on the sidewalk. One of them is carrying a basket. There is a signboard with the words "US Army" on it. There are buildings on the side of the road. There are trees and bushes on the side of the road.

Google Gemini

Created by gemini-2.0-flash on 2025-05-20

Here's a description of the image:

This vibrant, vintage photograph captures a slice of life on a city street. An elderly man sits on a green park bench in the foreground. He wears a dark jacket and brown trousers, with a straw hat resting on the bench beside him. A cane lies across his legs. His gaze is directed towards the scene unfolding on the sidewalk.

Two women, dressed in mid-century fashion, stroll along the sidewalk. One is in a dark dress and the other wears a light-colored blouse and a full, patterned skirt. Each carries a woven basket.

In the background, a bustling city street stretches out with cars and pedestrians moving about. Buildings of various heights line the street, including one with a sign indicating "Beneficial Loans." A sign advertising the US Army sits on the sidewalk. The photograph has a warm, sunny feel to it. The color quality and clothing styles suggest the image was taken sometime in the mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-20

Here is a description of the image:

The image is a vibrant, color photograph capturing a scene from a city street in what appears to be the mid-20th century. The scene is bustling with activity, showing a mix of people and architectural styles.

In the foreground, an elderly man is seated on a green park bench, his posture suggesting a moment of rest. He is dressed in a suit and holds a hat on his lap, and his cane rests on the ground nearby. Another person, partially visible, sits next to him on the bench.

In the mid-ground, two women are walking on the sidewalk in the opposite direction. They are dressed in clothing fashionable for the period, carrying baskets. Behind them is a yellow sign with an advertisement.

The background reveals a cityscape with tall buildings and a clear sky. There is a sign indicating "Beneficial Loans" and a storefront of "Rock H". The overall impression is one of a sunny day, captured at the height of a bustling city life in a bygone era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a street scene in an urban setting, likely from the mid-20th century. In the foreground, an elderly man is seated on a green park bench. He is wearing a suit, a hat, and has a cane resting beside him. His posture suggests he is relaxed, perhaps enjoying the day or waiting for someone.

In the background, two women are walking on the sidewalk. One woman is dressed in a dark dress and carrying a basket, while the other is wearing a light-colored dress with a patterned skirt and carrying a shopping bag. They appear to be engaged in conversation as they walk.

The street is lined with buildings, including a tall structure with the words "Personal Loans" visible on a sign. Other signs and storefronts are visible, including one for "Rock's" and another for "3023 St. Louis Ave." The architecture and signage suggest a bustling city environment.

The overall atmosphere of the image is calm and everyday, capturing a moment of urban life from a bygone era.

Qwen

No captions written

Text analysis

Amazon

ROCK
LOANS
BENEFICIAL
ROCK H
USARMY
H
AKOS
3523 ST LOUIS AVE
KODYK
KODYK EIFA
EIFA
FRANCE
Thomp
STER

Google

OUFU BENEFICIAL LOANS ww.A ROCK H OPTE 3523 ST LOUIS AVE NIDEED VBARMY ZACOX
OUFU
BENEFICIAL
LOANS
ww.A
ROCK
H
OPTE
3523
ST
LOUIS
AVE
NIDEED
VBARMY
ZACOX