Human Generated Data

Title

Untitled (Main Street, Lancaster, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.30

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Main Street, Lancaster, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.30

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Person 96.9
Person 95.2
Sitting 94.3
Clothing 92.6
Footwear 92.6
Person 92.1
Shop 91.5
Person 91
Male 79.9
Person 79.9
Boy 79.9
Child 79.9
Shoe 79.7
Shoe 77.7
Face 69.9
Head 69.9
Coat 69.6
Shoe 61.2
Shoe Shop 57.5
Accessories 57.5
Glasses 57.5
Indoors 57.4
Formal Wear 57.2
Suit 57.2
Furniture 55.6

Clarifai
created on 2018-05-11

people 99.9
group 99.3
one 99.1
two 99
adult 98.8
furniture 98
group together 98
many 97.6
three 96.7
man 96.3
room 96.1
leader 95.6
administration 94.7
vehicle 93.8
four 93.4
several 92.7
commerce 91.5
merchant 90.3
street 90
chair 88.6

Imagga
created on 2023-10-06

stall 57.1
computer 28.1
technology 22.3
working 22.1
work 22
business 21.9
worker 18.7
man 16.8
shop 15.2
person 15.2
musical instrument 14.7
people 14.5
adult 14.2
equipment 14.1
machine 13.9
laptop 13.8
office 13.7
support 13
industry 12.8
male 12.8
accordion 12.4
indoors 11.4
happy 11.3
modern 11.2
sitting 11.2
professional 11
smile 10.7
interior 10.6
busy 10.6
warehouse 10.5
one 10.4
smiling 10.1
truck 10.1
businesswoman 10
transportation 9.9
factory 9.6
keyboard instrument 9.6
storage 9.5
vehicle 9.4
indoor 9.1
attractive 9.1
black 9
wind instrument 8.9
center 8.9
monitor 8.8
home 8.8
forklift 8.7
hardware 8.6
portrait 8.4
floor 8.4
device 8.3
stack 8.3
book 8
desk 7.9
engineer 7.9
telephone 7.8
men 7.7
product 7.7
repair 7.7
old 7.7
case 7.6
store 7.6
keyboard 7.5
shirt 7.5
service 7.4
phone 7.4
room 7.4
inside 7.4
occupation 7.3
industrial 7.3
lifestyle 7.2
information 7.1
job 7.1
television 7.1

Google
created on 2018-05-11

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 58-66
Gender Male, 100%
Calm 67.9%
Sad 24.6%
Surprised 8.2%
Fear 6.3%
Confused 3.7%
Disgusted 1.8%
Angry 1.8%
Happy 1.3%

AWS Rekognition

Age 6-12
Gender Female, 86.9%
Calm 93.9%
Fear 7.5%
Surprised 6.3%
Sad 2.5%
Disgusted 0.6%
Happy 0.3%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 41.3%
Fear 33.9%
Surprised 14.4%
Disgusted 7.4%
Angry 3.9%
Sad 3%
Confused 2%
Happy 0.9%

AWS Rekognition

Age 38-46
Gender Female, 99.1%
Happy 95.8%
Surprised 6.5%
Fear 6.5%
Sad 2.2%
Calm 0.7%
Confused 0.6%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 21-29
Gender Male, 73.7%
Sad 99.6%
Calm 30.8%
Surprised 6.6%
Fear 6%
Happy 1.5%
Disgusted 0.8%
Angry 0.7%
Confused 0.5%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Boy
Child
Shoe
Glasses
Adult 99.2%
Male 99.2%
Male 79.9%
Man 99.2%
Person 99.2%
Person 96.9%
Person 95.2%
Person 92.1%
Person 91%
Person 79.9%
Boy 79.9%
Child 79.9%
Shoe 79.7%
Shoe 77.7%
Shoe 61.2%
Glasses 57.5%

Categories

Captions

Microsoft
created by unknown on 2018-05-11

a person sitting in a box 29.4%

Clarifai
created by general-english-image-caption-blip on 2025-05-31

a photograph of a man sitting on the sidewalk in front of a store -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows a man sitting on the sidewalk near a storefront in an urban setting. He is dressed in a suit, with a tie and dark shoes, and has a cane resting beside him. The storefront displays various items, including bathing goods, belts, suspenders, photographs, and framed portraits. To the right of the man is another window filled with white shoes displayed on racks. The scene suggests a moment from the past with vintage-style merchandise and architecture.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a street scene in front of a store. To the left, there is a display window with various items, including bathing goods, caps, belts, and sandals. Prices such as 10 cents and 25 cents are visible on some of the items. The window also features a collection of photographs, including two larger portraits and a few smaller images. To the right, another window displays several pairs of white shoes arranged on multiple shelves.

In the foreground, a man is sitting on the sidewalk. He is dressed in a suit and tie and is sitting on a piece of fabric or paper. In front of him, there is a black hat with what appears to be a few pencils inside, suggesting he may be selling them or seeking donations. A crutch lays on the ground beside him, and his posture indicates he is resting or waiting. Nearby, a woman in a patterned dress is standing partially in the frame on the left. The scene is composed with an art-deco style building facade visible behind them.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a man sitting on the sidewalk outside a store, with a newspaper and a shoe-shining kit in front of him. He is dressed in a suit and tie, and appears to be engaged in shoe shining. The store behind him has a sign that reads "Bathing Goods" and displays various items in its window, including shoes and a dress. The overall atmosphere suggests a quiet, everyday scene from a bygone era.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of an elderly man sitting on the sidewalk in front of a storefront. The man is dressed in a suit and tie, with his legs crossed and his hands resting on his knees. He appears to be holding a hat or container filled with straws or other objects. A cane lies on the ground beside him.

In the background, there are two storefronts visible. The one on the left features a window display with various items, including clothing, accessories, and signs. The sign on the window reads "Bathing Goods" and lists prices for different items. The storefront on the right has a window display with shoes and other items.

The overall atmosphere of the image suggests that the man may be a street performer or vendor, possibly selling his wares or performing for passersby. The presence of the cane and the man's seated position suggest that he may be elderly or disabled, and the image conveys a sense of vulnerability and resilience.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

A black-and-white photo shows a man sitting on the ground in front of a store. He is wearing a suit and tie, glasses, and leather shoes. He is holding a newspaper and a cigarette in his hand. The store has a glass window with shelves displaying different products, including hats, shoes, and handbags. There is a signboard with the text "Bathing Goods" on the glass window.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image features a black-and-white photograph of an elderly man sitting on the sidewalk in front of a store. The man is wearing a suit, a tie, and glasses. He is holding a newspaper and appears to be waiting for something or someone. The store has a glass window with various items displayed, including hats, shoes, and other accessories. There is also a signboard with the text "BATHING GOODS" and other words.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Here is a description of the image:

The image is a black and white photograph showing a man sitting on the sidewalk in front of two store windows. The man is wearing a suit, tie, and glasses. He has a cup in his hand, and he is sitting on a piece of newspaper. A crutch lies on the ground next to him.

The store window on the left contains items labeled as "Bathing Goods," "Caps, Belts & Sandals," with prices of "10" and "25". There are also small framed photographs displayed in the window, perhaps advertising a photo service.

The store window on the right displays a variety of white shoes. The facade of the store window has vertical fluting and decorative squares. In the lower right corner, there is some text on the facade.

A woman is partly visible on the left side of the image, wearing a floral dress, likely window shopping. The scene appears to be set in a city, with a sense of everyday life captured in a moment.

Created by gemini-2.0-flash-lite on 2025-06-05

Here's a description of the image:

Overall Impression:

The image is a black and white photograph that appears to be from the mid-20th century. It depicts a man sitting on a sidewalk in front of a storefront. The scene has a poignant, historical feel.

Key Elements:

  • The Man: A middle-aged man with glasses sits on the sidewalk, possibly homeless or in dire straits. He's dressed in a suit, which adds to the overall melancholic feeling. He has a cup in his lap, possibly for collecting donations, and is sitting on a newspaper.
  • Storefronts: The photograph captures two storefronts. One sells bathing goods and includes a sign that says "Bathing Goods," "Caps," "Belts," and "Sandals." The other storefront sells shoes.
  • Crutches: Lying on the sidewalk near the man are a pair of crutches, implying the man may have a physical disability or is disabled.
  • Composition and Setting: The photo is taken outdoors on a city street. The composition is a bit off-center, with the man dominating the foreground and the storefronts providing the background. The contrast between the man's attire and his situation contributes to the photograph's emotional impact.

Overall Mood/Interpretation:

The image evokes feelings of poverty, hardship, and perhaps isolation. The man’s presence alongside the storefronts, which include clothing for sale, suggests a contrast between what he lacks and what is readily available. It's a snapshot of everyday life in a time gone by, capturing a moment of human struggle.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The black-and-white photograph depicts an elderly man sitting on a small stool on a sidewalk in front of a store. The man is dressed in a suit and tie, wearing glasses, and appears to be a shoe shiner, as evidenced by the shoe shine box and brushes he is holding. His equipment, including a footrest and additional brushes, is placed on the sidewalk beside him.

The store behind him has a display window showcasing various items. On the left side of the window, there are bathing goods such as caps and belts, with price tags indicating they cost $1.00 each. There are also framed photographs of individuals, possibly famous figures or athletes, displayed in the window. On the right side of the window, there are several pairs of white shoes displayed on stands.

The store's entrance is to the right of the man, and the facade of the building appears to be made of stone or concrete with decorative elements. The overall scene suggests a mid-20th-century urban setting, capturing a moment of everyday life in a city.

Text analysis

Amazon

BATHING
GOODS
25
SANDALS
10
BELTS
(APS
A
A PHOTOS10
BELTS R
D
PHOTOS10
RA
R

Google

GOOD APS 10 1O 25
GOOD
APS
10
1O
25