Human Generated Data

Title

Untitled (Middleboro, Kentucky)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1446

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Middleboro, Kentucky)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1446

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Accessories 100
Bag 100
Handbag 100
City 99
Road 99
Street 99
Urban 99
Clothing 97.5
Coat 97.5
Face 77.1
Head 77.1
Machine 74.4
Pedestrian 73.2
Footwear 72.8
Purse 71
Walking 63.5
Path 56.9
Sidewalk 56.9
Market 56.1
Shorts 56.1
Overcoat 56
Shop 56
Bus Stop 55.8
Outdoors 55.8

Clarifai
created on 2018-05-11

people 100
group together 99.7
many 99.1
group 99
adult 97.5
man 95
several 94.1
administration 92.6
woman 91.9
leader 91
wear 89
recreation 88.7
war 86.3
military 85.6
vehicle 85.3
child 81
crowd 80.6
transportation system 78.8
soldier 77
chair 76.8

Imagga
created on 2023-10-07

engineer 27.5
man 26.2
uniform 26
brass 19.7
trombone 19
people 19
male 18.4
clothing 17.9
military uniform 17.7
war 16.4
military 16.4
wind instrument 16.2
travel 15.5
protection 15.5
danger 15.5
city 15
sky 14.7
old 14.6
person 13.9
mask 13.4
weapon 13.3
pedestrian 12.9
building 12.7
gun 12.1
musical instrument 12
industrial 11.8
soldier 11.7
destruction 11.7
architecture 11.7
nuclear 11.6
history 11.6
men 11.2
industry 11.1
outdoor 10.7
urban 10.5
safety 10.1
leisure 10
camouflage 9.8
toxic 9.8
army 9.7
protective 9.7
fun 9.7
gas 9.6
construction 9.4
vacation 9
radioactive 8.8
radiation 8.8
together 8.8
chemical 8.7
life 8.6
day 8.6
sport 8.6
adult 8.4
tourism 8.2
covering 8.2
environment 8.2
dirty 8.1
suit 8.1
rifle 7.9
stalker 7.9
work 7.8
battle 7.8
accident 7.8
two 7.6
horse 7.6
outdoors 7.5
tourist 7.4
symbol 7.4
historic 7.3
consumer goods 7.2
child 7.2
transportation 7.2
religion 7.2
worker 7.1
to 7.1
summer 7.1
happiness 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.9
person 98.6
people 87.4
white 76.9
group 72.9
old 68.1
black 66
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 36-44
Gender Female, 80.5%
Calm 92.9%
Surprised 6.3%
Fear 5.9%
Confused 3.4%
Sad 3.2%
Angry 0.5%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Male, 50.8%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-31
Gender Female, 98.5%
Sad 100%
Fear 6.9%
Surprised 6.7%
Calm 3.4%
Angry 1.6%
Confused 1.1%
Happy 0.7%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Female, 90.6%
Calm 32.2%
Happy 16.9%
Surprised 13.2%
Fear 11.3%
Angry 9.3%
Sad 8.2%
Disgusted 8%
Confused 3.7%

AWS Rekognition

Age 26-36
Gender Male, 98.7%
Calm 78.3%
Sad 30.7%
Surprised 6.3%
Fear 5.9%
Confused 0.4%
Happy 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 94.3%
Surprised 7.6%
Fear 6%
Sad 2.3%
Happy 1.1%
Confused 0.7%
Disgusted 0.6%
Angry 0.3%

AWS Rekognition

Age 13-21
Gender Female, 83.1%
Calm 48%
Fear 24.3%
Sad 12.1%
Surprised 10.2%
Happy 2.7%
Confused 2.4%
Disgusted 1.8%
Angry 1.7%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 65.7%
Surprised 18.6%
Fear 8%
Sad 7.2%
Confused 2%
Angry 1.9%
Disgusted 1.8%
Happy 0.5%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Female
Woman
Wheel
Shoe
Hat

Clarifai

Man
Clothing
Footwear
Tree
Human face
Wheel
Human hair

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 94.7%

AWS Rekognition

Person 94.6%

AWS Rekognition

Person 94.2%

AWS Rekognition

Person 94%

AWS Rekognition

Person 93.2%

AWS Rekognition

Person 90.1%

AWS Rekognition

Person 84.3%

AWS Rekognition

Person 81.1%

AWS Rekognition

Person 73.9%

AWS Rekognition

Person 71.3%

AWS Rekognition

Person 70.8%

AWS Rekognition

Person 63.1%

AWS Rekognition

Person 61.9%

AWS Rekognition

Person 57.1%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 97.7%

AWS Rekognition

Adult 97.3%

AWS Rekognition

Adult 93.2%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 97.3%

AWS Rekognition

Male 93.2%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 97.3%

AWS Rekognition

Man 93.2%

AWS Rekognition

Female 97.7%

AWS Rekognition

Woman 97.7%

AWS Rekognition

Wheel 74.4%

AWS Rekognition

Shoe 72.8%

AWS Rekognition

Shoe 72.4%

AWS Rekognition

Shoe 61.3%

AWS Rekognition

Shoe 58.8%

AWS Rekognition

Shoe 56.5%

AWS Rekognition

Hat 68.8%

AWS Rekognition

Hat 62.4%

AWS Rekognition

Hat 57.2%

Clarifai

Man 79.8%

Clarifai

Man 79.2%

Clarifai

Man 79.1%

Clarifai

Man 77.1%

Clarifai

Man 75.6%

Clarifai

Man 72.2%

Clarifai

Man 71.9%

Clarifai

Man 63.9%

Clarifai

Man 62.7%

Clarifai

Man 62.7%

Clarifai

Man 60%

Clarifai

Man 59.3%

Clarifai

Man 54.3%

Clarifai

Man 53.2%

Clarifai

Man 46.4%

Clarifai

Clothing 79.4%

Clarifai

Clothing 70.4%

Clarifai

Clothing 69.1%

Clarifai

Clothing 61.5%

Clarifai

Clothing 61.5%

Clarifai

Clothing 51.3%

Clarifai

Clothing 51.3%

Clarifai

Clothing 46%

Clarifai

Clothing 45.2%

Clarifai

Clothing 42.8%

Clarifai

Clothing 41.9%

Clarifai

Clothing 39%

Clarifai

Clothing 37.5%

Clarifai

Clothing 35.8%

Clarifai

Clothing 33.7%

Clarifai

Footwear 78.8%

Clarifai

Footwear 78.1%

Clarifai

Footwear 77.4%

Clarifai

Footwear 77%

Clarifai

Footwear 75.3%

Clarifai

Footwear 68.8%

Clarifai

Footwear 67.2%

Clarifai

Footwear 65.2%

Clarifai

Footwear 65.1%

Clarifai

Footwear 62.5%

Clarifai

Footwear 56.9%

Clarifai

Footwear 56.9%

Clarifai

Footwear 54.9%

Clarifai

Footwear 54.7%

Clarifai

Footwear 52%

Clarifai

Footwear 52%

Clarifai

Footwear 45.4%

Clarifai

Footwear 45.2%

Clarifai

Footwear 40%

Clarifai

Footwear 36.5%

Clarifai

Footwear 34.7%

Clarifai

Footwear 33.4%

Clarifai

Tree 67.1%

Clarifai

Tree 37.7%

Clarifai

Human face 38.3%

Clarifai

Wheel 38%

Clarifai

Human hair 33.1%

Categories

Imagga
created on 2023-10-07

streetview architecture 93.2%
paintings art 3.5%
nature landscape 1.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a woman in a dress and hat walking down a street

Created by general-english-image-caption-blip-2 on 2025-07-05

an old black and white photo of people walking down the street

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a lively street scene from mid-20th century America. People are walking along a commercial street lined with various businesses, including a hardware store and Lee's Drug Store, advertising items like soda. Some individuals appear to be engaged in conversation or going about their daily errands. The surroundings show a mix of cars parked on the street and storefronts, with some individuals dressed formally and others more casually. In the foreground, a person is sweeping the street with a broom while a wooden cart is visible nearby. The atmosphere suggests an everyday urban setting with a bustling community.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a lively street scene, presumably from the early to mid-20th century, based on the clothing styles and presence of vintage automobiles. The street is bustling with activity, showing a diverse group of people. A person wearing a white uniform is sweeping the sidewalk, suggesting they might be employed by a nearby business or municipality. Several men are dressed in suits and hats typical of the era, reflecting a formal fashion vibe. Businesses lining the street include a drugstore named "Lee's Drugs" and a hardware store, both with distinct signage. Some individuals are carrying shopping bags, indicating they might be patrons of the local stores. The sidewalk is crowded, suggesting this is a busy, perhaps commercial, area in the town or city.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph depicting a busy street scene in what looks like a small town or city. There are several people visible on the sidewalk, including men wearing hats and coats, as well as a woman carrying a child. The buildings in the background include a hardware store and other shops, and there is a street lamp visible as well. The overall scene conveys a sense of activity and liveliness in the town.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from the 1930s or 1940s, showing a busy street scene in what looks like a small American town. There's a hardware store and "Lee's Drugs" visible in the storefronts. Several people are walking along the sidewalk, with men wearing hats typical of the era. In the foreground, there's someone in a white apron or uniform with what appears to be a cleaning or maintenance tool. The street has both pedestrians and what looks like period automobiles parked along it. The scene captures everyday life during this historical period, with people going about their daily business in a typical main street setting. The image has the characteristic grainy quality of photographs from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image is a black-and-white photograph of a street scene in the 1930s. The street is lined with storefronts, including a hardware store and a pharmacy. A group of people are walking down the street, some of whom are dressed in clothing from the 1930s. One man is wearing a suit and hat, while another is wearing overalls and a newsboy cap. A woman in a dress and coat is walking alongside them. In the foreground, a man is sweeping the sidewalk with a broom. The background of the image shows trees and a clear sky, suggesting that it is a sunny day. The overall atmosphere of the image is one of everyday life in a small town during the Great Depression.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image depicts a black-and-white photograph of a bustling street scene, with a man in the foreground sweeping the sidewalk. He is dressed in a white apron and hat, holding a broom in his right hand and leaning on it with his left. A chair is positioned in front of him.

In the background, several people are walking along the sidewalk, some carrying items or reading newspapers. The street is lined with storefronts, including a hardware store and a drugstore, which feature signs above their entrances. Cars are parked along the street, adding to the lively atmosphere.

The overall mood of the image suggests a busy day in a small town, with people going about their daily activities. The presence of the man sweeping the sidewalk adds a sense of community and maintenance to the scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-25

A black-and-white photograph of a busy street, with people walking on the sidewalk. The woman in front is carrying a newspaper, and she is wearing a hat and high heels. There are stores on the side of the street, with some people standing in front of them. There are also cars parked on the side of the street, and a street light is standing near the trees.

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image is a black-and-white photograph depicting a busy street scene from the past. The street is lined with shops, some of which have awnings. A prominent sign reads "HARDWARE," indicating the type of business. People of various ages and genders are walking on the sidewalk, some wearing hats and shoes, while others are dressed casually.

In the foreground, a person dressed in a chef's uniform, including a hat, is holding a broom and appears to be sweeping the sidewalk. The person is positioned near a car, which is parked on the side of the street.

The atmosphere is lively, with several people walking in different directions, some carrying bags or other items. The image captures a moment of everyday life in a town or city, showcasing the hustle and bustle of the street and the diverse activities of the people present.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

This black and white photograph appears to capture a bustling street scene, possibly from the mid-20th century. A woman in a knee-length dress, stockings, and sensible shoes confidently strides towards the viewer, holding what seems to be reading materials. Her focused expression suggests she is on a mission.

In the background, a diverse group of people can be seen walking in both directions. Men in hats and suits mingle with children and workers. The buildings on either side of the street display signs for businesses like "Lee's Drugs and Sodas" and "Hardware," suggesting a small town or urban center.

Near the front, a man in a white apron and hat appears to be sweeping the sidewalk with a straw broom, contributing to the dynamic atmosphere of the scene. The presence of vintage cars along the side of the street further reinforces the historical context of the photograph. Overall, the image offers a glimpse into everyday life from a bygone era.

Created by gemini-2.0-flash-lite on 2025-04-29

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph that appears to be from the early to mid-20th century. It depicts a bustling street scene with several people, stores, and cars.

Key Elements:

  • People: There are many people of varying ages and attire on the street. They are walking in different directions, and some are engaged in conversation or simply observing their surroundings. The people appear to be of diverse backgrounds.
  • Stores: A "HARDWARE" store is visible, as well as a "LEE'S DRUGS" store with a "SODAS" sign.
  • Vehicles: A car is parked on the left side, and more cars and trucks may be visible.
  • Setting: The scene is set on a city street, likely in a commercial district. There are buildings with awnings, suggesting a sunny day.
  • Foreground: The photo shows a person sweeping the street with a broom. Also in the foreground is a chair of some kind.

Overall Mood:

The photograph has a sense of movement and everyday life. It seems to capture a moment in time on a busy city street. The vintage quality of the photograph adds to its nostalgic appeal.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-26

The image appears to be a historical photograph depicting a street scene from an earlier era, likely the early to mid-20th century. Here are some key details:

  1. Setting: The photograph shows a busy street with a mix of pedestrians and a few visible storefronts. The architecture and signage suggest a small-town or urban setting from the past.

  2. People:

    • Foreground: A man dressed in a white uniform, possibly a street cleaner, is leaning on a broom. He is wearing a cap and appears to be resting or taking a break.
    • Midground: Several men and women are walking along the sidewalk. The men are dressed in suits, hats, and ties, indicative of the fashion of the time. One woman is walking with a child, holding her hand.
    • Background: More people are visible further down the street, including a man wearing a hat and coat, and another woman walking with a child.
  3. Storefronts:

    • Lee's Drugs: A prominent sign for "Lee's Drugs" is visible, indicating a pharmacy or drugstore.
    • Hardware Store: Another sign indicates a hardware store, suggesting a commercial area with various shops.
  4. Vehicles: There is a partial view of a vintage car on the left side of the image, further emphasizing the historical context.

  5. Street Elements: A streetlight and awnings over the storefronts are visible, adding to the period atmosphere.

The overall scene captures a moment of everyday life in a bygone era, with people going about their daily activities in a commercial district.

Qwen

No captions written

Text analysis

Amazon

LEE'S
HARDWAR
SODAS
-
DPUGS.
ZO-
A
aud

Google

HARDWAR LEES DRUG
HARDWAR
LEES
DRUG