Human Generated Data

Title

Untitled (Lower East Side, New York City)

Date

April 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3141

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3141

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Beard 100
Face 100
Head 100
Photography 99.3
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Portrait 99
Person 98.4
Adult 98.4
Male 98.4
Man 98.4
Clothing 95.2
Hat 95.2
Formal Wear 76.4
Suit 76.4
Hat 70.7
Coat 57.8
Overcoat 55.2
Sun Hat 55.1

Clarifai
created on 2018-05-10

people 98.5
bill 95.1
man 94.2
portrait 94.1
adult 93
illustration 89.8
one 87.2
wear 86.9
administration 85.4
retro 84.8
text 82.7
art 81.8
sign 78.4
business 77.9
music 75.3
group 75.2
offense 72.6
education 70.3
card 67.9
military 67.6

Imagga
created on 2023-10-07

book jacket 41.2
jacket 32
wrapping 24.3
barbershop 21.9
black 21.7
shop 19.6
symbol 18.2
man 16.8
covering 16.5
art 15.8
vintage 14.9
currency 14.4
mercantile establishment 14.1
financial 13.4
letter 12.8
cash 12.8
money 12.8
stamp 12.6
person 12.6
comic book 12.5
bill 12.4
conceptual 12.3
blackboard 12.2
text 12.2
business 12.1
postmark 11.8
mail 11.5
retro 11.5
male 11.4
old 11.1
dollar 11.1
finance 11
billboard 10.8
sign 10.5
grunge 10.2
card 10.2
face 9.9
silhouette 9.9
circa 9.9
envelope 9.7
close 9.7
place of business 9.5
bank 9.4
banking 9.2
dark 9.2
portrait 9.1
signboard 8.9
philately 8.9
success 8.8
postage 8.8
postal 8.8
ancient 8.6
design 8.4
people 8.4
economy 8.3
creation 8.3
message 8.2
slick 8.1
closeup 8.1
product 7.9
structure 7.9
shows 7.9
printed 7.9
horror 7.8
drawing 7.7
party 7.7
human 7.5
note 7.4
investment 7.3
graphic 7.3
aged 7.2
collection 7.2
wealth 7.2
adult 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

text 96.5
black 88.6
white 75.9
old 70
posing 47.1
vintage 28.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 59-69
Gender Male, 100%
Calm 93.2%
Surprised 6.6%
Fear 5.9%
Angry 3.3%
Sad 2.4%
Confused 0.8%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 98.4%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 82.4%
Sad 13.2%
Fear 6.8%
Surprised 6.4%
Disgusted 0.9%
Angry 0.3%
Confused 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 77
Gender Female

Microsoft Cognitive Services

Age 76
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Suit
Person 99.1%
Person 99.1%
Person 98.4%
Adult 99.1%
Adult 99.1%
Adult 98.4%
Male 99.1%
Male 99.1%
Male 98.4%
Man 99.1%
Man 99.1%
Man 98.4%
Hat 95.2%
Hat 70.7%
Suit 76.4%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-28

a photograph of a man with a hat and a hat on a street -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts three individuals standing in front of a backdrop that appears to feature large text advertisements or signage. The text includes words such as "MADE," "CORSETS," "SHIRTS," and "SILVERWARE," suggesting it might be related to a commercial establishment. Each person is dressed formally, wearing hats and dark suits, with one individual holding a flower or similar object. The overall aesthetic hints at an older, historical photo, possibly from the mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a black-and-white photograph depicting three individuals standing side by side. The person on the left is wearing a suit with a tie and a white fedora hat, adorned with a light-colored flower in their lapel. The individual in the middle is wearing a dark coat and a light-colored hat. The person on the right has a long, white beard and is wearing a black hat, along with dark attire. The background features a partially visible advertisement or sign, displaying large, bold letters in varying orientations, spelling out words like "SETS" and "SHIERS." The photograph has a vintage appearance, typical of an early to mid-20th century setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows two older men standing in front of a sign that says "RSETS CIER'S ET". The men appear to be wearing hats and coats, and one has a long beard. The background is dark, creating a moody, dramatic atmosphere. The image seems to capture a moment in time, perhaps depicting some kind of social or political protest or event.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph showing three elderly men standing together. Two are wearing fedora-style hats, and the one on the right has a prominent white beard. The image appears to be taken in front of a storefront or business sign, with partial text visible reading "RSETS" and "MADE" in the background. The photo has a vintage quality to it, likely from the early to mid-20th century. The man on the left appears to be holding something small in his hand, possibly a flower. The composition has a documentary or street photography style to it.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of three men in front of a sign with text. The man on the left is wearing a suit, tie, and fedora hat, holding a small object in his right hand. The middle man is wearing a dark coat and fedora hat. The man on the right is wearing a dark coat and a black hat.

The background of the image features a sign with large, light-colored letters that are partially obscured by the men. The letters appear to read "RSETS" and "MADE," but the rest of the text is not legible. The overall atmosphere of the image suggests a formal or professional setting, possibly from the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of three men standing in front of a sign with partially visible text. The man on the left wears a white fedora and holds an object in his right hand, while the man in the middle sports a dark-colored fedora. The man on the right has a long white beard and wears a dark-colored fedora as well.

The background features a sign with large letters, but only some of the text is legible. The visible words include "RSETS," "CIER," "ET," and "MADE." The overall atmosphere of the image suggests that it may be a vintage or historical photograph, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of three men standing together in front of a sign. The men are dressed in suits and hats, with the man on the left holding an ice cream cone. The sign behind them has the word "Made" at the top, followed by "Rsets" and "Siers" in large letters, with additional text below. The photograph appears to be from an older era, possibly from the 1920s or 1930s.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white image shows three men standing in front of a banner. The man on the left is holding a cone-shaped ice cream. The man in the middle is wearing a hat, and the man on the right is wearing a hat with a beard. Behind them is a banner with the words "MADE IN SILVERWARE" and "MADE IN SILVERWARE." The banner is probably hanging on the wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-01

Here is a description of the image:

Overall Impression:

The image is a black and white photograph, likely taken in the mid-20th century. It features three older men, all dressed in dark coats and hats, standing in front of a store with large lettering in the background. The image has a slightly grainy texture, suggesting a vintage film photograph.

Key Elements:

  • The Men: The focus of the image is on the three men. They all appear to be of an advanced age, with the middle man sporting a greyish beard. The man on the left is holding what looks like a flower. They all have serious expressions.
  • Attire: The men are dressed in suits and hats, typical of the era. They are all wearing dark-colored overcoats. The hats are a mix of fedoras and a white-brimmed hat.
  • Background: Behind the men is a sign with large, bold lettering, partially obscured. It seems to be an advertisement for a store that sells corsets. The background also includes a bit of additional signage, slightly faded, with text indicating the word "Silverware" and "Novelties".

Overall Composition and Mood:

The photograph conveys a sense of quiet dignity and perhaps a hint of mystery. The men are the central focus, with the dark clothing and background creating a contrast that draws the eye. The photograph's vintage nature further enhances this feeling. The slightly blurry quality adds to the overall nostalgic atmosphere.

Created by gemini-2.0-flash on 2025-06-01

The black and white photograph shows three mature men standing in front of a commercial storefront, which is identified as a corset and brassiere shop. The trio are all wearing dark overcoats and hats. The man on the left is wearing a light colored hat with a dark band. He has a flower pinned to his lapel and is holding something in his hand. The man in the middle has a light-colored hat and full white beard, which is visible under the brim of his hat. The man on the right has a dark colored hat and a similar full white beard. The name of the store behind them appears to be cut-off so it is not possible to tell the full name. The men appear to be standing on a sidewalk with the storefront behind them. The photograph is dark and there is not much visible detail.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring three elderly men standing in front of a sign. The sign in the background appears to be an advertisement for "Norsets Soiers" with the word "MADE" partially visible at the top. The men are dressed in formal attire, each wearing a hat.

  • The man on the left is wearing a suit with a tie and a white hat with a dark band. He is holding something in his right hand, which looks like a small object or piece of paper.
  • The man in the middle is wearing a dark hat and a dark coat. His facial features are less distinct compared to the other two men.
  • The man on the right has a long beard and is wearing a dark coat and a dark hat. He is looking directly at the camera.

The photograph has a vintage feel, likely taken in the early to mid-20th century, judging by the style of clothing and the quality of the image. The men's expressions and posture suggest a sense of formality and perhaps a significant occasion.

Text analysis

Amazon

RSETS
Y
S
MADE
ET
of
SHO
IER
NOVELLIE
alpern
ЛЕТ SHO
o
Alverwan
ЛЕТ

Google

RSETS S의 ERmS
RSETS
S
ERmS