Human Generated Data

Title

Untitled (New York City)

Date

November 1935-1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2903

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

November 1935-1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2903

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Formal Wear 99.5
Suit 99.5
Head 87.8
Face 86.8
Overcoat 80.4
City 78.9
Smoke 66.1
Photography 57.2
Portrait 57.2
Sun Hat 57.1
Jacket 56.9
Shop 55.8

Clarifai
created on 2018-05-10

people 100
two 99.1
adult 98.7
group 98.1
veil 98.1
man 98
lid 97.6
three 97
fedora 96.9
group together 96.6
administration 96.2
wear 96
outfit 95.6
portrait 92.5
leader 92.5
four 91.2
woman 88.4
movie 87.6
several 87.6
outerwear 87.2

Imagga
created on 2023-10-06

man 53.1
hat 52.7
male 48.2
suit 41.5
person 40.6
clothing 31
portrait 29.8
people 27.9
adult 26
face 25.6
cowboy hat 24.2
business 23.7
handsome 22.3
guy 22
men 21.5
businessman 19.4
garment 19.2
black 18.8
happy 18.8
professional 18.1
headdress 18
office 17.8
looking 17.6
smiling 17.4
smile 17.1
scholar 16.1
look 15.8
work 15.7
attractive 15.4
hand 15.2
covering 15
worker 14.8
tie 14.2
shirt 14
intellectual 13.8
industry 13.7
head 13.4
grandfather 13.4
model 13.2
manager 13
corporate 12.9
success 12.9
engineer 12.9
casual 12.7
one 12.7
consumer goods 12.6
helmet 12.5
bartender 12.4
bow tie 12.4
senior 12.2
expression 11.9
necktie 11.9
occupation 11.9
architect 11.6
job 11.5
construction 11.1
hair 11.1
safety 11
studio 10.6
glasses 10.2
indoor 10
eye 9.8
hardhat 9.8
old 9.8
working 9.7
serious 9.5
engineering 9.5
lifestyle 9.4
executive 9.3
foreman 9.2
jacket 9.2
confident 9.1
pose 9.1
masculine 8.8
designer 8.7
boy 8.7
formal 8.6
building 8.5
dark 8.3
successful 8.2
sexy 8
beard 7.9
standing 7.8
contractor 7.8
mysterious 7.8
shop 7.7
modern 7.7
builder 7.7
mystery 7.7
talk 7.7
smart 7.5
site 7.5
human 7.5
style 7.4
mustache 7.1
posing 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.8
outdoor 87.2
standing 78.8
store 35.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 57-65
Gender Male, 100%
Calm 49.9%
Sad 25.3%
Happy 13.6%
Surprised 7.7%
Fear 7%
Confused 4.3%
Angry 4.2%
Disgusted 3.5%

AWS Rekognition

Age 45-51
Gender Male, 96.7%
Calm 90.8%
Surprised 6.4%
Fear 6%
Sad 3.7%
Happy 2.7%
Disgusted 1.1%
Angry 0.8%
Confused 0.2%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat

Clarifai

Man
Human face
Fedora
Poster

AWS Rekognition

Adult 98.7%

AWS Rekognition

Adult 98.6%

AWS Rekognition

Male 98.7%

AWS Rekognition

Male 98.6%

AWS Rekognition

Man 98.7%

AWS Rekognition

Man 98.6%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 98.6%

AWS Rekognition

Hat 96.1%

AWS Rekognition

Hat 95.3%

Clarifai

Man 94.7%

Clarifai

Man 94%

Clarifai

Human face 88.5%

Clarifai

Human face 85.3%

Clarifai

Fedora 73.4%

Clarifai

Fedora 68%

Clarifai

Poster 38.1%

Categories

Imagga
created on 2023-10-06

paintings art 53.4%
people portraits 25.8%
food drinks 6.6%
interior objects 6%
streetview architecture 4.2%
text visuals 1.7%
pets animals 1%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-06

two men in hats and coats standing in front of a store

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a suit and hat standing next to a man in a suit

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts two individuals dressed in formal overcoats and hats standing on a busy street. Behind them, there is a storefront window displaying various products, including advertisements for items such as "Ex-Lax" chocolate laxative. The scene suggests an urban setting, possibly taken during the mid-20th century, with additional details in the background like hanging signs and objects.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts two individuals standing on a street. They are dressed in overcoats and are wearing hats typical of an earlier era, giving a vintage feel to the scene. One person appears to be holding an item in their hands. They are standing in front of a shop window, which contains various products, and there is a sign next to them advertising "Ex-Lax, The Chocolate Laxative." Behind them, the street is bustling with an arrangement of indistinct shops and signs, as well as some hanging items like a bucket, suggesting a busy urban environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows two men standing on a city street. They are both wearing hats and coats, and appear to be engaged in conversation. The background includes a storefront with signs and advertisements visible through the window. The image has a vintage, black and white appearance, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white vintage photograph showing two men standing outside what appears to be a shop window. Both men are wearing dark fedora hats and overcoats in what seems to be a style from the early 20th century. One man appears to be showing something to the other, who is leaning in to look. The shop window behind them has some signage visible, including what appears to read "EX-LAX." The image has the grainy, slightly blurred quality typical of photographs from this era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two men in suits and hats standing outside a storefront.

The man on the left wears a dark suit, a white shirt, a dark tie, and a dark fedora-style hat. He holds a cigarette in his right hand, with the smoke rising from it. The man on the right also wears a dark suit, a white shirt, a dark tie, and a dark fedora-style hat. He appears to be looking down at something in his hands.

In the background, there is a storefront with a sign that reads "EX-LAX" and other illegible text. The overall atmosphere of the image suggests a casual, everyday moment captured in time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of two men standing on a sidewalk, engaged in conversation. The man on the left wears a dark suit, tie, and hat, while holding a pipe in his right hand. His companion, dressed in a dark coat, tie, and hat, stands to his right. In the background, a storefront with a sign reading "EX-LAX" is visible, along with other signs and a thermometer. The overall atmosphere suggests a casual encounter between the two men, possibly during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

A black-and-white photo of two men standing outside a shop. The man on the left is smoking a cigarette, while the man on the right is looking at him. They are both wearing hats and coats. The shop has a glass door with a thermometer and a sign that reads "EX-LAX The Laxative." There are also some items displayed on the shelves inside the shop.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows two men standing in front of a store. The man on the left is wearing a hat and a tie and is smoking a cigarette. He is looking at the man on the right, who is wearing a hat and a belt and is holding something in his hands. Behind them, there is a store with a glass window displaying products. The store has a signboard with the text "Ex-Lax".

Google Gemini

Created by gemini-2.0-flash on 2025-05-21

Here is a description of the image:

This is a black and white photograph featuring two men standing in front of a store window, likely on a city street. The older man on the left has a small pipe in his mouth and appears to be holding something in his hand, possibly a lighter or matches. He's wearing a dark overcoat, a collared shirt with a tie, and a dark hat with a short brim. To his right is another man who is also wearing a dark overcoat, collared shirt with a tie, and a similar style dark hat. His overcoat is belted at the waist.

The store window next to them displays various items, with a prominent advertisement for "EX-LAX The Chocolate Laxative" visible on a sign in the window. A thermometer is also visible next to the advertisement.

In the background, the street appears busy with pedestrians. The overall tone of the photograph suggests it was taken sometime in the mid-20th century. The image has some damage, with scratches and imperfections on the surface of the photo.

Created by gemini-2.0-flash-lite on 2025-05-21

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely taken in the mid-20th century. It features two older men standing near a storefront. The quality suggests it may be an older photograph.

Key Elements:

  • The Men: The men are the focal point. Both are wearing dark coats and hats, which are typical of the era. One of the men has a pipe in his mouth. Their expressions are partially obscured, but they appear to be engaged in a conversation or moment.
  • The Storefront: To the left is a storefront, possibly a pharmacy or general store, with display cases filled with various products. A sign advertising "Ex-Lax" is also seen.
  • Background: The background is blurred, suggesting movement or a busy street scene. Other shop fronts and possible pedestrian activity can be faintly made out.

Style and Tone:

The photograph has a classic, slightly grainy texture, typical of older film photography. The composition and attire of the men convey a sense of formality.

Possible Context:

The photograph likely captures a candid moment on a city street, perhaps in a working-class neighborhood. It provides a glimpse into the everyday lives and fashion of the period.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting two men standing outside a storefront. Both men are dressed in formal attire typical of the early to mid-20th century, including suits, ties, and hats. The man on the left is smiling and appears to be holding a small object in his hands, possibly a cigarette or a small piece of paper. The man on the right is leaning slightly forward, seemingly engaged in conversation with the man on the left.

The storefront behind them has a sign that reads "EX-LAX," indicating it might be a pharmacy or a store selling laxatives and other medicinal products. The window display of the store shows various items, likely medicines or health-related products. The street scene in the background includes other buildings and possibly some vehicles, suggesting an urban setting. The overall atmosphere of the photograph conveys a sense of casual interaction between the two men in a public, commercial area.

Qwen

Text analysis

Amazon

The
Chocolated
9
EXLAX
Prescriptions
-
Laxative
the
THIS STORE

Google

9 LAX The
9
LAX
The