Human Generated Data

Title

Untitled (New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2878

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2878

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Formal Wear 100
Coat 100
Sun Hat 99.5
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 99
Male 99
Man 99
Person 99
Hat 98.2
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Face 94.7
Head 94.7
Person 93.8
Person 91.2
Suit 89.8
Shirt 86.1
Hat 85.5
Photography 81.3
Portrait 81.3
Accessories 60.4
Tie 60.4
Suit 60.1
Tuxedo 57
Overcoat 55.9
Cap 55.7

Clarifai
created on 2018-05-10

people 99.9
adult 98.7
two 98.3
group 98.2
man 98.2
group together 98.2
wear 95.8
outfit 95.5
three 95.3
lid 93.9
administration 93.7
leader 93.4
several 92.8
veil 92.3
uniform 90.8
four 90.8
portrait 90.3
movie 89.2
many 88.8
one 88.5

Imagga
created on 2023-10-06

man 54.4
male 39.7
person 34.6
people 30.1
work 25.1
business 24.3
professional 22
face 21.3
office 21
men 20.6
businessman 20.3
adult 19.7
portrait 18.1
sitting 18
worker 17.3
suit 17
job 16.8
bartender 16.3
looking 16
senior 15.9
occupation 15.6
table 15.6
lifestyle 15.2
happy 15
look 14.9
tie 14.2
black 13.8
hat 13.5
call 13.3
smiling 13
mature 13
glasses 13
corporate 12.9
smile 12.8
restaurant 12.8
serious 12.4
working 12.4
shop 12.3
clothing 12.1
coat 11.9
old 11.8
confident 11.8
handsome 11.6
engineer 11.6
holding 11.6
indoors 11.4
hand 11.4
executive 11.4
desk 11.3
barbershop 11.1
guy 10.5
computer 10.4
attractive 9.8
necktie 9.7
medical 9.7
study 9.3
manager 9.3
building 9.2
scientist 8.8
chemistry 8.7
education 8.7
happiness 8.6
college 8.5
meeting 8.5
shirt 8.4
employee 8.4
phone 8.3
one 8.2
laptop 8.2
bow tie 8.1
hair 7.9
student 7.9
conversation 7.8
talk 7.7
exam 7.7
elderly 7.7
profession 7.7
career 7.6
mercantile establishment 7.5
focus 7.4
tool 7.4
indoor 7.3
alone 7.3
group 7.3
success 7.2
color 7.2
team 7.2

Microsoft
created on 2018-05-10

person 100
man 99.7
hat 87.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Suit
Adult 99.1%
Adult 99%
Adult 97.3%
Male 99.1%
Male 99%
Male 97.3%
Man 99.1%
Man 99%
Man 97.3%
Person 99.1%
Person 99%
Person 97.3%
Person 93.8%
Person 91.2%
Hat 98.2%
Hat 85.5%
Suit 89.8%
Suit 60.1%

Categories

Imagga

people portraits 97.3%
events parties 1.2%

Captions

Microsoft
created by unknown on 2018-05-10

a man wearing a hat 95.4%
a man wearing a suit and hat 95.3%
a man wearing a black hat 93.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-28

a photograph of a man in a suit and hat talking to a man in a suit -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows two men wearing vintage-style suits and hats, standing in front of a shop window. The man on the left is seen from behind wearing a dark suit and hat, while the other man is dressed in a light-colored suit with a dark tie and pocket square. The shop window displays various items, such as coats and suits with visible price tags. Reflections in the glass show more hats, clothing, and blurred figures. The scene evokes a classic or retro setting, possibly from the early to mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts two men dressed in suits and hats, standing on a city street in front of a store window. The man facing away from the camera is wearing a dark suit and a light-colored hat with a dark band. The man on the right, who is partially visible, is dressed in a lighter-colored suit with a tie and a pocket square, and is also wearing a hat. In the background, there is a store window displaying several clothing items with price tags, such as "9" and "6 1/2", suggesting they might be on sale. Reflections in the glass indicate other people and vehicles typical of an urban setting. The appearance and style of clothing suggest the scene is from the early to mid-20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows two men in a street scene. One man is wearing a hat and suit, and the other man is also wearing a hat and suit. They appear to be engaged in a conversation or interaction on the street, which is lined with storefronts and signage in the background. The image has a black and white, vintage aesthetic, suggesting it is from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a black and white photograph from what looks like the 1930s or 1940s. Two men are shown in conversation on a street, both wearing formal attire typical of that era - fedora hats, suits with ties. One man is wearing a dark suit and is shown from behind, while the other is wearing a lighter colored three-piece suit and is shown in profile. They appear to be standing in front of a storefront or shop window. The image has the grainy quality characteristic of period photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two men standing in front of a storefront window. The man on the left has his back to the camera and is wearing a dark suit jacket, white shirt, and a light-colored fedora with a dark band. The man on the right is facing the camera and is wearing a light-colored suit jacket, white shirt, and a light-colored fedora with a dark band. He also has a dark tie and a pocket square in his breast pocket.

In the background, there are various items displayed in the store window, including a sign that reads "TO'S" and a pair of boots. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly in the 1920s or 1930s. The men's clothing and hairstyles are consistent with the fashion of that era, and the style of the photograph itself appears to be from that time period.

The image may have been taken by a professional photographer or amateur photographer who was interested in capturing everyday life in the city. It could also be a personal photograph taken by one of the men themselves, perhaps as a memento or souvenir. Regardless of its origin, the image provides a glimpse into the past and offers insight into the fashion, culture, and daily life of people during that time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of two men in suits and hats, with one man standing in front of a storefront window. The man on the left is wearing a dark suit and a light-colored fedora hat, while the man on the right is dressed in a light-colored suit, white shirt, dark tie, and a dark fedora hat. He has his arms crossed and appears to be engaged in conversation with the other man.

In the background, the storefront window reflects the image of the man in the light-colored suit, as well as other objects and signs that are not clearly visible. The overall atmosphere of the image suggests a scene from the past, possibly from the early 20th century, given the style of clothing and the black-and-white photography.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The black-and-white image captures a moment of interaction between two men in front of a shop. The man on the left, wearing a hat, appears to be engaged in conversation with the man on the right, who is dressed in a suit and tie. The shop behind them has glass windows displaying various items, including a sign that reads "Smith's" and a price tag of "7." The image also shows reflections of people and items inside the shop, adding depth and context to the scene.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows two men standing in front of a store. The man on the right side is wearing a suit with a tie, a hat, and a handkerchief in his pocket. He is looking at the man on the left, who is wearing a hat and a suit. The man on the left is looking down. Behind them are blurry images of people and signs.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Here is a description of the image:

A black and white photograph shows two men in hats standing in front of a store window. The man on the left is only visible from the back. He wears a dark suit jacket, and his hat is dark with a light-colored band. The man on the right faces the camera and wears a light-colored suit with a vest and tie. His hat is similar to the first man's, but the band is dark. The store window behind them has clothes and price tags displayed. Reflections of people and objects can be seen in the glass, adding a sense of depth to the image. The overall impression is of a vintage scene, perhaps from the mid-20th century, capturing a moment in time with its distinctive fashion and street setting.

Created by gemini-2.0-flash-lite on 2025-06-05

This is a black and white photograph of two men in hats. The man in the foreground is turned toward the man in the background, who is also wearing a hat. The man in the foreground is wearing a light-colored suit, a tie, and a fedora. The background shows a shop window with reflections of other people, merchandise, and price tags. The photo appears to be from the mid-20th century, given the clothing and style.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph capturing a street scene, likely from the early to mid-20th century. It features two men standing outside a storefront. The man on the right is facing the camera, wearing a light-colored suit, a tie, and a fedora-style hat. He appears to be engaged in conversation with the other man, whose back is turned to the camera. The second man is also wearing a suit and a hat, and his attire includes a visible name tag that reads "SMITH."

The storefront behind them has a sign that reads "SMITH'S," suggesting it might be a business establishment, possibly a shop or a store. The window display of the store shows various items, and there are price tags visible on some of the products. The overall atmosphere of the image suggests a typical urban setting from a bygone era, with people dressed in the fashion of the time.

Text analysis

Amazon

TH'S
SMITHS
9
A
M
ND
7P
SA TH'S
8 A ND UMA
1
600
8
Behing
UMA
SA