Human Generated Data

Title

Untitled (New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3818

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3818

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 100
Sun Hat 96.2
Body Part 94.2
Finger 94.2
Hand 94.2
Archaeology 91.2
Sitting 88.7
Coat 88.7
Photography 88.6
Face 85.9
Head 85.9
Portrait 84
Footwear 83.2
Architecture 57.9
Building 57.9
House 57.9
Housing 57.9
Staircase 57.9
Outdoors 56.1
Cap 55.1
Undershirt 55.1

Clarifai
created on 2018-05-09

people 99.8
adult 98.2
monochrome 97.5
one 97.3
man 95.8
street 95.3
woman 93.8
two 92.7
wear 91.4
child 88
administration 87.5
portrait 87.4
sit 82.4
leader 82.3
group 81.7
veil 80.3
music 78.1
art 77.2
window 77.2
old 74.3

Imagga
created on 2023-10-06

sill 76
structural member 57.2
support 40.5
architecture 34.6
building 28.8
old 27.2
statue 24.5
windowsill 24
device 22.5
stone 22.4
city 20.8
ancient 20.8
history 20.6
sculpture 19.9
religion 18.8
travel 15.5
culture 15.4
house 15.1
monument 15
historical 14.1
tourism 14
column 12.6
religious 12.2
art 12
historic 11.9
window 11.8
landmark 11.7
antique 11.3
temple 11
marble 10.7
wall 10.3
famous 10.2
street 10.1
door 10.1
vintage 9.9
entrance 9.7
structure 9.3
town 9.3
church 9.3
traditional 9.2
classic 8.4
fountain 8.2
monk 8.1
detail 8
urban 7.9
facade 7.8
palace 7.7
grunge 7.7
exterior 7.4
tourist 7.4
dress 7.2
home 7.2
sky 7

Google
created on 2018-05-09

Microsoft
created on 2018-05-09

outdoor 94.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 43-51
Gender Male, 90.7%
Happy 66.4%
Sad 7.3%
Fear 7.2%
Angry 7.2%
Surprised 6.8%
Calm 6.5%
Confused 3.9%
Disgusted 2.9%

Feature analysis

Amazon

Adult
Male
Man
Person
Shoe

Clarifai

Footwear
Clothing
Stairs
Human face
Human leg
Human head
Window
Human arm

AWS Rekognition

Adult 99.5%

AWS Rekognition

Male 99.5%

AWS Rekognition

Man 99.5%

AWS Rekognition

Person 99.5%

AWS Rekognition

Shoe 83.2%

Clarifai

Footwear 87.3%

Clarifai

Footwear 77.8%

Clarifai

Clothing 86.9%

Clarifai

Stairs 86.3%

Clarifai

Human face 59.1%

Clarifai

Human leg 54.9%

Clarifai

Human leg 50.3%

Clarifai

Human head 42.8%

Clarifai

Window 40.7%

Clarifai

Human arm 36.9%

Categories

Imagga
created on 2023-10-06

interior objects 72.3%
streetview architecture 19.7%
paintings art 5.6%
pets animals 1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

a man sitting on the steps of a building

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man sitting on a step up to a set of stairs

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This is a photographic negative of a person sitting on steps outside a doorway. The individual is dressed casually, wearing pants, a jacket, hat, and light-colored shoes. Their posture suggests a moment of contemplation or rest as they hold an object in one hand, possibly interacting with it or examining it. The setting shows architectural details like textured steps, a railing to the side, and a solid door in the background with ornamental paneling. Due to the negative format, dark areas appear light, and light areas appear dark, creating an inverted visual effect.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a photographic negative showing a person sitting on the steps in front of a door. The person is wearing a dark beret and a light-colored button-up shirt. They are seated with elbows resting on their knees and appear to be holding something small in one hand. The stairs are prominently visible, leading up to the door, which features panels and a doorknob. There is a railing on the right side of the stairs. The negative effect causes the colors to appear inverted, with dark areas appearing light and light areas appearing dark.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows an elderly man sitting on the steps of what appears to be an old, ornate building. He is dressed in a white shirt and dark pants, and is wearing a cap. The man appears to be resting or contemplating something, with his hands clasped in front of him. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The black and white image shows an elderly man sitting on the steps of what appears to be an old, ornate building. He is wearing a light-colored shirt, pants, and a cap. The man has his hands clasped together and is looking down, giving the impression of being deep in thought or perhaps tired. The weathered, textured walls and decorative moldings of the building behind him suggest it may be a historic or important structure. The composition and lighting create a contemplative, almost melancholic mood in this candid portrait of the seated gentleman.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph that appears to be historical in nature. It shows someone sitting on what appears to be front steps of a building, wearing light-colored clothing and a cap. They appear to be holding something small in their hands while seated. The steps look to be made of stone or concrete, and there's some ornate architectural detail visible on the building behind them, including decorative molding or paneling. The image has the quality and style typical of early-to-mid 20th century photography. According to the caption, this image is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of a man sitting on the steps of a building. The man is wearing a white shirt, dark pants, and a dark cap. He is sitting on the steps with his legs crossed and his hands resting on his knees. He appears to be holding a cigarette in his right hand.

The building behind him has a large door with a window above it. The door is made of wood and has a decorative design on it. The window is rectangular and has a small pane of glass in the center.

The background of the image is out of focus, but it appears to be a street or sidewalk. There are no other people or objects visible in the image.

Overall, the image suggests that the man is taking a break or resting on the steps of the building. The fact that he is holding a cigarette and has his legs crossed suggests that he may be feeling relaxed or casual.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

This image is a black-and-white photograph of a man sitting on the steps of a building, possibly a house or apartment. The man is wearing a dark-colored hat, a light-colored jacket, dark pants, and light-colored shoes. He is holding a small object in his right hand, which appears to be a cigarette or cigar. The man's face is blurred, making it difficult to discern any facial features.

The background of the image shows the front door of the building, which has a decorative design on it. The door is slightly ajar, and there appears to be a window above it. The overall atmosphere of the image suggests that the man is taking a break or enjoying some quiet time outside.

In the bottom-left corner of the image, there is a copyright notice that reads "© President and Fellows of Harvard College (Harvard University Art Museums)". In the bottom-right corner, there is a number that reads "P1970.3818.0000". This suggests that the image is part of a collection at Harvard University's Art Museums.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The image is a black-and-white photograph of an elderly man sitting on the steps of a building. He is wearing a hat, a long-sleeved shirt, and pants. He is holding a cigarette in his hand and is looking to the left, possibly posing for the photograph. The building behind him has a wooden door with a glass window and a metal railing on the right side. The image has a watermark on the bottom left corner.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The image is a black-and-white photograph of a man sitting on the steps of a door. He is wearing a hat, a white shirt, pants, and shoes. He is holding something in his hand, which might be a cigarette. The man is sitting on the steps of a door, which has a glass window. The door is made of wood and has a decorative design. The photograph is taken from a low angle.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Impression:

The image is a black and white negative of a man sitting on a set of stone steps. The composition is well-framed, with the subject centered and the architectural elements adding to the visual interest.

Subject:

  • A man is the central subject. He's wearing a dark cap, a light-colored shirt and pants. He appears to be holding a pipe or small object in his hand, suggesting a moment of pause or reflection.

Setting:

  • He's seated on steps, which seem to lead up to a doorway. The architecture is somewhat ornate, with visible columns and details around the door frame. There's writing or symbols above the doorway.

Technical Aspects and Visual Qualities:

  • Negative: The image is a negative, meaning that light and dark values are reversed. This gives the image a unique and slightly unsettling quality, with bright areas appearing dark and vice versa.
  • Contrast: There's a strong contrast between light and dark, which helps define the forms and shapes.
  • Composition: The composition uses the steps to create a sense of depth and lead the eye to the subject.

Inferred Narrative:

It feels like a moment of leisure or a contemplative pause. The man is seated, perhaps enjoying a moment of peace, or deep in thought. The setting suggests a historical or culturally significant location.

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

This black and white photograph depicts a man seated on the steps leading up to a door, presumably of a building. The image is presented in a negative format, where lighter areas appear dark and vice versa, which gives it an ethereal, almost ghostly quality.

The man is wearing a cap, long-sleeved shirt, and pants, with what appear to be lace-up shoes. He is holding a small object in his hand, perhaps a pipe or a cigarette, and appears to be in a moment of contemplation or rest.

The setting around him is architectural, with columns flanking the door and inscriptions or designs visible on the building's facade. The steps are layered, leading up to the door, which features rectangular panels.

The overall composition is balanced, with the man positioned centrally and the surrounding architecture providing a framing effect. The inverted colors and the vintage style of the photograph suggest it is an older image, likely taken with film and then inverted.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting an elderly man sitting on the steps of a building. The man is dressed in a white shirt, dark pants, and a hat. He appears to be looking down, possibly at something in his hands, although it's not clear what he is holding. The setting seems to be an urban environment, with the steps leading up to a doorway that has intricate carvings or decorative elements. The photograph has a vintage feel, possibly from the mid-20th century, given the style of clothing and the overall composition. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black and white photograph showing a seated individual. The person is dressed in traditional attire, including a long-sleeved shirt, pants, and a cap, and is seated on the steps of a building with ornate architectural details. The steps appear to lead to a doorway or an entrance, which is also decorated with intricate designs. The person is holding and appears to be examining a small object, possibly a shoe or a similar item, in their hands. The overall setting suggests a historical or cultural context, and the photograph has a vintage appearance, likely from an earlier era. The image is watermarked with a copyright notice for the President and Fellows of Harvard College, indicating it is part of a collection at Harvard University Art Museums.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph captures a scene featuring a man seated on the steps in front of a wooden door. The man is wearing a cap, a light-colored shirt, and trousers, with one leg crossed over the other. He appears to be focused on something in his hands, possibly a small object or tool. The door behind him has decorative elements and a small padlock. The surrounding walls are textured, suggesting a weathered or aged building. The image has a vintage feel, likely due to its monochrome style and the attire of the man. The text at the bottom indicates that the image is from the Harvard University Art Museums collection.

Text analysis

Amazon

College
Art
and
University
of
(Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
Fellows
Museums)
Harvard
President
P1970.3818.0000
RA

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.3818.0000
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.3818.0000