Human Generated Data

Title

Severed Head, New York

Date

1955

People

Artist: William Klein, American 1928 - 2022

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.600

Human Generated Data

Title

Severed Head, New York

People

Artist: William Klein, American 1928 - 2022

Date

1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.600

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 97.5
Apparel 97.5
Human 94.3
Overcoat 93.8
Coat 93.8
Suit 86.2
Door 70.1
Tuxedo 62.5
Machine 55.8
Jacket 55.3
Tire 55

Clarifai
created on 2023-10-25

people 99.5
monochrome 96.4
indoors 95.2
man 94.8
room 94.6
adult 94.2
chair 94
one 93.7
woman 92.9
street 92.6
furniture 91.5
window 91.1
door 90.6
no person 89.5
portrait 88.6
business 86.1
train 85.9
architecture 85.7
art 85.6
doorway 84.6

Imagga
created on 2022-01-08

equipment 27.3
door 27.2
device 25.8
elevator 23.3
server 21.7
furniture 21.5
room 21.1
loudspeaker 20.4
interior 20.3
home 19.9
lifting device 17.9
modern 17.5
telephone 17
call 15.9
house 15.9
architecture 15.6
technology 15.6
design 14.1
box 14
machine 12.7
office 12.6
electrical 12.4
black 12
building 12
open 11.7
3d 11.6
entrance 11.6
light 11.4
metal 11.3
old 11.1
style 11.1
object 11
business 10.9
wood 10.8
apartment 10.5
wall 10.3
phone 10.1
security 10.1
electronic equipment 9.7
station 9.7
indoors 9.7
empty 9.4
industry 9.4
pay-phone 9.4
computer 9.1
exit 8.8
wooden 8.8
safe 8.7
public 8.7
urban 8.7
movable barrier 8.7
electronics 8.5
travel 8.4
communication 8.4
electrical device 8.3
city 8.3
connection 8.2
sliding door 8.2
new 8.1
refrigerator 8.1
transportation 8.1
doorway 7.9
nobody 7.8
car 7.6
storage 7.6
power 7.6
sound 7.5
electronic 7.5
floor 7.4
service 7.4
domestic 7.2
pump 7.1
structure 7
glass 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 97
black and white 96.8
clothing 94.7
person 88.3
man 84.3
street 81.4
black 76.7
white 69.9
monochrome 68.6
footwear 54.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 95.5%
Calm 97.6%
Confused 0.9%
Happy 0.4%
Angry 0.4%
Fear 0.3%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Man
Footwear
Human face
Door

AWS Rekognition

Person 94.3%

AWS Rekognition

Person 91.2%

Clarifai

Man 77%

Clarifai

Man 52.8%

Clarifai

Footwear 73%

Clarifai

Footwear 51.2%

Clarifai

Footwear 43.7%

Clarifai

Footwear 42.4%

Clarifai

Footwear 39.5%

Clarifai

Footwear 38.3%

Clarifai

Footwear 36.5%

Clarifai

Human face 43.8%

Clarifai

Door 40.9%

Clarifai

Door 33.8%

Categories

Imagga
created on 2022-01-08

streetview architecture 48%
interior objects 36.7%
paintings art 14.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

photograph of a man standing in front of a door.

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a suit and tie standing in front of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This black-and-white photograph depicts an urban street corner scene with strong contrasts of light and shadow. The architectural details include geometric shapes on the building facade, and there are shadows cast by the architectural features, creating an interplay of light. To the left, a mounted newspaper or vending machine is visible. Near the bottom, polished chrome water fixtures catch the light distinctly. Another individual wearing a coat is partially seen entering the frame on the right. The image conveys a sense of urban life and uses dramatic lighting to emphasize textures and contrasts.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a black and white photograph depicting a man standing against a building in an urban environment. The man is wearing a long dark coat and a suit, and he is facing forward with his hands in his pockets. The building behind him has a decorative panel, and there is a bright diagonal shadow cast across the scene, suggesting strong sunlight. Part of the scene includes another person walking away, wearing a hat and an overcoat, which adds a sense of motion and context to the urban setting. The overall atmosphere of the image is classic and perhaps reminiscent of mid-20th-century street photography.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to be a black and white photograph depicting a man standing in a doorway or entryway. The man is wearing a suit and hat, and the background features architectural elements with geometric shapes and patterns. The lighting creates dramatic shadows and contrasts, adding to the moody, atmospheric feel of the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a dramatic black and white photograph that appears to be from an earlier era, possibly mid-20th century. The image shows a figure in a dark overcoat standing in what appears to be a doorway or entrance. The composition makes interesting use of light and shadow, with strong contrasts creating a film noir-like atmosphere. The lighting casts dramatic shadows on the floor and walls, and there's an interesting interplay between the architectural elements and the human silhouette. The photograph has a mysterious, perhaps even slightly ominous quality to it, enhanced by the stark contrast and the way the figure is positioned within the frame.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a man standing outside a building, with another man visible in the background.

  • The man in the foreground is positioned to the left of the image, leaning against a wall.
    • He is dressed in a dark suit and tie.
    • His hands are tucked into his pockets.
    • His face is blurred, making it difficult to discern any features.
  • The background of the image features another man standing outside the building.
    • He is positioned to the right of the image, facing away from the camera.
    • He is wearing a light-colored suit and appears to be walking towards the entrance of the building.
  • The building itself is constructed from stone and features a large entranceway.
    • The entranceway is flanked by two columns.
    • A sign is visible above the entranceway, although the text is illegible due to the image's low resolution.

In summary, the image captures a moment of everyday life, with two men standing outside a building, one leaning against the wall and the other walking towards the entrance. The use of black and white photography adds a sense of nostalgia and timelessness to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of two men standing outside a building. The man on the left is leaning against the wall, wearing a dark suit and tie, with his hands in his pockets. He has short hair and is looking to his right. The man on the right is walking away from the camera, wearing a long coat and a hat. He is also wearing dark pants and shoes.

In the background, there is a window with a sign that reads "Cigarettes" and another sign that is illegible. The wall behind the men has a decorative design, and the floor is made of stone or concrete. The overall atmosphere of the image suggests a busy city street during the day, with people going about their daily business.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The black-and-white photograph depicts a man standing in front of a building. He is dressed in a long coat and is leaning against the wall with his arms crossed. His shadow is cast on the wall, and the sunlight is shining on the man. On the left side, there is a glass display case with some items inside. The image has a white border.

Created by amazon.nova-pro-v1:0 on 2025-06-05

A black-and-white photograph features two men standing outside a building. The man on the left is standing on the wall of the building, leaning on it with his right hand, and holding a cigarette in his left hand. The man on the right is wearing a hat and is standing near the entrance of the building. The building has a glass window with a display case and a curtain hanging on the right side.

Google Gemini

Created by gemini-2.0-flash on 2025-05-02

The black and white image shows two men standing outside of a building. One man is leaning against the building, his arms in his pockets, and is looking up. He is wearing a long coat and a tie. The building is made of stone blocks, and there are two small decorative metal objects casting a shadow on the wall behind the man. A water fountain is below the man against the wall.

The second man is standing to the right of the first man, facing away from the camera. He is wearing a long coat and a hat.

The scene is lit by strong sunlight, which casts deep shadows on the building and the men.

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

This is a striking black and white photograph that captures a street scene. The composition is dominated by strong shadows and highlights, creating a dramatic and somewhat melancholic mood. Here's a breakdown:

  • Subject: The primary subject appears to be a man leaning against a building wall. He's dressed in a dark overcoat, his hands in his pockets, suggesting a moment of pause or contemplation. The light creates a halo effect around his head, enhancing the drama.
  • Setting: The photograph appears to be taken on a city street. A building's facade, with distinct architectural details, forms the background. There's a water fountain and what looks like a newspaper stand to the left. A second figure, with a coat and hat, is partly visible, adding another layer to the narrative.
  • Light and Shadow: The most striking element is the play of light and shadow. A strong light source, likely sunlight, casts sharp shadows across the building's facade and the ground. This creates strong contrasts, emphasizing lines and forms and creating a sense of depth. The shadows are particularly important, suggesting a particular time of day.
  • Composition: The photographer has skillfully used the architecture and light to compose the scene. The figures are positioned within the frame to draw the eye, and the stark contrast and geometric shapes add visual interest.

Overall, the photograph has a classic, timeless quality. It evokes the feeling of a moment captured in time, with a sense of quietude, perhaps solitude, and the quiet moments of city life. The use of light and shadow is exceptional, turning a simple street scene into a work of art.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

This black and white photograph depicts a scene with strong contrasts and shadows, creating a dramatic and somewhat mysterious atmosphere. The main subject is a man in a dark suit and tie, standing in a doorway or entrance. He is leaning against the doorframe and appears to be smoking a cigarette. The man's posture and the way he is holding the cigarette suggest a relaxed or contemplative mood.

The lighting in the image is quite stark, with the man partially illuminated by sunlight that casts sharp shadows on the ground and the surrounding structures. The background includes architectural elements such as pillars and possibly a staircase, adding depth to the scene. Another person, seen from behind and dressed in a coat, is walking away from the camera, further into the shadows.

The overall composition, with its play of light and shadow, gives the photograph a film noir quality, evoking a sense of intrigue and timelessness.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

This is a black-and-white photograph that captures a scene in what appears to be a city street. The image is framed as a vertical portrait. The setting includes a doorway or an entrance with a prominent architectural feature, possibly a building or a storefront.

On the left side of the frame, there is a person leaning against the wall, wearing a long coat and what seems to be a hat, with their legs crossed. The individual appears to be in a contemplative or waiting pose. The shadows cast by the structure and the person add depth and contrast to the image.

To the right, another person is partially visible, dressed in a suit, walking away from the camera. The lighting suggests that it is daytime, with sunlight streaming in and creating patterns on the street and the wall.

The photograph has a classic, almost cinematic quality, with its high-contrast black-and-white palette and the interplay of light and shadow. The composition and the subjects suggest a moment frozen in time, likely capturing a candid street scene.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This is a black-and-white photograph capturing a street scene, likely from a mid-20th-century urban setting. The image is framed with strong contrasts of light and shadow, emphasizing a dramatic, moody atmosphere.

  1. Foreground:

    • A man in a dark coat stands in the doorway of a building, leaning slightly against the wall. He has a serious or contemplative expression, and his head is turned to the side, looking out into the street.
    • His shadow is cast prominently on the wall next to him and onto the street, contributing to the high-contrast visual effect.
  2. Background:

    • The street appears to be dimly lit, possibly during the evening or in an area of heavy shadows.
    • Another person, partially visible, walks away in the right foreground, wearing a coat as well. They appear as a silhouette against the light.
    • The background consists of architectural details—rows of windows and a textured wall—further adding depth to the image.
  3. Lighting and Composition:

    • The light source comes from the left, creating sharp contrasts and dynamic shadows.
    • The lines of the building and the shadows cast suggest a strong geometric and almost cinematic quality.

The photograph evokes a sense of mystery or introspection, likely inspired by noir film aesthetics. The man in the doorway could represent a figure lost in thought or waiting, adding intrigue to the scene.