Human Generated Data

Title

Untitled (man and woman in day clothes descending small staircase in fancy building)

Date

1948-1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9293

Human Generated Data

Title

Untitled (man and woman in day clothes descending small staircase in fancy building)

People

Artist: Martin Schweig, American 20th century

Date

1948-1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9293

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 96.3
Apparel 96.3
Person 96.1
Human 96.1
Person 94.9
Person 94.5
Person 94.2
Person 91.8
Handrail 81.5
Banister 81.5
Overcoat 76.3
Coat 76.3
Suit 70.1
Tie 64.6
Accessories 64.6
Accessory 64.6
Staircase 60.6
Sleeve 55.3

Clarifai
created on 2023-10-26

people 99.8
monochrome 97.9
adult 97.4
step 97
woman 97
group 96.8
two 96.7
man 95.9
administration 95.9
indoors 94
room 92.8
leader 92.8
three 91.9
furniture 90.5
wear 87.6
home 85.9
group together 85.1
one 84.5
four 83.5
several 83.4

Imagga
created on 2022-01-23

business 35.8
male 33.3
businessman 32.7
man 32.2
office 32.2
people 30.7
corporate 29.2
adult 26.5
person 25
suit 22.3
professional 21.7
musical instrument 19.6
executive 19.3
building 19
men 18.9
wind instrument 18.1
meeting 17
happy 16.9
businesswoman 16.4
room 16.3
group 16.1
indoor 15.5
looking 15.2
job 15
women 15
brass 15
indoors 14.9
work 14.1
modern 14
life 13.8
handsome 13.4
businesspeople 13.3
desk 13.2
worker 12.7
attractive 12.6
team 12.5
manager 12.1
mature 12.1
success 12.1
black 11.5
smile 11.4
career 11.4
standing 11.3
education 11.3
pretty 11.2
sitting 11.2
laptop 11
portrait 11
classroom 11
confident 10.9
couple 10.5
teamwork 10.2
day 10.2
casual 10.2
two 10.2
communication 10.1
successful 10.1
employee 9.9
outfit 9.8
fashion 9.8
colleagues 9.7
boss 9.6
table 9.5
tie 9.5
sax 9.3
teacher 9.2
occupation 9.2
holding 9.1
cheerful 8.9
computer 8.9
40s 8.8
hall 8.7
smiling 8.7
corporation 8.7
diversity 8.6
chair 8.6
happiness 8.6
adults 8.5
senior 8.4
company 8.4
device 8.2
architecture 8.1
interior 8
lifestyle 7.9
urban 7.9
businessperson 7.8
speaker 7.8
confidence 7.7
formal 7.6
finance 7.6
thinking 7.6
inside 7.4
student 7.3
alone 7.3
color 7.2
face 7.1
working 7.1
travel 7
together 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

man 94.6
clothing 93.8
black and white 92.6
person 91.1
text 80.2
monochrome 58.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 84.2%
Surprised 13.5%
Happy 0.8%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 95.1%
Calm 60.6%
Sad 11.5%
Disgusted 7.5%
Happy 7.1%
Surprised 6.9%
Confused 4.2%
Angry 1.2%
Fear 0.9%

AWS Rekognition

Age 25-35
Gender Female, 93.1%
Calm 52%
Sad 24.8%
Fear 10.9%
Confused 7.4%
Happy 1.8%
Angry 1.7%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Male, 96%
Fear 98.2%
Sad 0.6%
Disgusted 0.5%
Calm 0.3%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Tie
Person 96.1%
Person 94.9%
Person 94.5%
Person 94.2%
Person 91.8%
Suit 70.1%
Tie 64.6%

Categories

Captions

Microsoft
created by unknown on 2022-01-23

a man standing in front of a door 81.6%
a man standing next to a door 76.5%
a man standing in a room 76.4%

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man and woman walking down stairs in a building -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows two individuals descending a staircase in what appears to be a formal or public setting. The person on the left is dressed in a stylish outfit with a textured jacket, a dark skirt or dress, and white heeled shoes, while carrying a small handbag. The person on the right is wearing a long double-breasted coat with a patterned tie and white shoes, and is holding a suitcase. The staircase has a railing, and there is signage in the lower portion of the image indicating different room names, such as "Tap Room," "Marine Room," "Mandarin Room," "Walnut Room," and "Versailles Room." The background includes modern architectural elements, and there are people visible in white clothing further up near the entrance.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a black and white film negative, showing a man and a woman descending a flight of stairs. The woman is wearing a mid-length dress with a long coat and a matching hat. The man is dressed in a double-breasted suit, carrying a suitcase and a cane. Behind them, several people are visible at the top of the stairs, dressed in white, possibly uniforms. In the background, there's a large painting on the wall next to the staircase. A directional sign indicating locations such as the "TAP ROOM," "MARINE ROOM," "MANDARIN ROOM," "WALNUT ROOM," and "VERSAILLES ROOM" is affixed to a surface on the right side. The photograph appears to capture a scene from an indoor location, possibly a hotel or convention center.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image appears to be a black and white photograph depicting two men standing on a set of stairs in what seems to be a hotel or building lobby. The men are dressed in formal attire, with one wearing a coat and the other wearing a suit. Behind them, there are signs indicating different rooms or floors, such as "Marine Room" and "Versailles Room". The overall scene suggests a formal or professional setting, possibly related to travel or hospitality.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The black and white image shows two well-dressed men standing on a staircase or walkway inside what appears to be a large building or ship. They are both wearing suits, ties, and hats typical of an earlier era, likely the early to mid 20th century based on their attire and the surroundings.

Behind them, an older couple can be seen standing at the top of the stairs. The interior has an industrial or nautical feel, with metal railings and what looks like portholes or round windows along the wall.

Signs are visible indicating various rooms like the "First Floor", "Bar Room", "Marine Room", "Versailles Room", and a "Pull" sign that may be for an emergency alarm. The overall scene has a formal, posed quality as if the men are being photographed on the staircase of an important building or ocean liner from that time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a black and white photograph showing an interior staircase, likely from a hotel or upscale establishment. There's a directional sign visible that points to various rooms including "Marine Room," "Mandarin Room," and "Versailles Room." Two figures are standing on the stairs wearing what appears to be formal attire. The architecture has an Art Deco or modernist style, with clean lines and metal railings. The image has a distinct vintage quality and was likely taken sometime in the mid-20th century.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-30

The image depicts a black-and-white photograph of a man and woman descending a staircase, with the man holding a suitcase. The woman is dressed in a dark dress, white jacket, and heels, while the man wears a suit and tie. A sign on the right side of the image indicates the location of various rooms, including the "First Floor," "Tap Room," "Marine Room," "Mandarin Room," "Walnut Room," and "Versailles Room." In the background, other individuals are visible, although their features are not clearly defined due to the image's monochromatic tone. The overall atmosphere suggests a formal or professional setting, possibly a hotel or office building.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-30

The image depicts a black-and-white photograph of a man and woman descending a staircase in a hotel lobby.

The woman, positioned on the left, wears a dark dress with a white lace jacket and carries a suitcase in her right hand. Her hair is styled in an updo, and she has a scarf around her neck. The man, standing on the right, is dressed in a light-colored suit, dark shirt, and tie, and holds a suitcase in his left hand. Both individuals are descending the stairs, which feature a railing on the left side.

In the background, a sign on the right side of the stairs indicates the location of various rooms, including the "First Floor," "Tap Room," "Marine Room," "Mandarin Room," "Walnut Room," and "Versailles Room." Above the sign, a glass railing encloses a balcony, where two people in white robes are visible. The overall atmosphere of the image suggests that the couple is arriving at or departing from the hotel.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The black-and-white image features a couple in formal attire descending a staircase. The man is wearing a suit and tie, and the woman is dressed in a dress and carrying a handbag. They both have suitcases. The staircase has a metal handrail, and a signboard is mounted on the wall next to it, indicating directions to various rooms. Behind the couple, there are two other people in white coats standing on a balcony. The image has a vintage filter and a watermark in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The black-and-white image shows a man and a woman descending a staircase. The woman is dressed in a white jacket, black dress, and high heels. She is holding a handbag in her right hand. The man is wearing a suit, tie, and sneakers. He is carrying a handbag and a suitcase. The staircase has a metal handrail and a signboard with the text "First Floor."

Google Gemini

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

This grayscale, high-contrast image captures two people descending a staircase in what appears to be a public building or venue.

On the left side of the frame, a woman is walking down the steps while holding onto the metal railing. She is wearing a dress with a jacket, adorned with a brooch, and she is carrying a small, boxy suitcase. On the right of her, a man in a suit and tie carries a briefcase as he also descends the stairs.

Behind them, atop the stairs, are three figures standing behind a railing. Their attire resembles uniforms.

A sign next to the staircase indicates the first floor and directs to various rooms, including the Tap Room, Marine Room, Mandarin Room, Walnut Room, and Versailles Room. A framed image of a body of water and buildings hangs above them on the wall. The image has high contrast, which gives it a vintage or documentary feel.

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Impression:

The image appears to be a black and white negative of a photograph, likely taken in the mid-20th century. It shows a couple descending a staircase inside a building, with other individuals visible in the background. The image has a vintage feel due to its composition and the clothing styles of the subjects.

Foreground:

  • Couple: A man and a woman are the primary subjects. They are both dressed in formal attire and appear to be arriving somewhere. The man is wearing a suit and tie, carrying a briefcase. The woman has a dress on with a blazer. The woman is holding a purse and also has flowers on her blazer. The couple are both smiling.
  • Staircase: The couple is descending a staircase with metal railings. The stairs are clean, and the environment looks to be in good condition.

Background:

  • Other Individuals: Several people can be seen on a balcony or landing above the couple, near the top of a different staircase. They are wearing what looks like white lab coats, suggesting a professional or institutional setting.
  • Signage: A sign indicates the "First Floor" and lists various rooms, including "Tap Room," "Marine Room," "Mandarin Room," "Walnut Room," and "Versailles Room." This implies the location might be a hotel, restaurant, or entertainment venue.
  • Decorative Element: There is an artistic painting, most likely a mural, hanging on the wall.

Style and Composition:

  • The composition is balanced, with the couple as the main focus.
  • The use of the negative image creates a distinctive look.
  • The photograph has a sense of formality, possibly capturing a special occasion or event.

Overall, the image has a classic and somewhat nostalgic feel, suggesting a moment captured from the past.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring two individuals descending a staircase. The setting appears to be an interior space, possibly a hotel or a similar establishment, given the presence of directional signs and the decor.

  • People:

    • The person on the left is a woman dressed in a dark outfit, wearing a light-colored, textured coat and a hat. She is carrying a handbag.
    • The person on the right is a man dressed in a long coat and a tie. He is holding a suitcase in his left hand.
  • Staircase and Signage:

    • The staircase they are descending has metal railings on both sides.
    • There is a directional sign on the wall to the right of the staircase, listing various rooms on the first floor: Tap Room, Marine Room, Mandarin Room, Walnut Room, and Versailles Room.
  • Background:

    • Behind the individuals, there is a wall with a piece of artwork or a painting.
    • There are other people visible in the background, standing near a railing on an upper level, suggesting that the staircase leads to multiple floors.
  • General Atmosphere:

    • The overall atmosphere suggests a formal or semi-formal setting, possibly from a mid-20th-century time period, given the style of clothing and the black-and-white nature of the photograph.

The image captures a moment of transition, with the two main subjects moving from one floor to another, possibly indicating arrival or departure.

Text analysis

Amazon

MANDARIN
ROOM
WALNUT
FIRST
WALNUT ROOM
FIRST FLOOR
VERSAILLES ROOM
TAP
TAP ROOM
FLOOR
VERSAILLES
MARINE
PULL
MANDARIN ROOM 1
1

Google

MARINE ROOM ROOM
MARINE
ROOM