Human Generated Data

Title

Untitled (man standing with a woman and holding two knives)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8457

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man standing with a woman and holding two knives)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8457

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99
Interior Design 94.1
Indoors 94.1
Home Decor 91.4
Furniture 88
Priest 74.9
Room 64.6
Bishop 63.4
Clothing 60.3
Apparel 60.3
People 59.8
Chair 56.3
Living Room 56.3
Couch 55.2

Clarifai
created on 2023-10-26

people 99.6
man 97.4
adult 97
two 96.4
one 92.2
monochrome 92
leader 91.6
group 91.2
three 90.7
wear 89.1
furniture 86.2
indoors 85.6
administration 85.4
woman 85.1
ceremony 84.9
veil 82.7
wedding 81.6
religion 81.4
elderly 80.7
outfit 78.3

Imagga
created on 2022-01-15

metropolitan 53
shop 23.1
people 20.6
barbershop 18.9
man 18.8
building 14.8
mercantile establishment 13.9
old 13.9
male 13.5
architecture 13.3
adult 13.2
window 13
men 12.9
person 12.6
history 12.5
door 12.4
indoors 12.3
business 12.1
church 12
religion 11.6
city 11.6
interior 11.5
fashion 11.3
love 11
clothing 10.3
room 10.2
inside 10.1
modern 9.8
work 9.5
office 9.5
women 9.5
place of business 9.3
street 9.2
life 9.1
outdoors 9
businessman 8.8
home 8.8
urban 8.7
sitting 8.6
black 8.5
house 8.3
suit 8.2
happy 8.1
dress 8.1
chair 8
couple 7.8
entrance 7.7
two 7.6
hand 7.6
light 7.3
historic 7.3
group 7.2
art 7.2
portrait 7.1

Google
created on 2022-01-15

Picture frame 91.8
Mirror 91.3
Coat 89.4
Style 83.9
Suit 80.3
Snapshot 74.3
Monochrome photography 73.7
Monochrome 72.3
Vintage clothing 72
Room 71.1
Curtain 67.7
Event 67.5
Classic 65.9
Stock photography 65.6
History 57.6
Holy places 54.5
Font 54.4
Pattern 53.7
Rectangle 52.3
Art 52.3

Microsoft
created on 2022-01-15

text 96.2
clothing 82.3
person 75.5
white 74.1
curtain 64.1
black and white 56.9
furniture 53.3
altar 23.2

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Clothing
Mirror
Human face
Human hair

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.1%

Clarifai

Clothing 78.1%

Clarifai

Clothing 63.4%

Clarifai

Clothing 56.4%

Clarifai

Mirror 44.8%

Clarifai

Human face 44%

Clarifai

Human face 43.6%

Clarifai

Human hair 43.3%

Categories

Imagga
created on 2022-01-15

streetview architecture 76.7%
interior objects 17.4%
paintings art 4.8%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of monarch and noble person.

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man and woman in formal attire standing in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image presents a classic interior space featuring ornate furnishings and décor. A large, elaborately framed oval mirror hangs above a fireplace, surrounded by candlesticks and decorative accents. The striped wallpaper adds a formal touch to the room. Additionally, there is an upholstered armchair with a patterned texture placed in the foreground. Other elements include a lamp and furniture pieces arranged to complement the elegant aesthetic of the room.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a black and white photograph that appears to be in negative. It depicts two people standing in a room with classic interior decor. The room features a large, ornate mirror with an elaborate frame hung on a wall with vertical stripes. Below the mirror, there is a mantel adorned with several tall candlesticks and crystal ornaments. A large upholstered armchair with a tufted backrest is positioned in the foreground. To the right, there is a lamp with a cylindrical base and a rectangular window allowing light into the room. The overall setting suggests a formal or elegant environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows an interior scene with a large ornate mirror on the wall. In front of the mirror, there are two people, an older man and an older woman, who appear to be conversing. The room is decorated with various ornamental objects, including candelabras and other decorative items. The overall atmosphere suggests a formal, elegant setting, perhaps a living room or parlor in a historic building.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a black and white photograph from what seems to be an elegant interior setting, likely from an earlier era. The room features ornate decorative elements including a large decorative oval mirror with an elaborate frame and crystal candelabras. There are striped wallpaper or wall coverings visible. In the scene, two people are interacting - one appears to be wearing a dark suit while the other is dressed in light-colored clothing that includes what appears to be a cape or flowing outer garment. There's also a upholstered chair with a decorative fabric pattern visible in the foreground. The setting suggests this might be in an upscale home or establishment, possibly from the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a man and woman in a room with a mirror, lamp, and chair.

  • The man stands on the left side of the image, facing the woman. He has short white hair and wears a dark-colored suit with a light-colored shirt and pants. His hands are clasped together in front of him.
  • The woman stands on the right side of the image, facing the man. She has short white hair and wears a dark-colored dress with a white shawl draped over her shoulders. Her hands are at her sides.
  • Behind the man is a large ornate mirror with a decorative frame. To the left of the mirror is a dark-colored dresser or sideboard with several decorative items on top, including a lamp, a vase, and a picture frame.
  • In the center of the image, behind the woman, is a dark-colored armchair with a floral pattern. To the right of the chair is a tall lamp with a white shade and a decorative base.
  • The background of the image is a wall with vertical stripes, possibly made of wood or wallpaper. There is a doorway to the right of the image, and a window or other opening to the left.

The overall atmosphere of the image suggests a formal or elegant setting, possibly a living room or parlor. The man and woman appear to be engaged in conversation, and the decorative items in the room suggest a sense of luxury and sophistication.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a man and woman in a room with a fireplace. The man, positioned on the left side of the image, is dressed in a suit and tie, while the woman, situated on the right side, wears a dress and a shawl.

The room features a fireplace with a mirror above it, accompanied by various decorative items on the mantle. A chair is placed in front of the fireplace, and the walls are adorned with vertical stripes. The overall atmosphere of the image suggests that it may be a formal portrait or a scene from a play or film.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of two women standing in a room with a fireplace. The room has striped wallpaper and a mirror on the wall. The woman on the left is holding a small object and looking at the woman on the right, who is wearing a white coat and has her hands on her hips. There is a chair with a floral pattern in the foreground, and a lamp with a decorative shade is on the right side of the image. The image has a watermark in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-06

A black-and-white photo of two people standing in front of a fireplace. The man is wearing a suit, and the woman is wearing a white coat. They are both smiling, and the man is holding something. The fireplace has a mirror on top and a shelf with a lamp and candles. There is a chair with a pillow on it. On the right side, there is a person wearing a white coat.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

Overall Impression:

The image is a black and white negative of a photograph, depicting a scene inside a well-decorated room. The style and the subjects suggest the image is from an earlier era, perhaps the mid-20th century.

Key Elements:

  • People: There are at least three people in the scene. A man in a suit is standing, appearing to be holding something and speaking to a woman with a headscarf and a gown. Another figure is visible through an open door.
  • Interior Decor: The room has an elegant feel. Notable features include:
    • Striped wallpaper.
    • A decorative fireplace, with a large oval mirror above it, decorated with an ornate carved frame.
    • A lamp.
    • Candle holders or decorative objects on the mantelpiece.
    • A floral-patterned armchair.
  • Composition: The photograph seems to be staged, with the figures posed in the room. The perspective and composition create a sense of depth.

General Notes:

The quality of the photograph suggests a professional setting and possibly a planned portrait. The negative format is evident, and the image's clarity makes it a significant document from a specific period.

Created by gemini-2.0-flash on 2025-05-02

The image is a black and white photograph of three people standing in an ornately decorated room. The photo appears to be a negative.

The room features striped wallpaper with a decorative floral pattern on one part of the wall. A large, ornate mirror hangs above a fireplace, which is flanked by tall candle holders.

A man in a suit stands to the left, holding an object in his hands. A woman stands to the right, wearing a light-colored dress and a shawl. A third person, possibly another man, is partially visible in a doorway on the right. An armchair is placed in front of the fireplace.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting two individuals in a room that appears to be part of a set, possibly for a film or a theatrical production. The setting is elaborately decorated, featuring ornate furniture and decorative items.

  1. Background and Setting:

    • The room has striped wallpaper with a vertical pattern.
    • There is a large, ornate mirror with a decorative frame mounted on the wall.
    • Several decorative items, including crystal candle holders, are placed on a table beneath the mirror.
    • A lamp with a decorative shade is visible to the right.
    • An armchair with a floral pattern is in the foreground.
  2. Individuals:

    • The person on the left is dressed in a suit and appears to be holding a telephone receiver to their ear.
    • The person on the right is dressed in a white garment with a darker garment underneath, possibly a robe or a coat. They are wearing large earrings and appear to be engaged in conversation with the individual on the left.
  3. Lighting and Atmosphere:

    • The lighting is soft, creating a dramatic effect typical of classic films or stage productions.
    • The overall atmosphere suggests a scene from a period piece, possibly set in an earlier era given the style of clothing and decor.

The photograph captures a moment of interaction between the two individuals, with the setting and attire contributing to a sense of elegance and formality.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image depicts a formal indoor setting, likely from a historical period, given the style of clothing and decor. Two individuals are the focus of the photograph. The person on the left, who seems to be a man, is holding a small object, possibly a watch or a similar item, and is presenting it to the woman on the right. The woman, who appears to be seated, is dressed in a formal outfit with a white shawl or wrap-like garment draped over her shoulders and a darker dress underneath. She is seated on an ornate, upholstered chair with a floral pattern.

The background features elegant decorative elements, including an ornate mirror with a decorative frame, a striped wallpaper with black and white vertical stripes, and a dark wooden cabinet or mantle that holds various objects, including what seem to be decorative vases or urns. To the right, there is a floor lamp with a design that includes a lyre, a symbol often associated with music. The setting suggests a refined and possibly historic indoor environment, potentially a home or a formal gathering place. The overall tone of the photograph is formal and dignified.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

The black-and-white image depicts an elegantly dressed couple in a luxurious room. The man, wearing a suit, is holding a small object, possibly a ring or a piece of jewelry, and appears to be showing it to the woman. The woman is seated on an ornate armchair, wearing a light-colored dress and a fur stole. The room is decorated with striped wallpaper and features a decorative mirror on a console table adorned with intricate candelabras. The atmosphere suggests a sophisticated and possibly formal occasion.

Text analysis

Amazon

s
1449
14493.
s John
1449 KA
KA
Е6hhi
John

Google

449A ON-YT37A2- MAMT2A3
449A
ON-YT37A2-
MAMT2A3