Human Generated Data

Title

Untitled (Marriage Mart, Elkton, Maryland)

Date

1937, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1016

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Marriage Mart, Elkton, Maryland)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1016

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 98.2
Workshop 97.5
Tie 94.6
Accessories 94.6
Accessory 94.6
Person 92.7
Clothing 91.6
Apparel 91.6
Overcoat 86.8
Coat 86.8
Suit 84.7
Building 75.8
People 74.8
Face 66.9
Machine 63.9
Room 59.9
Indoors 59.9
Monitor 59.5
Electronics 59.5
Display 59.5
Screen 59.5
Sleeve 59.1
Tuxedo 57.9
Lab 56.3

Clarifai
created on 2023-10-25

people 99.9
adult 98.8
man 98
group together 97.3
group 96.9
two 95.9
woman 95.9
administration 94.5
one 91.5
several 90.6
five 90.5
room 90.3
typewriter 89.2
indoors 88.6
three 88.2
microphone 87.9
four 87.1
leader 85.7
many 84.9
wireless communication 84

Imagga
created on 2022-01-08

man 33.6
male 29.8
people 28.4
office 27.7
person 27.5
computer 26.7
sitting 24
business 23.7
web site 22.3
businessman 22.1
classroom 22
room 20.9
laptop 20.2
adult 19.9
television 19
newspaper 18.9
senior 16.9
technology 15.6
class 15.4
old 15.3
product 15.3
desk 15.2
education 14.7
men 14.6
looking 14.4
work 14.1
smiling 13.7
student 13.7
telecommunication system 13.6
school 13.3
happy 13.2
building 13
teacher 12.9
indoor 12.8
casual 12.7
monitor 12.5
creation 12.2
professional 12.1
one 11.9
screen 11.8
black 11.4
table 11.2
alone 11
communication 10.9
chair 10.9
lifestyle 10.8
team 10.7
job 10.6
working 10.6
indoors 10.5
executive 10.5
group 10.5
businesspeople 10.4
restaurant 10.3
corporate 10.3
mature 10.2
modern 9.8
cheerful 9.7
together 9.6
elderly 9.6
smile 9.3
face 9.2
horizontal 9.2
businesswoman 9.1
portrait 9.1
to 8.8
teaching 8.8
boy 8.7
studying 8.6
reading 8.5
worker 8.5
college 8.5
board 8.5
two 8.5
keyboard 8.4
manager 8.4
university 8.4
teamwork 8.3
color 8.3
aged 8.1
success 8
women 7.9
seated 7.8
1 7.7
retirement 7.7
diagram 7.7
chart 7.6
finance 7.6
hand 7.6
blackboard 7.2
handsome 7.1
financial 7.1
day 7.1
happiness 7
child 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 100
person 98.1
clothing 92.6
man 91.8
indoor 90.6
black and white 68.9
human face 59.2
posing 36.6
computer 34.7
male 16.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 94.4%
Surprised 1.6%
Sad 1.3%
Confused 0.9%
Angry 0.6%
Happy 0.6%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 99.8%
Surprised 0%
Confused 0%
Angry 0%
Sad 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 64.3%
Sad 21.9%
Disgusted 4.1%
Surprised 2.8%
Fear 2.7%
Confused 1.6%
Angry 1.5%
Happy 1%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 99.4%
Person 98.2%
Person 92.7%
Tie 94.6%
Suit 84.7%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a man and woman standing in a mailbox -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts a scene indoors, likely within an official or administrative setting, such as a clerk's office or service counter. A group of individuals are standing close to a counter, with one person raising their hand, possibly indicating participation in an oath or formal acknowledgment process. A typewriter is visible on the counter along with papers and documents. Behind the counter is a wall of individual storage sections, resembling mailboxes or filing compartments. There is a sign on the wall that reads "W.U. SERVICE" along with smaller text, and handwritten notes appear at the bottom of the photograph, including the mention of "Steinmetz Studio" and "Marriage." The image is dated "March 1937."

Created by gpt-4o-2024-08-06 on 2025-06-16

The image depicts a group of people at what appears to be a counter or service area. One individual's hand is visible, pointing or gesturing toward another person. There is a typewriter on the counter, along with some paperwork and an ink stamp pad. A sign nearby reads "W U SERVICE" indicating a service counter, likely related to Western Union. Behind the group are many small numbered boxes, possibly mailboxes or filing compartments. The floor consists of a stone pattern. There are handwritten notes on the image border, including "RE-SHOOT NEW 62% 65%" and "Steinmetz Studio Marriage Bklyn, N.Y. Mar. 1937."

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of three men in a post office setting. The man on the left, wearing a light-colored suit jacket, is gesturing with his hand as he speaks to the man in the center, who is wearing a white shirt and a light-colored suit jacket. The man on the right, dressed in a dark suit, stands with his arms crossed behind the two men.

In the foreground, a desk with a typewriter and papers is visible, with a hand reaching out from the left side of the frame. A sign on the wall reads "W. U. SERVICE" and "Letters Dear Sir." The background features rows of mailboxes, with a tiled floor and a brick wall.

The overall atmosphere suggests a scene from a film or television show, with the three men engaged in a conversation or discussion. The presence of the typewriter and papers on the desk implies that they may be working on a project or task together. The sign on the wall adds a touch of authenticity to the setting, suggesting that this is a real post office or a film set designed to resemble one.

The image appears to be a still from a movie or TV show, possibly a drama or comedy. The three men are likely characters in the story, and their conversation is likely an important part of the plot. The post office setting provides a neutral backdrop for their discussion, allowing the viewer to focus on the characters and their interactions.

Overall, the image is a captivating and intriguing snapshot of a moment in time, inviting the viewer to wonder what is being discussed and what will happen next in the story.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man and woman standing at a counter, with a man in a suit standing behind them. The man at the counter has short dark hair and is wearing a light-colored suit jacket over a white shirt. He is holding his right hand up, possibly taking an oath or swearing in. The woman next to him has short dark hair and is wearing a checkered dress and a hat. She is looking down at something on the counter.

Behind them stands a man in a dark suit, with his arms crossed. He appears to be observing the scene. The counter has various objects on it, including papers, a typewriter, and a sign that reads "W.U. SERVICE" with smaller text below it.

In the background, there are rows of mailboxes or filing cabinets, suggesting that the scene may be taking place in a post office or government building. The overall atmosphere of the image is formal and serious, with the man and woman appearing to be engaged in some kind of official business.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of a scene inside a building. The photograph is bordered with a white frame. In the photograph, three people are standing in front of a desk. The man on the left is gesturing with his hand. The man in the middle is wearing a hat and a checkered coat. The man on the right is wearing a suit and tie and has his arms crossed. There are several cabinets with labels in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white image shows three people inside what seems to be an office. Two of them are standing, while the other one is sitting behind the desk. The man in the middle is wearing a hat and raising his hand, while the man on the right is wearing a suit and tie. There is a signboard on the left side of the image that reads "W.U. SERVICE."

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a black-and-white photograph featuring three people at a Western Union counter. The scene is somewhat dimly lit, with rows of mailboxes or cubbies filling the background.

In the foreground, a person's arm (presumably a clerk) is visible, holding a pen and appearing to be in the process of writing something. In front of them is a desk area with what appears to be an inkwell, some papers, and other office supplies.

Standing at the counter are two individuals, a man and a woman. The man is wearing a light-colored jacket and raises his hand in what may be a gesture or signal. The woman beside him has short hair and wears a patterned coat with a hat. Standing behind them is another man wearing a suit and tie, with his arms crossed, looking towards the front of the image.

A sign reads "WU SERVICE" and "Lyons Drug Store." There are various notations along the bottom of the image, including the words "RE-SHOOT," "NEW," "62," "65%," and the name "Steinmetz Studio & Marriage MART, Sikton, Mo, 1937"

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression: The image is a black and white photograph from the 1930s. It depicts a scene inside what appears to be a Western Union telegraph office or a similar establishment. There are several people present, suggesting a transaction or event is taking place.

People and Actions:

  • Two people are in the center. A man with his right arm raised, looking towards someone off-camera.
  • A person in a checkered blazer and hat is beside him.
  • A third man is standing in the background with his arms crossed.
  • The hand of a fourth person is seen on the left.
  • The group seems to be at a counter, possibly filling out or reviewing paperwork.

Setting:

  • The interior seems to be an office or service counter, with a dark, polished desk.
  • Behind the people, there are many small compartments or boxes arranged on the wall. They seem to be mailboxes.
  • A sign reading "W U Service" and a listing for "Lyons Drug Store" can be seen.

Composition and Other Details:

  • The photo is well-lit, with a clear focus on the people at the counter.
  • The image includes text labels at the bottom: "RE-SHOOT," "NEW," along with percentages (62% and 65%).
  • There is also a studio stamp reading "Steinmetz Studio" and a note saying "Sikton, Md 1937." This suggests the photo was taken at a studio in Sikton, Maryland, in 1937, potentially marking a marriage.

Possible Interpretation:
The photo likely captures a moment related to a telegram being sent or received. It is possible that the people are getting married or taking care of important details surrounding a marriage.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting three individuals in what appears to be a post office or a mail sorting facility. The background features numerous mailboxes or sorting bins, suggesting a setting related to mail processing.

In the foreground, a man in a light-colored shirt is operating a machine, likely a postmarking or stamping device, as indicated by the mechanical apparatus on the counter. He is engaged in conversation with a young boy standing beside him, who is wearing a cap and a checkered shirt. The boy appears to be observing the man's actions closely.

In the background, another man in a suit and tie is standing and watching the interaction between the man and the boy. He has his arms crossed and seems to be supervising or observing the scene.

A sign on the pole behind the counter reads "W.U. SERVICE, Lynn's Drug Store," which could indicate that the facility handles Western Union services or that it is located in or associated with Lynn's Drug Store.

Additionally, there are handwritten annotations on the bottom of the photograph, which include the words "RE-SHOOT," "NEW," and some numerical codes, possibly related to the photograph's cataloging or processing information.

Overall, the image captures a moment of interaction and instruction within a mail-related setting, highlighting the roles and activities of the individuals present.

Text analysis

Amazon

65%
62
SHOOT
NEW
RE-
1937
SERVICE
MART
Stein
Stein metz
210
metz
W
W U SERVICE
Drug
Md
U
EIKTON, Md
MART .12
EIKTON,
Marriage
Studio
Lyon's Drug Shore
-
Lyon's
.08
.12
.
فحد
Shore
SER

Google

WU SERVICE Lvon's Drag Sre RE- SHOOT 62 65% Stein metz SAudio e Marriage MART EIKTON, Md! 1937 NEW 220
WU
SERVICE
Lvon's
Drag
Sre
RE-
SHOOT
62
65%
Stein
metz
SAudio
e
Marriage
MART
EIKTON,
Md!
1937
NEW
220