Human Generated Data

Title

Untitled (couple getting married, man raising right hand)

Date

1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4626

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple getting married, man raising right hand)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4626

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.5
Accessories 96.2
Accessory 96.2
Clothing 94.3
Apparel 94.3
Lab 79.9
Machine 74.4
Furniture 73.6
Workshop 69.2
Coat 68.8
Housing 68.5
Building 68.5
Face 67.2
Table 66.5
Text 63.8
Portrait 62.1
Photography 62.1
Photo 62.1
Scientist 57.9
Microscope 56.6

Clarifai
created on 2023-10-15

people 99.7
adult 98.5
man 98.3
group together 97.9
group 97.3
grinder 93.2
two 92.5
three 91.6
indoors 90.4
woman 88.1
monochrome 87.5
room 87.1
five 86.9
several 85.7
vehicle 85.2
wear 84.7
industry 84.5
education 82.1
many 81.4
one 81.4

Imagga
created on 2021-12-14

office 53.7
man 48.4
businessman 43.3
male 42.6
business 38.9
people 36.8
meeting 33
businesspeople 31.3
adult 31
person 30.2
businesswoman 30
computer 29.7
team 29.6
group 29
room 28
work 25.9
working 25.6
professional 24.8
desk 24.8
colleagues 24.3
happy 23.8
indoors 23.7
corporate 23.2
teamwork 22.3
classroom 22
laptop 21.9
men 20.6
job 20.4
executive 20.2
indoor 19.2
casual 18.7
table 18.4
sitting 18
worker 17.8
coworkers 17.7
associates 16.7
20s 16.5
together 15.8
conference 15.6
clinic 15.3
smiling 15.2
looking 15.2
lifestyle 15.2
discussion 13.6
talking 13.3
newspaper 13.2
barbershop 13.1
40s 12.7
women 12.7
modern 12.6
shop 12.4
color 12.2
cheerful 12.2
education 12.1
smile 12.1
manager 12.1
home 12
successful 11.9
communication 11.8
horizontal 11.7
suit 11.7
portrait 11.7
cooperation 11.6
handsome 11.6
busy 11.6
30s 11.5
face 11.4
success 11.3
technology 11.1
employee 11
happiness 11
confident 10.9
attractive 10.5
couple 10.5
career 10.4
nurse 10.3
patient 10.3
company 10.2
document 10.2
product 10.2
lab coat 10.2
hospital 10.1
25 30 years 9.8
businessmen 9.8
conversation 9.7
medical 9.7
employment 9.7
mid adult 9.7
coat 9.6
paper 9.5
females 9.5
day 9.4
student 9.4
doctor 9.4
two 9.3
presentation 9.3
focus 9.3
occupation 9.2
holding 9.1
teacher 8.9
collaboration 8.9
crew 8.9
discussing 8.8
restaurant 8.8
partner 8.7
four 8.6
workplace 8.6
ethnic 8.6
expression 8.5
adults 8.5
learning 8.5
mercantile establishment 8.4
mature 8.4
clothing 8.4
camera 8.3
building 8.3
idea 8
creation 8
boardroom 7.9
engineer 7.9
explaining 7.9
4 7.8
businessperson 7.8
concentration 7.7
partnership 7.7
hand 7.6
plan 7.6
keyboard 7.5
bright 7.2
interior 7.1

Google
created on 2021-12-14

Hat 84.6
Watercraft 79.2
Naval architecture 78.9
Smile 77.1
Monochrome photography 69.8
Art 69.7
Monochrome 69.4
Vintage clothing 68.6
Room 65.7
Machine 65
Engineering 63.5
Boat 63.2
Motor vehicle 62.8
Science 61.6
Font 60.8
History 59.8
Suit 59.6
Door 59.2
Job 56
Paper product 55.5

Microsoft
created on 2021-12-14

text 99.4
person 95.2
clothing 84.8
man 75.6
black and white 74.7
sink 58.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-60
Gender Male, 98.4%
Surprised 52.2%
Calm 33%
Sad 6.6%
Angry 3.9%
Confused 2%
Happy 1.9%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 30-46
Gender Female, 82.3%
Calm 99.5%
Sad 0.3%
Surprised 0.1%
Confused 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 97.3%
Calm 93.2%
Sad 3.2%
Angry 1.9%
Confused 0.7%
Surprised 0.6%
Happy 0.3%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie

Clarifai

No features identified

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 97.5%

AWS Rekognition

Tie 96.2%

Categories

Imagga
created on 2021-12-14

people portraits 53.4%
text visuals 15.2%
interior objects 9.2%
streetview architecture 8.7%
events parties 6.3%
paintings art 3.8%
pets animals 1.4%
food drinks 1.1%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people standing around a sewing machine

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image depicts an interior scene with individuals engaging in a transaction or interaction at a counter. There is office equipment visible on the counter, including what appears to be a mechanical device or scale. The background features rows of numbered compartments or mailboxes, suggesting the location might be a postal or administrative office. A sign on the wall reads “W.U. Service” and references a drug store. The arrangement conveys a professional or service-oriented environment.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image depicts an interior scene where a group of people is standing at a counter. One person is gesturing with their hand towards the individual behind the counter. The background shows a wall filled with numerous postboxes, indicating that the setting is likely a post office or a similar establishment. There is a sign on the wall that says "W.U. SERVICE Call before 9AM Loyola Drug Store." There are various mechanical devices on the counter, suggesting activities related to mail or package processing. The floor is tiled, and the overall atmosphere suggests a formal or business-like environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a scene inside what appears to be a pharmacy or drugstore. There are several people visible, including a man in a white coat who seems to be demonstrating or explaining something to a younger man wearing a checkered jacket. In the background, there are rows of lockers or cabinets, suggesting this is a storage or inventory area. The overall setting suggests a professional, clinical environment, likely related to the medical or pharmaceutical field.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph showing what appears to be a Western Union telegraph service counter. Several people are standing at a counter with telegraph equipment, and there's a sign visible that reads "W.U. SERVICE." Behind the counter, there's a wall filled with what looks like message boxes or filing compartments arranged in a grid pattern. The image appears to be from an earlier era, possibly mid-20th century, based on the clothing styles and office equipment visible. The setup suggests this is a busy telegraph office where messages would be sent and received.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man standing behind a counter, gesturing with his hand, while two people stand in front of him. The man behind the counter has short white hair and wears a dark suit jacket over a black shirt. He stands behind a counter with a cash register and other items on it.

In front of him are a woman wearing a checkered dress and a black hat, and a man in a light-colored suit. The woman and man are both looking at the man behind the counter, who is gesturing with his right hand.

The background of the image shows a wall of mailboxes, with a sign that reads "W. U. SERVICE" and "Lynora Drug Store." The overall atmosphere of the image suggests a scene from a drugstore or pharmacy, possibly during the mid-20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of three individuals standing in front of a counter, with a sign that reads "W.U. SERVICE" and a wall of mailboxes in the background. The scene appears to be set in a post office or similar establishment.

Key Elements:

  • Sign: A sign on the left side of the image reads "W.U. SERVICE" in white letters on a black background.
  • Counter: A counter runs along the bottom of the image, with various objects on it, including a typewriter, a book, and a hand holding a pen.
  • Individuals: Three individuals are standing in front of the counter, all wearing dark-colored clothing. The person on the left is wearing a suit jacket and tie, while the person in the middle is wearing a dress and hat. The person on the right is wearing a suit jacket and tie.
  • Mailboxes: A wall of mailboxes is visible in the background, with each mailbox having a small window and a slot for mail.
  • Floor: The floor is made of tile and has a pattern of squares.

Overall Impression:

The image appears to be a vintage photograph, possibly from the early 20th century. The scene is set in a post office or similar establishment, where people are gathered to send and receive mail. The image conveys a sense of nostalgia and historical significance, providing a glimpse into the past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring four individuals in a room with a tiled wall. On the left side, a person is standing behind a counter, holding a small object and pointing at it. In front of the counter, a woman is standing, wearing a hat and a checkered dress. Next to her, a man is standing, wearing a suit and tie, and he is looking at the woman. Behind them, a man is standing, wearing a white suit and a tie, and he is looking at the man in the suit.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black-and-white photo of three people in a room with a tiled wall. The man on the left is wearing a suit and tie and is holding a machine. The man in the middle is wearing a hat and is looking at the machine. The man on the right is wearing a suit and tie and is standing with his arms crossed. There is a sign on the wall that says "W.U. Service."

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here's a description of the image:

This appears to be an inverted black and white photograph taken indoors, likely in a pharmacy or similar business setting. The scene is centered around a service counter with various pieces of equipment, including what looks like a drug compounding scale and containers. A pair of hands wearing a light-colored sleeve seems to be in the process of using this equipment.

Behind the counter, there are three people. A man stands to the left with his arm raised, as if gesturing. Next to him is another person wearing a checkered shirt and a cap, looking towards the equipment. The third person, a man dressed in a light-colored suit, stands with his arms crossed in the background.

Behind the people, there is a wall with numerous mailboxes or storage compartments. A sign reads "WU Service - Call Station at Lyon's Drug Store" suggesting a Western Union service located in the drug store. The overall style of the image and clothing worn by the people suggest it was taken in the mid-20th century, possibly the 1930s or 1940s. The "inverted" nature of the photo (where light areas appear dark and vice-versa) makes details less clear.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image appears to be a vintage photograph, likely from the early to mid-20th century. It's a shot of a business or service, possibly a telegraph office or a similar type of operation.

Key Elements:

  • People: There are four people in the frame. One person is working at a counter, their hands near what appears to be a machine of some kind. Another person, standing behind the counter, appears to be gesturing, possibly directing something. A third person stands beside them, and the fourth stands in the background.
  • Setting: The setting seems to be an interior space. The background features a wall with numerous small, identical compartments or cubbies, possibly for messages or documents. There's a counter with what appears to be some kind of equipment.
  • Equipment: The machinery on the counter could be used to transmit messages or perform some form of business transaction, though it's unclear from this angle what the exact functions are.
  • Signage: There's a sign in the upper-left corner that reads "W.U. SERVICE".

Style: The black-and-white photography, and the clothing styles of the people, indicate the photograph's vintage. The image is slightly grainy.

Possible Context:

The photograph is likely capturing a moment in a Western Union telegraph office or a similar communications hub. The workers are likely processing messages or conducting business.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The black-and-white photograph depicts a scene inside what appears to be a post office or similar establishment, as indicated by the numerous mailboxes in the background. The image features three individuals.

  1. Foreground:

    • A man wearing a plaid shirt and a headband is standing at a counter. He is holding a pipe in his mouth and seems to be engaged in conversation with another man.
    • The counter has various items on it, including what looks like a scale and some other tools or equipment, possibly used for weighing or sorting mail.
  2. Center:

    • An older man with white hair is behind the counter, facing the man with the headband. He is wearing a jacket and appears to be explaining something, as he is gesturing with his hand.
  3. Background:

    • Another man, dressed in a white uniform, stands slightly behind the older man. He has his arms crossed and is observing the interaction between the two men at the counter.

The photograph captures a moment of interaction between the individuals, possibly related to postal services or some form of transaction. The setting and attire of the individuals suggest a time period from the mid-20th century.

Qwen

Text analysis

Amazon

Lyon's
SERVICE
W
Stone
W U SERVICE
Lyon's Druo Stone
Oil
U
Druo
JCHU
JCHU 830N3330
830N3330
an

Google

SCRU Y RA2 830M3330
SCRU
Y
RA2
830M3330