Human Generated Data

Title

Untitled (piano player and crowd at bottom of stairs)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4535

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (piano player and crowd at bottom of stairs)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4535

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 99.2
Person 99.1
Clinic 98.5
Person 97.8
Person 97.5
Person 97.1
Person 94.3
Hospital 93.4
Operating Theatre 87.4
Person 84.9
Person 73.4
Doctor 72.3
Person 69.1
Person 66.2
People 57.4
Clothing 56.5
Apparel 56.5

Clarifai
created on 2023-10-26

people 99.5
group 98.9
man 98.6
adult 98.6
woman 97.9
medical practitioner 96.9
monochrome 94.8
healthcare 94.1
outerwear 89.7
uniform 89.5
hospital 89.3
indoors 85.2
coat 83.5
group together 81.5
doctor 80.9
medicine 80.9
many 79.9
education 77.9
scientist 77.8
science 74.7

Imagga
created on 2022-01-23

man 49.8
businessman 46.9
male 42.6
person 41.3
professional 41.1
adult 41.1
business 40.1
lab coat 38.7
specialist 38.3
office 37.9
meeting 37.7
people 37.4
team 36.8
colleagues 35
businesswoman 34.6
businesspeople 34.2
coat 33.6
executive 33.6
work 31.4
group 29.9
teamwork 28.8
desk 28.4
working 28.3
worker 27.8
happy 27.6
corporate 27.5
groom 25.1
patient 24.9
smiling 24.6
table 24.3
laptop 23.7
computer 23.3
sitting 23.2
indoors 22
indoor 21.9
room 21.1
talking 20
nurse 19.9
job 19.5
suit 18.9
associates 18.7
casual 18.7
teacher 18.5
confident 18.2
men 18.1
together 17.5
women 17.4
clothing 16.8
medical 16.8
coworkers 16.7
conference 16.6
portrait 16.2
doctor 16
communication 16
smile 15.7
modern 15.4
garment 15.3
looking 15.2
manager 14.9
20s 14.7
successful 14.7
cooperation 14.5
30s 14.5
explaining 13.8
hospital 13.8
success 13.7
practitioner 13.7
40s 13.6
face 13.5
boss 13.4
handsome 13.4
formal 13.4
couple 13.1
presentation 13
mature 13
discussion 12.7
health 12.5
staff 12.5
ethnic 12.4
color 12.3
educator 12
employee 11.9
horizontal 11.7
mid adult 11.6
lifestyle 11.6
workplace 11.4
education 11.3
home 11.2
occupation 11
boardroom 10.9
discussing 10.8
leader 10.6
cheerful 10.6
four 10.6
attractive 10.5
technology 10.4
senior 10.3
company 10.2
sick person 10.1
case 9.9
clinic 9.9
care 9.9
crew 9.9
30 35 years 9.8
businessmen 9.8
planning 9.6
standing 9.6
career 9.5
two 9.3
bright 9.3
hand 9.1
collaboration 8.9
25 30 years 8.8
medicine 8.8
colleague 8.8
businessperson 8.8
employment 8.7
corporation 8.7
busy 8.7
student 8.5
treatment 8.3
hall 8
businesswomen 7.9
happiness 7.8
diverse 7.8
partners 7.8
project 7.7
diversity 7.7
collar 7.7
finance 7.6
multi 7.6
plan 7.6
training 7.4
life 7.1
to 7.1
day 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 97.6
text 97.1
clothing 89.5
man 79.3
posing 63.7
group 59
black and white 58
wedding dress 57.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 99.8%
Sad 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 98.7%
Surprised 0.5%
Sad 0.3%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 56.2%
Surprised 64.3%
Calm 32.1%
Confused 0.9%
Sad 0.8%
Happy 0.7%
Disgusted 0.7%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 27-37
Gender Male, 96.9%
Calm 96.8%
Happy 1.3%
Sad 0.9%
Confused 0.4%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 95.1%
Sad 56.5%
Calm 27.7%
Confused 8.5%
Surprised 3.6%
Disgusted 1.1%
Angry 1.1%
Happy 0.8%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Feature analysis

Amazon

Person
Person 99.4%
Person 99.2%
Person 99.1%
Person 97.8%
Person 97.5%
Person 97.1%
Person 94.3%
Person 84.9%
Person 73.4%
Person 69.1%
Person 66.2%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people in white uniforms and hats -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image appears to be a negative of a photograph, featuring a group of people dressed in formal attire, including suits, hats, and dresses with elaborate accessories such as fur stoles and brooches. The setting is indoors, with a staircase visible in the background along with a wall-mounted candle-style light fixture. Some individuals are holding documents or objects, suggesting an organized event or gathering. The overall composition suggests a social or ceremonial occasion from an earlier era.

Created by gpt-4o-2024-08-06 on 2025-06-13

This image is a black-and-white negative depicting a group of people dressed in formal attire. The scene appears to be set indoors, with individuals congregating near a staircase. The attire suggests a formal or semi-formal event, featuring suits and elegant dresses or gowns complemented by accessories like hats and ties. Several individuals are holding books or papers. A decorative light fixture is visible on the right side of the image, attached to the wall. The image is marked at the top and bottom with the number "13542."

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to depict a group of people dressed in formal attire, likely attending some kind of ceremonial or religious event. The individuals are wearing white robes, hats, and other ceremonial garments, and seem to be gathered in a formal setting. Some are holding books or other items, suggesting this may be a religious or formal gathering of some kind. The image has a black and white, vintage aesthetic, indicating it is likely an older photograph.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The black and white photograph shows a large group of African American men and women, likely at a church service or gathering. They are all dressed formally in white robes or dresses and dark suits. Many of the women are wearing decorative hats or head coverings. The group appears to be singing or reciting something together, as many have their mouths open and some are holding papers or books. The image captures a moment of community and shared spiritual experience among this congregation.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a historical black and white photograph showing several people dressed in white formal attire. The image appears to be taken at what could be a church or formal gathering space, with stairs visible in the background. The subjects are wearing white jackets or formal wear, and some appear to be holding or looking at books or documents, suggesting this might be a choir, religious ceremony, or formal event. The photograph has a number "13542" visible at the top and bottom, indicating it may be from an archive or collection. The lighting and photographic style suggests this is from an earlier era, possibly mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a group of people gathered around a piano. The group consists of approximately 15 individuals, all dressed in formal attire, with the majority being women wearing dresses and hats, while the men wear suits and bow ties. They are positioned around a grand piano, which is the central focus of the image.

In the foreground, a man with short white hair is seated at the piano, wearing a white suit jacket, black shirt, and bow tie. He appears to be playing the piano, although the image is not clear enough to determine this with certainty. To his left, a woman stands with her back to the camera, wearing a white dress and hat, while to his right, another woman stands facing the camera, also wearing a white dress and hat.

The background of the image features a staircase and a doorway, which suggests that the scene is taking place in a church or other formal setting. The overall atmosphere of the image is one of elegance and sophistication, with the group of people gathered around the piano creating a sense of community and shared experience.

The image appears to be a historical photograph, possibly taken in the early 20th century, given the style of clothing and the formal setting. The image has been scanned and digitized, with a white border around the edges and a series of numbers and letters printed along the top and bottom edges. The numbers "13542" are printed in the top-left corner, while the letters "EASTMAN SAFETY KODAK" are printed vertically along the right edge of the image.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This black-and-white photograph captures a group of individuals gathered around a piano, with a man seated at the instrument. The scene is set in a room with a staircase visible in the background, and the atmosphere appears to be one of performance or rehearsal.

The man playing the piano is dressed in a white suit jacket, black shirt, and white bow tie, while the other individuals are attired in various outfits, including dresses, suits, and hats. Some of them hold books or papers, suggesting that they may be singers or musicians.

The overall mood of the image is one of elegance and sophistication, with the formal attire and refined setting evoking a sense of refinement and culture. The presence of the piano and the group's engagement with it suggests a shared passion for music, and the image conveys a sense of community and collaboration among the individuals depicted.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image shows a group of people dressed in white clothing and hats, possibly for a performance or event. The man in the center is sitting and playing the piano, while the others are standing behind him, possibly singing or dancing. The image has a black-and-white filter, giving it a vintage look. The image also has a watermark with the number "13542" in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo features a group of people, perhaps attending a formal event. The man sitting in front of the piano is wearing a bow tie and a pocket square. Behind him are people wearing white clothes, some of them are wearing hats. The woman on the right is holding a handbag. A hat is placed on the right side. A staircase is behind the group of people.

Google Gemini

Created by gemini-2.0-flash on 2025-05-09

Here is a description of the image:

The image appears to be a black and white negative of a gathering of people, likely at an event or ceremony.

In the foreground, there's a man seated at what seems to be a piano or lectern. He is dressed in a suit with a bow tie, and he's looking to the side. A closed book rests on the piano or lectern. To his right, there's a hat placed on the surface.

Behind him, a group of people is standing. They seem to be dressed formally. Some are wearing hats or headdresses. There is a mix of ages and expressions among them. They appear to be looking towards the front, possibly at a speaker or performer.

In the background, there is a staircase, and to the right, there is a wall with a sconce or light fixture attached to it.

The image seems to be captured on film, with markings and identification numbers visible in the borders.

Created by gemini-2.0-flash-lite on 2025-05-09

This is a negative image of a group of people, likely taken indoors. Based on the clothing, it appears to be from the early to mid-20th century.

Key elements and details:

  • Setting: It looks like they are in a hallway or foyer, possibly with a staircase visible in the background. The presence of a candelabra on the wall adds to the classic look.
  • People: There are several people present, most of them dressed in formal attire.
  • Attire: The women are wearing dresses, coats, and hats. The men are wearing suits and hats.
  • Foreground: In the foreground, there seems to be a book and some sort of table-like structure.
  • Mood: The image has a somber or formal atmosphere, perhaps a funeral or memorial service.

The photo appears to be a historical snapshot of a social gathering.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image appears to be a historical black-and-white photograph of a group of people, likely taken in the early to mid-20th century. The individuals in the photo are dressed in formal attire, suggesting a ceremonial or official event.

Here are some detailed observations:

  1. Attire:

    • Several people are wearing white robes or garments, some of which have decorative elements like lace or embroidery.
    • A few individuals are wearing suits and bow ties, indicating a formal occasion.
    • Some people are wearing head coverings, possibly hats or caps, which also seem to be part of the formal attire.
  2. Setting:

    • The setting appears to be indoors, possibly in a church or a ceremonial hall, given the formal clothing and the presence of what looks like a pulpit or lectern.
    • The background includes architectural elements like columns and possibly a staircase, adding to the formal ambiance.
  3. Activity:

    • The people in the photo seem to be engaged in a formal gathering or ceremony.
    • Some individuals are holding books or documents, which could be hymnals, Bibles, or other ceremonial texts.
    • The expressions and postures of the people suggest a solemn or respectful atmosphere.
  4. Photographic Details:

    • The image has a border with the number "13542" printed on it, which could be a catalog or reference number.
    • The photograph has a slightly faded quality, typical of older photographs.

Overall, the image captures a formal, ceremonial gathering, likely of religious or official significance, with participants dressed in traditional or formal attire.

Text analysis

Amazon

13542
St

Google

13542 13542,
13542
13542,