Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Metropolitan Hospital, Blackwell's Island: Metropolitan Hospital, New York City: Tuberculosis Infirmary Interior of Dining Pavilion.: "Part 2. of panoramic view."

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.786.2

Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Metropolitan Hospital, Blackwell's Island: Metropolitan Hospital, New York City: Tuberculosis Infirmary Interior of Dining Pavilion.: "Part 2. of panoramic view."

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.786.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.2
Human 99.2
School 98.9
Indoors 98.9
Room 98.9
Classroom 98.9
Person 98.8
Person 98.5
Person 98.5
Person 98.4
Person 98.4
Person 97.2
Person 97.2
Person 95
Person 84.5
Person 79.3
Building 78.2
Factory 76.7
Restaurant 68.8
Cafeteria 68.8
Person 66.5
Person 66.2
Person 65.8
Person 49.2

Clarifai
created on 2019-06-07

people 99.9
many 99.5
group 98.3
group together 97.7
adult 96.5
man 94.1
administration 92.1
woman 89.4
furniture 88.2
crowd 88.2
war 87.7
room 86.2
military 86.2
indoors 86.2
child 83.3
leader 82.3
wear 80.7
education 80.6
sit 73.6
employee 72.5

Imagga
created on 2019-06-07

dairy 33
hall 27.3
building 27
room 21
classroom 20.5
architecture 18
city 17.4
travel 16.9
structure 14.4
old 13.9
landscape 13.4
prison 13.2
tourism 13.2
water 12.7
sky 12.1
wall 12
restaurant 11.7
group 11.3
people 11.2
cafeteria 11
house 10.9
life 10.7
correctional institution 10.6
interior 10.6
crowd 10.6
chair 10.5
urban 10.5
bird 10.2
scene 9.5
table 9.5
walking 9.5
lake 9.1
park 9.1
man 8.7
day 8.6
column 8.3
vacation 8.2
history 8
penal institution 8
summer 7.7
culture 7.7
traditional 7.5
outdoors 7.5
town 7.4
historic 7.3
tourist 7.2
river 7.1
male 7.1

Google
created on 2019-06-07

Photograph 95.8
Snapshot 84.1
Class 80.3
Room 65.7
History 54.1
State school 53.2
Team 52.3
Building 50.8
Crowd 50.7

Microsoft
created on 2019-06-07

person 95.9
indoor 92.5
clothing 90.4
table 87.9
man 74.5
group 66.2
old 65.8
school 56.8
clothes 16.2

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 48-68
Gender Male, 54%
Disgusted 45.8%
Surprised 45.5%
Confused 45.2%
Sad 45.3%
Happy 47.1%
Calm 50.1%
Angry 46.1%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Sad 45.8%
Confused 45.4%
Disgusted 45.1%
Calm 51.1%
Happy 45.1%
Angry 47.3%
Surprised 45.3%

AWS Rekognition

Age 38-57
Gender Male, 54.9%
Sad 45.3%
Calm 45.8%
Angry 53.6%
Disgusted 45%
Confused 45.2%
Surprised 45.1%
Happy 45%

AWS Rekognition

Age 38-59
Gender Male, 54.9%
Calm 47.2%
Disgusted 45.4%
Angry 46%
Sad 50.4%
Surprised 45.2%
Confused 45.6%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Surprised 45.3%
Calm 48.5%
Sad 47.4%
Happy 45%
Confused 46%
Angry 47.6%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Calm 46.2%
Disgusted 45.4%
Angry 45.5%
Sad 51.3%
Surprised 45.8%
Confused 45.5%
Happy 45.2%

AWS Rekognition

Age 60-90
Gender Male, 53.1%
Angry 45.5%
Happy 47.1%
Disgusted 45.6%
Sad 46%
Confused 45.4%
Surprised 45.5%
Calm 50%

AWS Rekognition

Age 48-68
Gender Male, 54.9%
Happy 45.2%
Surprised 45.3%
Confused 45.9%
Angry 47%
Sad 47%
Disgusted 45.3%
Calm 49.3%

AWS Rekognition

Age 38-57
Gender Male, 53.9%
Happy 45.6%
Surprised 46%
Sad 45.4%
Confused 45.2%
Disgusted 45.1%
Calm 52.2%
Angry 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.4%
Sad 54.6%
Confused 45%
Disgusted 45%
Angry 45.2%
Happy 45.1%
Surprised 45%
Calm 45.1%

AWS Rekognition

Age 27-44
Gender Male, 51.9%
Sad 49.2%
Angry 48.1%
Happy 45.1%
Disgusted 45.3%
Calm 46.6%
Surprised 45.4%
Confused 45.3%

AWS Rekognition

Age 57-77
Gender Male, 53.1%
Angry 49.2%
Calm 48.4%
Happy 45.2%
Sad 46.1%
Disgusted 45.4%
Surprised 45.4%
Confused 45.3%

AWS Rekognition

Age 45-66
Gender Female, 50.2%
Sad 49.6%
Confused 49.5%
Calm 49.5%
Angry 50.1%
Disgusted 49.7%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.4%
Happy 49.5%
Angry 50.1%
Calm 49.7%
Surprised 49.5%
Disgusted 49.6%
Confused 49.5%
Sad 49.6%

AWS Rekognition

Age 49-69
Gender Male, 50%
Disgusted 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Sad 49.8%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Sad 50.3%
Happy 49.5%
Calm 49.5%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Calm 49.8%
Disgusted 49.5%
Sad 49.9%
Happy 49.7%
Surprised 49.5%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Angry 49.6%
Sad 50.2%
Happy 49.6%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Calm 49.6%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 50.3%

AWS Rekognition

Age 27-44
Gender Female, 50.4%
Confused 49.5%
Sad 50.1%
Disgusted 49.5%
Calm 49.6%
Happy 49.6%
Surprised 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Angry 50.4%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Angry 49.8%
Calm 49.8%
Happy 49.6%
Sad 49.7%
Disgusted 49.5%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 6-13
Gender Male, 50.5%
Sad 49.6%
Confused 49.5%
Calm 49.5%
Angry 49.6%
Disgusted 50.3%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.5%
Sad 50.4%
Angry 49.5%
Calm 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Male, 50.4%
Surprised 49.5%
Angry 49.5%
Sad 49.5%
Disgusted 50.3%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50%
Calm 49.7%
Surprised 49.5%
Confused 49.5%
Angry 49.6%
Sad 49.9%
Happy 49.7%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Disgusted 49.5%
Calm 49.6%
Confused 49.8%
Sad 49.8%
Angry 49.7%
Surprised 49.6%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.6%
Calm 49.7%
Confused 49.7%
Sad 49.6%
Angry 49.8%
Surprised 49.6%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Angry 49.5%
Surprised 49.5%
Sad 50.4%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Disgusted 49.9%
Surprised 49.6%
Angry 49.7%
Calm 49.6%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Feature analysis

Amazon

Person
Person 99.2%
Person 98.8%
Person 98.5%
Person 98.5%
Person 98.4%
Person 98.4%
Person 97.2%
Person 97.2%
Person 95%
Person 84.5%
Person 79.3%
Person 66.5%
Person 66.2%
Person 65.8%
Person 49.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-06-13

a photograph of a group of people sitting at tables with plates of food -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a large dining hall filled with rows of individuals seated at long tables. The tables are set with plates, bowls, and cups, suggesting a meal is taking place or being served. The hall is spacious with a high ceiling, supported by vertical columns, and natural light streams in through tall windows on the right-hand side. Overhead signs marked with letters such as "B," "C," and "D" are suspended from the ceiling, possibly indicating table designations or sections. A few figures are moving around the room, likely attending to guests or overseeing the dining process. The atmosphere appears orderly, and the environment resembles that of an institution such as a hospital, cafeteria, or shelter.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a large dining hall filled with people seated at long tables. The setting appears to be institutional, such as a cafeteria in a prison, asylum, or similar facility, with individuals dressed uniformly. The room is spacious, with high ceilings, and large windows on the right side allow natural light to pour in. The architecture features prominent pillars and hanging light fixtures. Signs labeled with letters such as "B," "C," and "D" hang from the ceiling, possibly indicating different sections or groups within the hall. The tables are set with bowls, cups, and some food items, suggesting a mealtime is occurring. The overall atmosphere is orderly and organized.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to show a large dining hall or cafeteria filled with a crowd of people, mostly men, seated at long tables and eating a meal. The room has a high ceiling with exposed beams and a large window along one wall. There are signs or letters on the wall, possibly indicating sections or areas of the space. The people in the image seem to be from a working-class or industrial background, based on their attire and the setting. The overall scene conveys a sense of a communal dining experience, likely in some kind of institutional or industrial setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a historical black and white photograph showing what appears to be a large industrial or institutional dining hall. The space is filled with long tables where numerous workers, likely from the early 1900s based on their clothing and the style of photography, are seated having a meal. The room has high ceilings with ornate tin or metal ceiling tiles, tall windows letting in natural light, and support columns running down its length. The diners are using what appear to be white cups, bowls, and plates. The room has a very organized, regimented layout typical of factory or institutional cafeterias of that era. The image captures a moment of communal dining that was common in industrial workplaces of the time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a large room filled with numerous men seated at long tables, engaged in eating. The men are dressed in attire typical of the early 20th century, including jackets and sweaters. Each table is set with plates, bowls, cups, and silverware, indicating a communal dining setting.

The room features high ceilings, large windows, and a grid-like pattern on the ceiling, suggesting a utilitarian design. A series of letters, including "B," "C," and "D," are visible on the wall, possibly indicating different sections or areas within the room.

The overall atmosphere of the image is one of communal activity, with the men gathered together to share a meal. The setting appears to be a cafeteria or dining hall, likely in a workplace or institution such as a factory, school, or hospital. The image provides a glimpse into the daily lives of these men, who are likely workers or students, and highlights the importance of communal dining in their daily routines.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a vintage black-and-white photograph of a large room filled with men seated at long tables, engaged in eating. The room features a high ceiling with exposed pipes and windows along the right side, while the left side has windows with a sign that reads "B" in the background. The atmosphere appears to be one of a communal dining setting, possibly in a military or institutional context.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image shows a historical photograph of a large dining hall with many people seated at long tables, possibly soldiers or workers, in a military or industrial setting. The dining hall has a high ceiling with a series of hanging lamps and metal beams, and there are windows on the side walls. The people are seated in rows, with some wearing uniforms and others in civilian clothes. The tables are set with plates, bowls, and cups, and some people are eating while others are looking around.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image features a dining hall with numerous men seated at tables, possibly in a military or institutional setting. The hall is well-lit, with large windows on the right side allowing natural light to enter. The ceiling is high, adorned with decorative patterns, and supported by several pillars. Each table is set with bowls, plates, and utensils, indicating a communal mealtime. The men appear to be engaged in eating, with some looking directly at the camera. The overall atmosphere suggests a structured and organized environment.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

The image is a vintage black and white photograph depicting a large dining hall filled with men seated at long tables. The room is well-lit with large windows along the right side, and there are industrial-style support pillars throughout the space. Each table is covered with a light-colored cloth and set with plates, bowls, and cutlery, suggesting a mealtime. The men are dressed in a variety of jackets and coats, and most of them appear to be engaged in eating. Signs with letters "B", "C", "D", and others are hanging from the ceiling above the tables. The overall impression is of a communal dining space, possibly in a factory, workhouse, or institutional setting from a bygone era.

Created by gemini-2.0-flash-lite on 2025-06-13

Certainly! Here's a description of the image:

Overall Impression:

The image is a sepia-toned, historical photograph. It depicts a large, well-lit dining hall packed with people. The scene has a sense of order and structure.

Key Elements:

  • Large Dining Hall: The setting is a spacious room with a high, patterned ceiling. Long tables are arranged throughout, occupied by a large number of people.
  • People: The diners are predominantly men, dressed in what appears to be workwear or slightly formal attire. They are seated and seem to be eating a meal.
  • Tables and Seating: The tables are covered with white cloths, and there are simple wooden chairs at each place. Plates, bowls, and cups are set out.
  • Lighting: Large windows along one side of the room provide natural light. Other fixtures (potentially lamps or pendant lights) hang from the ceiling.
  • Structure/Organization: Hanging signs labeled with letters ("B," "C," "D") suggest organized seating or areas.
  • Details: Some of the people have facial hair. There is also a small plant near the windows.

Overall, it's likely a photograph documenting a communal meal, perhaps in a factory, institution, or boarding house of the late 19th or early 20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a large dining hall filled with people seated at long tables, likely from the early 20th century. The hall has a high ceiling with hanging lights, and large windows that allow natural light to enter. The individuals in the photograph are predominantly men, dressed in simple, work-like clothing, suggesting they might be workers or soldiers. They are eating from plates and bowls, and some have cups in front of them, indicating a mealtime setting. The tables are arranged in rows, and the atmosphere appears to be orderly and communal. The setting and attire of the individuals suggest this could be a factory canteen, a military mess hall, or a similar communal dining area. The overall mood is one of shared experience and camaraderie.

Text analysis

Google

B
B