Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: Detained at the "Moral Gate-Way," Pending Further Investigation.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.300.1

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: Detained at the "Moral Gate-Way," Pending Further Investigation.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.300.1

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Human 98.9
Clothing 95.5
Apparel 95.5
Chair 86.3
Furniture 86.3
Sitting 83
Lighting 81
Crowd 79.7
Building 71
Audience 64.5
People 63.8
Paper 63.1
Coat 62.2
Indoors 58.3
Room 58.3
Overcoat 57
Art 55.8
Electronics 55.6
Display 55.6
LCD Screen 55.6
Monitor 55.6
Screen 55.6
Waiting Room 55.6
Hat 55.1

Clarifai
created on 2019-06-04

people 99.7
group 97.4
adult 97.2
woman 95.8
many 94.7
man 94.4
group together 94.2
indoors 89.6
room 88.2
administration 86.5
wear 86.3
several 84.9
one 84.6
recreation 82
military 81.2
music 80.8
war 80.5
leader 80.5
vehicle 79.2
chair 77.8

Imagga
created on 2019-06-04

hall 56.7
room 54.1
chair 51.6
interior 44.2
table 39.1
classroom 34.8
restaurant 30.9
furniture 25.5
seat 24.6
architecture 20.3
indoors 20.2
chairs 19.6
floor 19.5
empty 18.9
indoor 18.3
modern 18.2
glass 17.9
wood 17.5
home 16.8
building 16.6
dining 16.2
decor 15.9
design 15.8
style 15.6
window 15.6
decoration 15.3
house 15
tables 14.8
dinner 14.3
drink 14.2
light 14
food 13.9
inside 12.9
luxury 12.9
eat 12.6
nobody 12.4
night 12.4
comfortable 12.4
hotel 12.4
lamp 12.4
bar 12
lunch 12
people 11.7
city 11.6
place 11.2
old 11.1
wooden 10.5
urban 10.5
party 10.3
wine 10.2
life 9.8
wall 9.7
lifestyle 9.4
space 9.3
coffee 9.3
service 9.3
cafeteria 9
shop 8.9
barbershop 8.9
culture 8.6
structure 8.5
contemporary 8.5
relax 8.4
elegance 8.4
stool 7.9
scene 7.8
travel 7.7
residential 7.7
relaxation 7.5
tea 7.5
traditional 7.5
row 7.5
street 7.4
adult 7.2
office 7.1

Google
created on 2019-06-04

Microsoft
created on 2019-06-04

clothing 98.8
person 93.8
man 90.5
smile 82.9
human face 67.5
woman 65.5

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 27-44
Gender Male, 99%
Confused 5.9%
Calm 78.1%
Disgusted 1.8%
Happy 1.6%
Angry 3.4%
Sad 1.3%
Surprised 7.8%

AWS Rekognition

Age 14-25
Gender Female, 53.8%
Surprised 45.4%
Confused 45.5%
Happy 45.5%
Angry 45.7%
Disgusted 45.2%
Sad 47.2%
Calm 50.6%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Confused 45.2%
Angry 46.1%
Disgusted 45.4%
Surprised 45.3%
Sad 45.7%
Happy 46.6%
Calm 50.7%

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Calm 48.6%
Disgusted 45.2%
Angry 45.5%
Sad 49.7%
Happy 45.2%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Female, 54.2%
Surprised 47.5%
Confused 45.4%
Happy 45.4%
Angry 45.6%
Disgusted 45.8%
Sad 50%
Calm 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Angry 46.3%
Disgusted 45.2%
Sad 48.4%
Confused 45.8%
Happy 45.4%
Surprised 45.8%
Calm 48.2%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Confused 49.6%
Disgusted 49.7%
Happy 49.6%
Calm 49.7%
Surprised 49.6%
Sad 49.6%
Angry 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50.2%
Confused 49.6%
Angry 49.8%
Disgusted 49.5%
Surprised 49.6%
Sad 49.6%
Happy 49.5%
Calm 49.8%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Clothing
Man
Human face
Footwear
Woman
Human hair

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 92.4%

AWS Rekognition

Person 83.7%

AWS Rekognition

Person 75.8%

AWS Rekognition

Person 66.9%

AWS Rekognition

Person 45.5%

AWS Rekognition

Painting 55.8%

Clarifai

Clothing 83.7%

Clarifai

Clothing 73.8%

Clarifai

Clothing 73.8%

Clarifai

Clothing 63.6%

Clarifai

Clothing 58.4%

Clarifai

Clothing 48.4%

Clarifai

Clothing 41.3%

Clarifai

Clothing 40.5%

Clarifai

Clothing 39.5%

Clarifai

Clothing 38.1%

Clarifai

Clothing 34.5%

Clarifai

Man 66.8%

Clarifai

Man 46.9%

Clarifai

Man 45.7%

Clarifai

Man 42.2%

Clarifai

Man 37.9%

Clarifai

Man 36.3%

Clarifai

Human face 48.1%

Clarifai

Human face 45.9%

Clarifai

Human face 45.1%

Clarifai

Human face 44.3%

Clarifai

Human face 43.5%

Clarifai

Human face 37.1%

Clarifai

Human face 36.1%

Clarifai

Footwear 48%

Clarifai

Footwear 35.5%

Clarifai

Woman 33.4%

Clarifai

Human hair 33.2%

Categories

Imagga
created on 2019-06-04

events parties 48.4%
people portraits 23.6%
interior objects 18.4%
food drinks 7.4%
pets animals 1.8%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image shows a group of people seated in what appears to be a waiting area or processing center. The interior includes high ceilings, large arched windows letting in natural light, and structural elements like columns and railings. The individuals are dressed in formal or modest attire typical of the early 20th century, and many are holding or sitting next to small baggage items such as suitcases or bags. The setting suggests it could be a historical immigration or transit scenario, such as Ellis Island in the United States.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a historical scene inside a large hall, possibly a waiting area. Several people are seated on benches or chairs, holding various luggage items, suggesting that this might be a travel or immigration setting, such as at a train station or an immigration processing center. The architectural features include high ceilings, large arching windows that let in natural light, and structural columns. The attire of the individuals, distinguished by hats and long coats, indicates a time period earlier in the 20th century. The atmosphere appears formal, with people sitting closely together in rows.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image appears to be a historical photograph depicting a group of people seated in what looks like an old train or railway carriage. The individuals are dressed in formal attire, suggesting this may have been an important or formal occasion. The setting has a vintage, sepia-toned appearance, indicating this is an older photograph. The scene conveys a sense of the past and the formality of travel during that era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This appears to be a historical black and white photograph, likely from the early 1900s, showing a group of people seated in what looks like a courtroom or public hearing space. The individuals are dressed in formal attire typical of that era, with men wearing suits and sporting distinctive mustaches. The room has tall windows letting in light and appears to have some kind of fencing or barrier in front of the seating area. The image has the grainy, slightly faded quality characteristic of photographs from that time period. The setting suggests this might be from some kind of legal proceeding or official government business.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a sepia-toned photograph of a group of people sitting in a waiting area, likely at a train station or bus terminal. The photo is taken from a low angle, looking up at the group.

People:

  • There are approximately 10 people visible in the photo.
  • They are all dressed in formal attire, with men wearing suits and hats, and women wearing dresses and hats.
  • Some of the people are holding bags or packages.
  • One person in the foreground is holding a suitcase.

Background:

  • The background of the photo shows a large room with high ceilings and columns.
  • There are windows on the left side of the room, letting in natural light.
  • The walls are made of stone or brick, and there are railings along the edges of the room.
  • In the distance, there appears to be a doorway or entrance to another room.

Overall:

  • The photo has a vintage feel to it, suggesting that it was taken in the early 20th century.
  • The formal attire and the setting suggest that the people in the photo may be traveling for business or pleasure.
  • The photo provides a glimpse into the past, showing how people used to dress and travel.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

This image is a sepia-toned photograph of a group of people sitting on a bench in what appears to be a train station or other public transportation hub. The individuals are dressed in formal attire, with the men wearing suits and hats, and the women wearing long dresses and head coverings. They are all seated on a long bench, facing the camera, and appear to be waiting for their train or other mode of transportation.

In the background, there are several other people milling about, some of whom are also seated on benches. There are also several large windows that allow natural light to enter the space. The overall atmosphere of the image is one of anticipation and expectation, as the individuals wait for their journey to begin.

The image has a vintage feel to it, suggesting that it was taken in the early 20th century. The sepia tone and the formal attire of the individuals add to the nostalgic quality of the image. Overall, the image provides a glimpse into the past, capturing a moment in time when people were preparing to embark on a journey.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The image is a vintage black-and-white photograph of people sitting on benches inside a waiting area. The waiting area has a metal fence and a ceiling with a wooden structure. Some of the people are wearing hats, and one man is wearing a bow tie. They are all wearing formal attire. Some of them are holding hats, and one of them is holding a cigarette. There are also luggage pieces on the floor.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image is a vintage photograph of a group of people sitting on a bench inside a building, possibly a train station. The photograph has a sepia tone and a slightly blurry effect, giving it an old-fashioned look. The people in the photograph are dressed in formal attire, with some wearing hats and shoes. They are sitting on a bench with their legs crossed, and some of them are holding luggage or handbags. Behind them, there is a metal railing and a large arched window.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

Certainly! Here's a description of the image:

Overall Impression:

The image appears to be a vintage photograph, likely from the late 19th or early 20th century, based on its sepia tones and the attire of the people. It captures a scene of a group of people seated indoors, possibly in a waiting area or a similar public space.

Key Elements:

  • Subject: The primary focus of the image is a row of people, possibly immigrants, waiting. They are dressed in period clothing, with men in suits and hats, and women in dresses and headscarves.
  • Setting: The setting seems to be a large hall or building. In the background, there is an arched window letting in light. Columns and railings are visible, adding to the architectural detail.
  • Composition: The people are arranged in a row, seated on what appears to be a bench. There is an architectural structure separating them from the background. The photographer's viewpoint is at a mid-level, capturing the seated figures and providing a sense of the space.
  • Mood and Atmosphere: The image has a serious and historical feel, portraying a moment in time with a sense of anticipation and waiting. The sepia tones and the subject matter hint at a period of migration or travel.

Details to Note:

  • The people in the foreground look like they are the focus of the image, possibly family members or individuals travelling together.
  • Bags and suitcases are placed on the floor next to the people, adding to the sense of travel or relocation.
  • The building's interior has some decorative features, suggesting a public space or a well-constructed building.

Let me know if you would like a more detailed description of any aspect!

Created by gemini-2.0-flash on 2025-05-22

Here's a description of the image:

This is a sepia-toned photograph that appears to be quite old, likely taken in the early 20th century. It depicts a group of people seated in what looks like a waiting area of some kind of transit center or station. They are positioned along rows of benches, possibly waiting for transportation.

In the foreground, there is a row of men and women. The men are dressed in formal attire, wearing suits and some with ties. One of the men is wearing a bow tie. They sport mustaches and appear well-groomed. The women are dressed in what seem to be traditional or modest attires, with one woman wearing a head covering. Luggage and bags are placed at their feet, indicating they are travelers.

In the background, there are more people sitting on benches, creating a sense of a crowded or busy place. The interior architecture features pillars, a railing, and what appears to be a second-story balcony. Light is entering through a large arched window, illuminating the scene.

The overall impression is that of a historical moment, capturing the faces and attire of people during a time of travel, possibly immigration. The photograph has a vintage quality, with noticeable wear and tear that adds to its antique charm.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image depicts a group of people, likely immigrants, waiting in what appears to be a large, institutional building. The setting suggests it could be an immigration processing center, possibly Ellis Island in the United States, given the historical context and appearance of the individuals and the surroundings.

Here are some detailed observations:

  1. People:

    • The group consists of men, women, and children, all dressed in early 20th-century attire. The men are wearing suits and hats, while the women are dressed in long skirts and blouses.
    • The expressions on their faces vary; some look tired, others appear anxious or hopeful.
  2. Setting:

    • The room has a high ceiling with large windows allowing natural light to filter in.
    • There are benches where people are seated, and some are standing.
    • The architectural style, with large pillars and an open space, is indicative of early 20th-century institutional buildings.
  3. Luggage:

    • Several individuals are holding or have placed beside them suitcases and bags, indicating they are travelers.
  4. Atmosphere:

    • The overall mood appears to be one of waiting and anticipation. The people seem to be in a transitional phase, possibly awaiting processing or further instructions.

This image captures a moment in the lives of immigrants, reflecting the hope, uncertainty, and fatigue that often accompany such journeys.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This is a black-and-white photograph depicting a group of people seated in what appears to be a train station or a waiting area. The individuals are dressed in formal attire, suggesting the photo might have been taken in the early to mid-20th century. The men are wearing suits, ties, and hats, while the women are in dresses and some are wearing headscarves or veils. They are seated on wooden benches or chairs, and one person is holding a cased object, possibly a photograph or a letter.

The setting includes large windows in the background, allowing natural light to enter the space, which is indicative of a public transportation hub. There is also a barrier or railing in the background, possibly separating the seating area from an adjacent space. The image has a vintage quality, with signs of age such as scratches, dust, and a slightly blurred appearance, suggesting it is a historical photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This image appears to be a historical photograph, likely from the early 20th century. It shows a group of people seated on benches in a large indoor area, possibly a waiting room or a processing area in a train station or a similar public space. The individuals are dressed in formal attire, with many wearing coats, hats, and scarves, suggesting a colder season. Some of the people are holding luggage, indicating they might be travelers. The setting includes large windows allowing natural light to enter, and the architecture features columns and a high ceiling. The overall atmosphere suggests a busy, perhaps hectic, environment.

Text analysis

Amazon

3

Google

3
3