Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: The Medical Examination.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.128.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: The Medical Examination.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.128.2

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Handrail 100
Banister 100
Human 99.4
Railing 96.1
Clothing 71.6
Apparel 71.6
Suit 62
Coat 62
Overcoat 62
Factory 56.9
Building 56.9
Flooring 56.8
Staircase 56.6

Clarifai
created on 2025-01-10

people 100
group 99.6
adult 99.4
group together 99.4
woman 99.2
child 98
man 97.6
many 96.7
several 94.2
five 92.7
furniture 91.9
recreation 90.6
boy 90.2
wear 90
three 89.7
step 88.1
war 87.9
administration 86.9
indoors 86.9
outfit 86.3

Imagga
created on 2022-06-04

turnstile 42.2
gate 38
prison 31
movable barrier 25.9
cell 23.7
industrial 23.6
industry 23
correctional institution 22.5
building 22.5
metal 20.1
barrier 18.9
structure 17.3
penal institution 16.9
steel 16.8
factory 16.1
interior 15.9
engineering 14.3
power 14.3
chair 14.2
room 14.2
architecture 14.1
modern 13.3
construction 12.8
wall 12.8
old 12.5
house 12.5
institution 11.2
window 11.1
plant 10.8
furniture 10.7
pollution 10.6
device 10.2
wood 10
equipment 9.9
obstruction 9.9
pipe 9.8
stairs 9.8
station 9.7
wooden 9.7
machine 9.6
concrete 9.6
seat 9.6
door 9.3
energy 9.2
inside 9.2
design 9
people 8.9
technology 8.9
manufacturing 8.8
man 8.7
urban 8.7
fuel 8.7
heavy 8.6
iron 8.4
work 8.3
home 8
indoors 7.9
piping 7.9
glass 7.8
waste 7.8
steam 7.8
supply 7.7
gas 7.7
area 7.6
electricity 7.6
lifestyle 7.2
transportation 7.2
worker 7.1
travel 7

Google
created on 2022-06-04

Microsoft
created on 2022-06-04

clothing 92.8
building 91.2
person 90.9

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 18-26
Gender Female, 86.8%
Confused 86.3%
Surprised 7.3%
Fear 6.4%
Sad 3.1%
Calm 3%
Disgusted 2.6%
Angry 1.8%
Happy 0.7%

AWS Rekognition

Age 27-37
Gender Male, 97.6%
Calm 95.1%
Surprised 6.5%
Fear 6%
Sad 2.4%
Angry 1.6%
Confused 0.7%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 36-44
Gender Female, 95.3%
Confused 27.9%
Fear 22.3%
Calm 20.4%
Surprised 10.1%
Happy 9.2%
Sad 6.7%
Angry 2.7%
Disgusted 2.7%

AWS Rekognition

Age 34-42
Gender Male, 100%
Angry 65.3%
Sad 19.5%
Calm 7.4%
Fear 7%
Surprised 6.8%
Disgusted 5.1%
Confused 1.1%
Happy 0.5%

AWS Rekognition

Age 23-33
Gender Male, 71.5%
Angry 93.7%
Surprised 6.8%
Fear 6.2%
Calm 3.3%
Sad 2.3%
Happy 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 50.3%
Calm 86%
Fear 10%
Surprised 6.4%
Happy 4.1%
Sad 2.2%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person

Clarifai

Building
Clothing
Footwear
Human face
Person
Chair

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98%

AWS Rekognition

Person 81.2%

AWS Rekognition

Person 53.3%

Clarifai

Building 72%

Clarifai

Clothing 62.1%

Clarifai

Clothing 61.3%

Clarifai

Clothing 60.8%

Clarifai

Clothing 58.3%

Clarifai

Clothing 54.7%

Clarifai

Clothing 52%

Clarifai

Clothing 51%

Clarifai

Clothing 44.7%

Clarifai

Clothing 42.3%

Clarifai

Clothing 41.2%

Clarifai

Clothing 38.4%

Clarifai

Footwear 58%

Clarifai

Footwear 51.6%

Clarifai

Footwear 45.7%

Clarifai

Footwear 44.1%

Clarifai

Footwear 36.8%

Clarifai

Footwear 34%

Clarifai

Human face 55.7%

Clarifai

Human face 50.3%

Clarifai

Human face 45.4%

Clarifai

Human face 41.7%

Clarifai

Human face 38.8%

Clarifai

Human face 37.9%

Clarifai

Human face 35.2%

Clarifai

Person 47.4%

Clarifai

Person 38.2%

Clarifai

Person 34.3%

Clarifai

Person 34%

Clarifai

Chair 33.5%

Categories

Imagga
created on 2022-06-04

interior objects 100%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing around a caged in cage

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people standing in a line

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This sepia-toned photograph depicts a scene of a medical examination at an immigration processing center, likely Ellis Island based on historical context. Several individuals are grouped together near metal fencing and pipes while an official, easily identified by their formal uniform, is seen interacting with them. The individuals appear to be wearing early 20th-century attire, including shawls, coats, and patterned skirts, and they carry bundles and bags, which might include their belongings. The architecture in the background features high ceilings, pillars, and upper-level balconies, suggesting a large institutional setting. The atmosphere conveys the serious and procedural nature of immigration health checks during this era.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts an interior scene with several individuals gathered in a fenced area, possibly part of a larger facility or processing center. The setting includes metallic piping and railings, suggesting that this is a structured environment, possibly for orderly processing or examination. People in the scene are dressed in early 20th-century clothing. An official wearing a uniform and cap appears to be interacting with the group. The architecture in the background includes large pillars and an upstairs railing, characteristic of institutional or public buildings from that era. A bench is visible to the side, and the lighting suggests a natural or well-lit indoor space. The caption "THE MEDICAL EXAMINATION" indicates the event taking place is a routine medical check, likely in the context of immigration or a similar process.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image appears to depict a medical examination or screening process. It shows a group of people, including men, women, and children, standing or sitting behind a metal barrier or fence. The people seem to be waiting or lining up for some kind of medical procedure or evaluation. The setting suggests an institutional or official environment, with pipes and architectural features visible in the background. The overall tone of the image is somber and serious, reflecting the nature of the medical examination taking place.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This is a historical sepia-toned photograph titled "THE MEDICAL EXAMINATION." It appears to be taken at an immigration processing center, likely Ellis Island in the early 1900s. The image shows a group of immigrants waiting in line behind metal railings and wire mesh barriers. Several people are carrying large white sacks or bundles, presumably containing their belongings. The architectural details visible include columns and what appears to be an institutional interior space. There are both adults and children in the group, dressed in the typical clothing of the era - long dresses for the women and suits for the men. An official in uniform can be seen at the right side of the image. This photo documents an important aspect of the immigration process where new arrivals would undergo mandatory medical screenings before being allowed to enter the United States.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image depicts a group of people, including children, standing in a large room with metal fencing and pillars. The individuals are dressed in clothing from the early 20th century, suggesting that the photograph was taken during this time period.

  • A group of people, including children, are standing in a large room with metal fencing and pillars.
    • The individuals are dressed in clothing from the early 20th century.
    • The photograph appears to be a medical examination, as indicated by the text at the bottom of the image.
  • The room has a high ceiling and is well-lit, with natural light entering through windows or skylights.
    • The walls are white, and the floor is made of concrete or stone.
    • There are several pieces of furniture, including a bench and a table, scattered throughout the room.
  • The people in the image are all facing the same direction, suggesting that they are waiting for something or someone.
    • Some of the individuals are holding bags or other items, while others have their hands in their pockets.
    • The children in the image appear to be dressed in clothing that is similar to that of the adults, suggesting that they may be accompanying their parents or guardians.
  • The overall atmosphere of the image is one of calmness and anticipation.
    • The people in the image seem to be waiting patiently for something to happen.
    • The room is clean and well-maintained, suggesting that the individuals are in a safe and comfortable environment.

In summary, the image depicts a group of people, including children, waiting in a large room for a medical examination. The individuals are dressed in clothing from the early 20th century, and the room is well-lit and clean. The overall atmosphere of the image is one of calmness and anticipation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a black-and-white photograph of a group of people in a medical examination area. The group consists of men, women, and children, all dressed in formal attire, with some carrying large bundles or bags. They are standing behind a chain-link fence, which separates them from the rest of the room.

In the foreground, there is a metal railing that runs horizontally across the image. In the background, there are several columns and a balcony, suggesting that the scene is taking place in a large public building, possibly an immigration center or a hospital.

The overall atmosphere of the image is one of seriousness and formality, with the individuals in the group appearing to be waiting for a medical examination or some other official procedure. The presence of the chain-link fence and the metal railing adds to the sense of separation and control, suggesting that the individuals in the group are being processed or evaluated in some way.

The image is captioned "THE MEDICAL EXAMINATION" at the bottom, which provides context for the scene and suggests that the individuals in the group are undergoing a medical examination as part of an immigration or health screening process. Overall, the image provides a glimpse into the lives of people who were immigrating to a new country and the procedures they had to go through to enter their new home.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The image is in black and white, and it is titled "The Medical Examination." It shows a group of people, including men, women, and children, standing in a queue, possibly in a hospital or clinic. Some of them are wearing hats, and some are carrying bags. A man in uniform, possibly a doctor or a nurse, is standing in front of them. The area is enclosed by metal railings and has a bench and a bowl on the side.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph titled "The Medical Examination." It depicts a group of people in what appears to be a medical examination area, possibly at an immigration processing center. The people are standing in a line, separated by metal railings. The individuals in the foreground are being examined by medical personnel, who are wearing uniforms and hats. The medical personnel are checking the individuals' eyes, ears, and other parts of their bodies. The people being examined are wearing hats and carrying bags. The image has a sepia tone, giving it a vintage look.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

The photograph shows a medical examination at what appears to be an immigration processing center, likely Ellis Island. A group of people, including families with children, stand in line behind metal railings. They are dressed in simple clothes and some carry large bundles, suggesting they are new immigrants. A uniformed official, possibly a doctor or officer, stands examining one of the immigrants. The examination is taking place in a large, open hall with tall columns and wire mesh partitions. The shadows suggest a bright day. The caption "The Medical Examination" is printed at the bottom of the photo, giving further context.

Created by gemini-2.0-flash on 2025-05-22

The sepia-toned photograph captures a scene titled "The Medical Examination," depicting a group of immigrants undergoing inspection, likely upon arrival in a new country. The image's focus is on a line of people standing behind metal barriers, some carrying large bundles on their heads or shoulders, suggesting they have brought all their worldly possessions with them.

An officer in a uniform is examining one of the men in the line, possibly checking his eyes or other features for signs of illness. The faces of the immigrants reveal a mix of apprehension, hope, and weariness.

The setting appears to be a large hall with high ceilings supported by pillars, indicating an institutional building, possibly a processing center for immigrants. The lighting is soft, casting shadows that add to the image's solemn atmosphere. The overall composition conveys a sense of the human experience of immigration, marked by both anticipation and uncertainty.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-23

The image depicts a historical scene titled "The Medical Examination." It appears to be taken at an immigration processing center, likely Ellis Island in New York, given the context and the style of the photograph. The scene shows a group of immigrants, including men, women, and children, undergoing a medical examination.

The immigrants are dressed in early 20th-century clothing, with some carrying large bundles of belongings. They are standing in a line behind a metal railing, waiting for their turn to be examined by medical personnel. The medical examiners, dressed in uniforms and hats, are inspecting the immigrants, possibly checking for signs of illness or disease.

The setting is indoors, with a large, open space that has a high ceiling and large windows, allowing natural light to illuminate the area. The atmosphere seems orderly but tense, reflecting the seriousness of the medical inspection process that immigrants had to undergo before being allowed entry into the country. The photograph captures a significant moment in the history of immigration, highlighting the rigorous procedures and the hopeful yet anxious faces of those seeking a new life.

Qwen

No captions written

Text analysis

Amazon

THE
MEDICAL
THE MEDICAL EXAMINATION.
EXAMINATION.
7
In

Google

THE MEDICAL EXAMINATION.
THE
MEDICAL
EXAMINATION
.