Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Hospital Ward

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2377.2

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Hospital Ward

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2377.2

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Hospital 99.6
Human 97.8
Furniture 94.7
Clinic 94.2
Operating Theatre 84.2

Clarifai
created on 2019-06-04

room 99.8
furniture 99.8
indoors 98.4
people 98
home 97.8
bed 97.4
chair 95.6
table 93.1
seat 92.8
hospital 91.3
bedroom 88.2
family 83.4
curtain 82.2
house 81.2
two 77
lamp 76.7
mirror 76
window 75.9
interior design 73.7
adult 73.7

Imagga
created on 2019-06-04

room 77.6
interior 64.6
chair 62.4
furniture 57
table 47.7
modern 44.9
house 43.5
home 42.3
floor 41
decor 38.1
barbershop 32.3
window 32.1
architecture 31.5
inside 31.3
design 31
seat 30.6
classroom 30.4
wood 29.2
shop 27.3
sofa 26.9
living 26.6
lamp 24.8
residential 24
indoor 23.8
luxury 23.2
indoors 22.9
apartment 22.1
area 21.7
structure 21
wall 20.7
patio 20.6
mercantile establishment 20
3d 19.4
building 19.3
estate 19
barber chair 18.9
light 18.7
comfortable 18.2
decoration 18.1
style 17.8
empty 17.2
glass 17.1
restaurant 17.1
chairs 16.7
couch 16.4
nobody 16.3
lighting 15.5
office 15
residence 14.6
carpet 14.6
place of business 14.4
anteroom 14.4
door 14.3
contemporary 14.1
space 14
decorate 13.3
real 13.3
render 13
living room 12.7
domestic 12.7
relax 12.6
fireplace 12.5
dining 12.4
hall 12.4
furnishings 11.8
hotel 11.5
new 11.3
reflection 10.6
business 10.3
kitchen 10
cabinet 9.9
tables 9.9
hardwood 9.8
tile 9.7
vase 9.7
leather 9.5
place 9.3
stone 9.3
stylish 9.1
family 8.9
upscale 8.9
cafeteria 8.9
wooden 8.8
work 8.6
desk 8.5
food 8.5
cell 8.5
dinner 8.4
bar 8.3
plant 8.2
lifestyle 8
establishment 7.9
stool 7.9
marble 7.9
corridor 7.9
dwelling 7.9
elegant 7.7
center 7.7
elegance 7.6
relaxation 7.5
clean 7.5
lights 7.4
counter 7.4
life 7

Google
created on 2019-06-04

Room 94.9
Property 86.9
Furniture 83.6
Building 81.5
Interior design 80.4
Black-and-white 78.1
Living room 74.2
House 71.7
Chair 66.2
Table 63.8
Home 63.7
Vintage clothing 54.7
Floor 53.9

Microsoft
created on 2019-06-04

room 99.4
indoor 99.3
floor 98.3
living 97.7
chair 94.1
ceiling 90.4
furniture 89.4
table 84.8
house 78.9
interior 73.1
couch 67.1
desk 62.9
bed 53
old 52.4
area 31.6
several 11.8

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 26-43
Gender Female, 53.9%
Calm 45.2%
Confused 45.1%
Happy 45.1%
Sad 53%
Surprised 45.1%
Disgusted 45.1%
Angry 46.4%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Sad 50%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.8%
Disgusted 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Angry 49.5%
Disgusted 49.5%
Sad 50.4%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 4-9
Gender Female, 50.4%
Confused 49.5%
Angry 49.6%
Happy 49.6%
Sad 50.2%
Disgusted 49.5%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Angry 49.6%
Calm 50.1%
Sad 49.6%
Disgusted 49.5%
Happy 49.6%
Confused 49.5%
Surprised 49.6%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Bed

Clarifai

Bed
Clothing
Building
Chair
Human face
Footwear
Table
Person
Window

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 93.9%

AWS Rekognition

Person 93.4%

AWS Rekognition

Person 79.1%

AWS Rekognition

Bed 94.7%

Clarifai

Bed 93.1%

Clarifai

Bed 42.3%

Clarifai

Clothing 73.9%

Clarifai

Clothing 72%

Clarifai

Clothing 64.9%

Clarifai

Clothing 64.4%

Clarifai

Clothing 59.5%

Clarifai

Clothing 55%

Clarifai

Clothing 49.9%

Clarifai

Clothing 37.8%

Clarifai

Clothing 34.8%

Clarifai

Building 73.5%

Clarifai

Chair 62.9%

Clarifai

Chair 36.1%

Clarifai

Human face 59.4%

Clarifai

Human face 57.7%

Clarifai

Human face 34.7%

Clarifai

Footwear 55.5%

Clarifai

Footwear 52.2%

Clarifai

Footwear 41.8%

Clarifai

Footwear 38.1%

Clarifai

Footwear 36.7%

Clarifai

Table 54%

Clarifai

Table 40.7%

Clarifai

Person 46.4%

Clarifai

Window 40.6%

Clarifai

Window 34%

Categories

Imagga
created on 2019-06-04

interior objects 99.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people in a room with beds and a television

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people in a room with beds

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts an old-fashioned hospital or care facility room. It has a modest and functional layout, with simple metal-frame beds adorned with white linens. The room features polished wooden floors, high ceilings, and large windows, allowing natural light to illuminate the space. A nurse or caregiver, dressed in traditional attire, appears to be attending to individuals seated in rocking chairs. The room includes basic furnishings like a dresser and wall decorations. It reflects a historical setting, likely from the early 20th century, showcasing a calm and orderly environment for patient care.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image shows a hospital room or a ward from an earlier time period. The room has high ceilings and large windows that allow natural light to enter. The windows have pull-down blinds partially covering them. There are several metal-framed beds in the room, each made with simple white linens. Beside one of the windows, there is a dresser with a mirror on top. The floor is wooden, and there is a single exposed light bulb hanging from the ceiling. In the room, a nurse wearing a white uniform stands next to one of the beds, while people are seated in wooden chairs near the windows and the beds.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image appears to be a black and white photograph of the interior of a room, likely a bedroom or living space. The room contains several pieces of furniture, including a bed, chairs, and what appears to be a radio or other electronic device. There are several people, primarily women, seated or standing in the room. The room has a somewhat sparse and utilitarian appearance, with plain walls and minimal decor. The overall atmosphere suggests this may be a residential or institutional setting from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a historical black and white photograph of what looks like a hospital ward or medical facility, likely from the early 1900s. The room has several metal-frame beds with white linens lined up against the wall. There are large windows letting in natural light, and the walls appear to be plain and institutional. Several people can be seen in the room, some sitting in rocking chairs or other seats. The room has a somewhat sparse, clinical appearance typical of medical facilities from that era, with basic furnishings and minimal decorations. The image captures the stark, utilitarian nature of early 20th century healthcare environments.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a vintage black-and-white photograph of a hospital room, circa 1910s-1920s. The room is furnished with two beds, each equipped with a metal frame and a white sheet. A third bed is partially visible in the bottom-right corner.

In the center of the room, a woman in a white dress stands near a chair, while two individuals sit in chairs, one of whom is a child. Another child sits on a bed, and a man lies in the other bed. The walls are adorned with windows, and a dresser is positioned near the back wall. The floor appears to be made of wood, and the overall atmosphere suggests a somber and clinical environment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a hospital room, likely from the early 20th century. The room features two beds with white sheets and metal frames, positioned on either side of the room. A woman in a nurse's uniform stands near the window, while several children sit in chairs or on the beds. The room has a wooden floor and is illuminated by natural light from the windows.

The image appears to be a historical photograph, possibly taken for documentation or educational purposes. It provides a glimpse into the past, showcasing the layout and furnishings of a hospital room during that era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

This is a black-and-white photograph of a hospital room. The room has several beds, some of which have pillows. There are also chairs and a cabinet. A woman in a white dress, possibly a nurse, is standing near the window, and there are three children sitting on a chair. The room has a wooden floor and a ceiling lamp. The photograph has a vintage look, and the image is slightly blurry.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black and white photo shows a room with a wooden floor and a ceiling with pipes. The room has four beds with white covers and pillows. The beds have metal frames. A woman is standing in front of the bed on the left side. There are three girls sitting on the chairs, and one of them is sitting on a rocking chair. There are three windows with blinds, and a cabinet is placed in front of them.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression: The image is a black and white photograph, likely taken in the early 20th century. It depicts a room that seems to be a ward or recovery space.

Setting: The room has an institutional feel, with large windows providing ample natural light. The walls appear to be painted and there's a dark wooden floor. There are hints of decorative elements like window frames.

People: There are several people in the room, appearing to be children. A woman, possibly a nurse or caregiver, stands near some of them, likely checking on them. Some of the children are sitting in chairs, and others are near beds.

Objects: There are several iron frame beds in the room, neatly made with white sheets. A tall dresser is in the background, and a few chairs. There are also a couple of hanging lightbulbs.

Created by gemini-2.0-flash on 2025-05-04

Here is a description of the image:

The image is a black and white photograph of what appears to be a hospital ward or a room in a residential facility from a bygone era. The room has several metal-framed beds, most of which are neatly made with white linens and pillows. The flooring consists of hardwood planks.

Along one wall, there's a large window divided into three sections, with blinds partially drawn. Underneath the window, several women are seated, while a woman in a light-colored uniform, possibly a nurse, stands nearby.

In the corner of the room, there is a chest of drawers with a mirror on top, and a small round clock on the wall above it. To the right of the chest, there is another window, and what looks like a child standing next to it with his arms crossed.

The room seems sparsely furnished and lit by a single hanging light bulb without a lampshade. The walls are painted a light color, and there are some pipes running along the ceiling and down the wall in one corner. The overall impression is one of simplicity and practicality.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a historical hospital ward or a similar medical facility. The room is spacious with high ceilings and large windows that allow natural light to enter. The walls are plain, and the floor appears to be wooden.

Several beds are lined up along the walls, each with metal frames and white bedding. There are patients in the beds, some sitting up and others lying down. The patients are dressed in hospital gowns or similar attire.

In the background, near the windows, there are a few more individuals, possibly nurses or medical staff, attending to the patients. One of the staff members is standing and appears to be engaged in conversation with a patient.

The overall atmosphere suggests a calm and orderly environment, typical of a hospital ward from an earlier era. The furnishings and attire of the individuals indicate that the photograph was likely taken in the early to mid-20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This is a black-and-white historical photograph of a room that appears to be a hospital or orphanage, likely from the early to mid-20th century. The room is furnished with a row of hospital-style beds with metal frames and white bedding, suggesting it may be used for patients or children. There are several individuals seated or lying in the room, some in chairs and others on the beds. A nurse or caretaker is standing near the left side of the room, interacting with one of the seated individuals. The room has a simple, utilitarian design with plain walls and wooden floors. There are windows at the back of the room, covered with dark curtains, allowing some light to filter through. A small table with a radio or similar device is visible in the background, along with a dress cabinet. The overall atmosphere suggests a quiet, somber setting, consistent with the historical context of the era.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This image appears to be a black-and-white photograph of a hospital ward or a similar medical facility from an earlier time period. The room has several beds with metal frames and white bedding. There are multiple people in the room, including a woman who seems to be a nurse or a caretaker, as she is wearing a white uniform and is attending to the patients. The patients are seated on chairs and some are on the beds. The room has large windows with curtains, and there is a radiator along the wall. The overall atmosphere suggests a calm and orderly environment.

Text analysis

Amazon

880