Human Generated Data

Title

Charity, Soldiers and Sailors: United States. New York. Bath. State Soldiers' and Sailors' Home: State Soldiers' and Sailors' Home, Bath, N.Y.: Dormitory H & I: Room 2

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1190.2

Human Generated Data

Title

Charity, Soldiers and Sailors: United States. New York. Bath. State Soldiers' and Sailors' Home: State Soldiers' and Sailors' Home, Bath, N.Y.: Dormitory H & I: Room 2

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1190.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 95.7
Furniture 92.3
Wood 73.5
Restaurant 71.4
Building 70.8
Indoors 63.7
Housing 62.4
Cafeteria 62.4
Plywood 58.9
Bedroom 56.1
Room 56.1

Clarifai
created on 2019-06-05

people 99.7
chair 99.6
furniture 99.6
room 98.3
group together 98.1
seat 97.2
many 95.7
group 95.1
adult 94
indoors 94
administration 90
military 87.7
home 85.3
leader 84.1
man 82.9
four 80.1
several 79
woman 78.8
table 78.5
war 78.3

Imagga
created on 2019-06-05

room 62.1
patio 61
area 49.5
chair 46.5
classroom 44.9
table 40
structure 38.3
interior 35.4
furniture 29.6
restaurant 27
house 25.1
wood 22.5
building 22
seat 21.3
home 20.7
luxury 19.7
modern 18.9
chairs 18.6
floor 18.6
architecture 18
relax 17.7
window 16.6
resort 16.4
vacation 15.5
hall 15.5
summer 15.4
hotel 15.3
cafeteria 15.2
design 15.2
travel 14.8
beach 14.5
sun 14.5
decor 14.1
sea 14.1
inside 13.8
empty 13.7
dinner 13.5
relaxation 13.4
sky 13.4
living 13.3
tourism 13.2
sofa 12.7
light 12.7
water 12.7
residential 12.4
ocean 12.4
lamp 12.4
tables 11.8
umbrella 11.7
glass 11.7
comfortable 11.5
dining 11.4
palm 11.2
indoor 11
terrace 10.8
decoration 10.5
style 10.4
paradise 10.4
place 10.2
warehouse 10.1
island 10.1
eat 10.1
outdoor 9.9
indoors 9.7
sand 9.6
pool 9.6
wall 9.6
estate 9.5
sunny 9.5
lunch 9.4
tropical 9.4
warm 9.2
food 9.1
coast 9
plant 9
residence 8.8
lighting 8.7
day 8.6
holiday 8.6
nobody 8.6
tree 8.5
city 8.3
parasol 8.1
upscale 7.9
office 7.8
carpet 7.8
couch 7.7
decorate 7.6
real 7.6
contemporary 7.5
coastline 7.5
business 7.3
tourist 7.3
lifestyle 7.2
deck 7.2
fireplace 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

chair 96.3
table 94.2
indoor 93.7
coffee table 56.3
furniture 27.8
several 10.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Calm 49.6%
Confused 49.5%
Happy 49.5%
Disgusted 49.7%
Sad 50.1%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.6%
Sad 50.1%
Calm 49.6%
Happy 49.6%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 48-68
Gender Male, 50.2%
Disgusted 49.6%
Confused 49.5%
Sad 49.5%
Angry 49.6%
Happy 49.6%
Surprised 49.5%
Calm 50.1%

Feature analysis

Amazon

Person
Couch
Chair

Clarifai

Building
Chair
Table
Clothing
Person

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 85.4%

AWS Rekognition

Person 79.4%

AWS Rekognition

Person 72.5%

AWS Rekognition

Person 68.1%

AWS Rekognition

Person 60.1%

AWS Rekognition

Person 50%

AWS Rekognition

Couch 92.3%

AWS Rekognition

Chair 85.1%

AWS Rekognition

Chair 77.6%

Clarifai

Building 80.2%

Clarifai

Building 79.6%

Clarifai

Chair 67.8%

Clarifai

Chair 66.9%

Clarifai

Chair 66.4%

Clarifai

Chair 59.7%

Clarifai

Chair 44.4%

Clarifai

Chair 42.2%

Clarifai

Chair 41.7%

Clarifai

Chair 40.1%

Clarifai

Chair 39.3%

Clarifai

Chair 36.1%

Clarifai

Chair 35%

Clarifai

Chair 34.7%

Clarifai

Chair 34.1%

Clarifai

Table 65.9%

Clarifai

Table 37%

Clarifai

Table 36.5%

Clarifai

Table 35.1%

Clarifai

Table 33.5%

Clarifai

Clothing 55.2%

Clarifai

Clothing 46.8%

Clarifai

Person 33.3%

Categories

Imagga
created on 2019-06-05

streetview architecture 84.6%
events parties 11.9%
interior objects 1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a group of people in a hospital room

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a hospital room with beds and people

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This black-and-white image depicts a dormitory room labeled as “Room 2.” The room contains rows of metal-frame beds covered with patterned blankets. Several elderly individuals, mostly men, are seated in wooden chairs next to their beds, creating a quiet, subdued atmosphere. Some are reading or relaxing. The room has tall ceilings with decorative molding, supported by visible pillars. There is minimal wall decoration, with a few framed items and coats hanging on racks in the background. The overall setting appears utilitarian, likely part of a care facility or shelter.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a dormitory room with multiple single beds lined up in two rows along the length of the room. The beds are covered with patterned bedspreads, and each has a pillow. The room appears to be a shared living space for men, as several elderly men are visible sitting or lying on the beds. Some of them are sitting upright in wooden chairs placed at the ends of the beds, while others are seated on the beds themselves. The setting has an old-fashioned look, likely from the early or mid-20th century, as evidenced by the style of the furniture and the men's clothing. The walls are plain, and a clock is visible above a doorway at the far end of the room. Coats or jackets hang on hooks along the walls, suggesting this is a communal living space. The overall atmosphere seems utilitarian, consistent with a dormitory or shelter environment. The handwritten labels on the photograph indicate "Dormitory" and "Room 2."

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white historical photograph of what appears to be a dormitory or hospital ward, labeled as "Room 2." The room has a high ceiling with decorative tin tiles and support columns. There are several metal-frame beds lined up along the walls, each covered with patterned white bedspreads. The room appears to be a communal living space, possibly in a retirement home or medical facility. Several elderly residents can be seen sitting on or near their beds, with some appearing to be reading. The walls have some artwork or pictures hung on them, and there are coat hooks visible along the walls. The image has an institutional feel typical of early 20th century care facilities.

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph of the interior of a room, likely in some kind of institutional or medical setting. The room has a high ceiling with a decorative pattern, and it is filled with rows of beds or cots. Several people can be seen sitting or reclining on the beds, suggesting this may be some kind of hospital or care facility. The overall atmosphere seems somber and institutional, though the details of the setting and the purpose of the room are not entirely clear from the image alone.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image depicts a vintage black-and-white photograph of a dormitory, likely taken in the early 20th century. The room is filled with rows of beds, each equipped with a mattress, pillow, and blanket. Some of the beds have chairs positioned beside them, while others have small tables or desks. A few men are seated on the beds or chairs, while others stand near the walls or in the background.

In the foreground, a large bed dominates the center of the image, accompanied by a chair and a small table. The walls of the room are adorned with various objects, including a clock, a picture frame, and a coat rack. The ceiling features a decorative pattern, and the floor appears to be made of wood.

The overall atmosphere of the image suggests a sense of quiet contemplation, with the men engaged in various activities or simply sitting in silence. The vintage setting and the presence of men in old-fashioned clothing add to the nostalgic feel of the photograph.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

The image depicts a vintage photograph of a dormitory, likely from the early 20th century. The room is filled with rows of beds, each equipped with a metal frame and a mattress covered by a patterned blanket. Some beds have pillows and chairs placed beside them.

In the background, several individuals are visible, some sitting on beds or chairs, while others stand around the room. The walls of the dormitory are adorned with various items, including pictures, coats, and other personal belongings. The ceiling features a decorative tin design, adding to the room's aesthetic appeal.

The overall atmosphere of the image suggests a sense of community and shared living space, with the residents going about their daily activities in a relaxed and informal setting. The photograph provides a glimpse into the past, offering insight into the lives of those who lived in this dormitory during a bygone era.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The image is a black-and-white photograph of a room with several beds. The room appears to be a hospital ward. The beds are arranged in rows, with some patients sitting on them and others lying down. Some of the patients are wearing hats, and some are reading newspapers. The room has a high ceiling with a clock mounted on the wall. There are also lamps hanging from the ceiling.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph of a room with beds, likely from a hospital. The room has a high ceiling and walls adorned with various items, including a clock, picture frames, and a shelf with books and other objects. Several people are seated on the beds, and one individual is standing near the entrance. The beds are neatly arranged, and some have pillows and blankets. The image has a watermark in the bottom left corner with the text "Dopnitory" and "Room 2."

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

The sepia-toned image shows what appears to be a dormitory or large room with rows of beds. The room is marked "Room 2," and someone wrote "Dormitory" in the bottom left.

The foreground features several beds with floral-patterned bedspreads and white pillows. Some beds have chairs placed beside them. The beds are lined up in rows, suggesting an institutional setting.

People are seen in the room, some sitting or lying on the beds. One person is sitting in a chair, reading a newspaper. The men are wearing clothing common to the period, including suits, hats, and vests.

The room itself is large and has a high ceiling with a grid pattern. Vertical columns support the ceiling, and there are doors and windows along the walls. There is a clock hanging on the wall. The room appears sparsely decorated but functional.

The image quality is consistent with old photographs, with slight imperfections and a subdued tonal range. The overall impression is of a shared living space, possibly in a hostel, hospital, or institutional setting, from a historical era.

Created by gemini-2.0-flash-lite on 2025-05-28

Here's a description of the image:

Overall Scene:

The image is a vintage black and white photograph depicting a dormitory. The scene is well-lit, likely due to natural light and possibly artificial lighting. The room appears to be spacious with a high ceiling.

Key Elements:

  • Beds: The room is filled with rows of beds. Each bed has a simple metal frame, is covered with a floral-patterned coverlet, and is topped with a pillow.
  • People: Several people are present in the room. Some are sitting on their beds, while others are standing or reading. They are all dressed in simple clothing, consistent with the era.
  • Architectural Details: The room has columns, a textured ceiling, and a door at the back. There is a clock on the wall. Coats are hung on a wall-mounted rack.
  • Lighting: The light seems to be coming from multiple sources, creating a generally even illumination throughout the room.

Atmosphere:

The photograph evokes a sense of an institutional environment. The scene is calm and orderly.

Text:

At the bottom of the image, there are the handwritten words "Dormitory" and "ROOM 2".

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts an old dormitory room, labeled as "Room 2." The photograph appears to be quite aged, possibly from the early to mid-20th century. The room is spacious, with high ceilings and large structural columns. There are numerous beds arranged in rows, each equipped with metal frames and headboards. The beds are made with neatly arranged bedding and pillows.

Several elderly men are seated or lying on the beds, suggesting that this dormitory might be part of a facility for older individuals, such as a retirement home or a hospital ward. The men are dressed in casual clothing, and some are wearing hats.

The walls are plain and unadorned, except for a few framed pictures and a clock hanging on the far wall. The floor is wooden, and the overall atmosphere of the room is simple and utilitarian. The lighting in the room seems to be natural, possibly coming from windows not visible in the image.

Overall, the photograph captures a moment in time within a communal living space, providing a glimpse into the living conditions of the era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image shows a room labeled "Dormitory" with the label "ROOM 2" at the bottom. The room appears to be designed for multiple individuals, with several beds arranged in rows. Each bed is covered with a patterned bedspread. There are individuals seated or lying on the beds, and a few are engaging with newspapers or other materials. The room has a high ceiling with exposed beams and large windows, allowing some natural light into the space. The walls are plain, and there are a few hanging garments in the background. The overall atmosphere suggests a communal or institutional setting, such as a dormitory or a facility for individuals in need of care.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts a dormitory labeled "Room 2." The room is spacious with a high ceiling and several white iron-framed beds arranged in rows. Each bed has a floral-patterned blanket. There are people sitting and lying on the beds, some dressed in dark suits and hats, suggesting a formal or institutional setting. The room has white walls, large windows, and a clock on the wall. There are also some framed pictures or certificates on the walls, and a few coat racks with hanging coats. The overall atmosphere suggests a communal living space, possibly in an orphanage, hospital, or similar institution.

Text analysis

Amazon

ROOM2
Dopmtoeu
575

Google

ST5 2opatren ROOM 2
ST5
2opatren
ROOM
2