Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Harlem Hospital, Manhattan: Harlem Hospital, Manhattan (New York City Almshouse System)

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.830

Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Harlem Hospital, Manhattan: Harlem Hospital, Manhattan (New York City Almshouse System)

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.830

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.4
Art 86.6
Outdoors 79.1
Nature 78.5
Painting 65.7
Drawing 58.2
Winter 56
Advertisement 55.4
Poster 55.4
Weather 55.4

Clarifai
created on 2019-06-07

people 95
art 94.1
illustration 92.5
landscape 91.5
painting 91.5
wear 90.3
wall 90
no person 89.7
print 89.5
building 89.2
picture frame 89.2
architecture 89.2
adult 88.9
retro 88.5
city 88.4
old 87.3
vintage 85.7
house 84.7
travel 84.3
outdoors 83.2

Imagga
created on 2019-06-07

envelope 70.6
container 51.2
drawing 35.2
retro 34.4
grunge 34.1
vintage 29
treasury 28.4
frame 28
design 26.5
old 24.4
sketch 23.7
graphic 23.4
facility 22.3
depository 22.3
art 21.9
pattern 19.8
paper 18.9
decoration 18.8
floral 17.9
texture 17.4
dirty 17.2
antique 16.6
silhouette 16.6
representation 16
border 15.4
decorative 15
flower 14.6
wallpaper 14.6
paint 14.5
symbol 13.5
card 13.4
element 13.2
style 12.6
modern 11.9
aged 11.8
money 11.1
leaf 10.9
stain 10.6
blank 10.3
black 10.2
painting 9.9
business 9.7
map 9.7
ink 9.6
shape 9.6
artistic 9.6
collection 9
line 8.6
grungy 8.5
greeting 8.4
clip art 8.3
gymnasium 8.3
swirl 8.3
sign 8.3
template 8.3
book 8.3
currency 8.1
cartoon 8
color 7.8
scrapbook 7.8
ornament 7.8
set 7.6
poster 7.6
plant 7.5
page 7.4
backdrop 7.4
note 7.4
ornate 7.3
holiday 7.2
decor 7.1
country 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

gallery 83.6
scene 79.6
person 75.4
clothing 63.6
room 57.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 45-63
Gender Male, 54%
Calm 47.6%
Happy 48.1%
Angry 46%
Sad 47.3%
Confused 45.2%
Surprised 45.3%
Disgusted 45.5%

AWS Rekognition

Age 27-44
Gender Male, 53.5%
Happy 45.1%
Angry 45.7%
Surprised 45.2%
Calm 48.7%
Sad 49.9%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 35-53
Gender Male, 52.9%
Angry 45.4%
Disgusted 45.7%
Happy 45.2%
Confused 45.4%
Calm 45.9%
Sad 52.2%
Surprised 45.2%

AWS Rekognition

Age 48-68
Gender Female, 50.3%
Surprised 49.5%
Calm 49.8%
Happy 49.9%
Confused 49.5%
Sad 49.6%
Disgusted 49.7%
Angry 49.5%

Feature analysis

Amazon

Person

Clarifai

Tree
Clothing
Human face
House
Window
Human arm

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 87.4%

Clarifai

Tree 84.4%

Clarifai

Tree 71.3%

Clarifai

Tree 40.9%

Clarifai

Tree 36.4%

Clarifai

Clothing 82%

Clarifai

Clothing 79.1%

Clarifai

Clothing 74.3%

Clarifai

Clothing 62.6%

Clarifai

Human face 71.8%

Clarifai

Human face 69.5%

Clarifai

Human face 64%

Clarifai

Human face 60.8%

Clarifai

House 47.7%

Clarifai

Window 38.6%

Clarifai

Window 37.4%

Clarifai

Window 33.4%

Clarifai

Human arm 37%

Categories

Imagga
created on 2019-06-07

paintings art 99.5%

Captions

Microsoft
created by unknown on 2019-06-07

a screen shot of a social media post 70.4%
a screen shot of a cat 30.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a couple of people sitting on a porch

Created by general-english-image-caption-blip-2 on 2025-07-06

two old photographs of people in front of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image shows two photographs side by side documenting Harlem Hospital in Manhattan, part of the New York City Almshouse System.

On the left, a group of individuals are seated on the porch of a building labeled "Part-House Staff." The setting includes wooden railings, visible buildings in the background, and trees, suggesting the hospital grounds.

On the right, a structure labeled "Ambulance-House View of Yard" is depicted. It includes a gazebo-like building surrounded by fencing, sparsely landscaped grounds, and additional buildings and trees visible in the background.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image consists of two photographs placed side by side on a page labeled "Harlem Hospital, Manhattan (New York City Almshouse System)." The photograph on the left is titled "PART-HOUSE - STAFF" and depicts a group of individuals, including several seated figures in formal attire, on a porch with a railing and a building in the background. On the right is a photograph titled "STABLES" with the label "AMBULANCE-HOUSE VIEW w/YARD," showing a small, decorative gazebo-like structure with latticework, set in a yard area with trees and other buildings visible in the distance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a historical photograph from the Harlem Hospital in Manhattan, New York. It is divided into two sections.

The left section shows a group portrait of what seems to be the hospital staff, including several individuals seated on a porch or balcony. They are dressed in formal attire, suggesting this is an official staff photograph.

The right section shows an exterior view of the hospital grounds, including a gazebo-like structure and what appears to be an ambulance house or outbuilding. The scene has a serene, pastoral quality, with trees and greenery visible in the background.

The overall image provides a glimpse into the history and operations of the Harlem Hospital during an earlier time period, though I cannot identify any of the specific individuals shown.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a historical photograph showing two views of the Harlem Hospital in Manhattan, which was part of the New York City Almshouse System. The image on the left shows staff members on what appears to be a porch or veranda of the hospital building. The image on the right shows an exterior view labeled "Stables Ambulance House View+Yard" featuring a decorative gazebo-like structure with ornate lattice work and a distinctive roof. The photographs appear to be from the late 19th or early 20th century, given their sepia tone and architectural style. The images provide interesting documentation of the hospital's facilities and staff during that period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image presents a collection of two vintage photographs, accompanied by a title card that reads "Harlem Hospital, Manhattan" in black text on a white background. The title card also includes the notation "(New York City Almshouse System)" in smaller text below.

Photograph 1: Part of House Staff

  • The photograph on the left features a group of four individuals posing for the camera.
    • Two men are seated on a porch, while a woman stands behind them.
    • A man stands at the top of the stairs, partially obscured by the woman.
    • The photograph is captioned "Part of House Staff" in small black text at the bottom.
  • The background of the photograph appears to be a porch or veranda, with trees and buildings visible in the distance.

Photograph 2: Ambulance House View from Yard

  • The photograph on the right depicts a gazebo or pavilion in a yard, with an ambulance house visible in the background.
    • The gazebo has a pointed roof and a decorative lattice screen surrounding it.
    • A ladder leans against the side of the gazebo.
    • The photograph is captioned "Ambulance House View from Yard" in small black text at the bottom.
  • The background of the photograph shows a yard with trees and other buildings visible in the distance.

Additional Details

  • The photographs appear to be from the early 20th century, based on the clothing and hairstyles of the individuals depicted.
  • The photographs are mounted on a piece of paper or cardboard, with a slight crease visible in the center.
  • The overall appearance of the photographs suggests that they were taken for official purposes, such as documenting the staff and facilities of Harlem Hospital.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image presents a vintage page from an album or scrapbook, featuring two black-and-white photographs. The top of the page displays the title "Harlem Hospital, Manhattan" in bold text, accompanied by smaller text that reads "(New York City Almshouse System)".

The left photograph depicts three individuals sitting on a porch, with a woman standing behind them. The right photograph shows a gazebo situated in a yard, with a house visible in the background. Both images are labeled with handwritten text at the bottom, although the text is difficult to read due to its faded nature.

The page itself has a light gray color and appears to be slightly torn at the top left corner. Overall, the image provides a glimpse into the past, showcasing the architecture and people associated with Harlem Hospital during a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image appears to be a collage of two photographs. The first photograph on the left depicts a group of people sitting on a porch. It is labeled "PARTHOUSE STAFF." The second photograph on the right shows a gazebo with a pathway leading to it. It is labeled "STARKES" and "AMBULANCE HOUSE VIEW OF YARD." The image has a monochromatic filter applied, giving it a vintage or old-fashioned look. The collage is set against a plain background, likely a wall or a page.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a composite of two old photographs with captions below them. The top part of the image has a label that reads "Harlem Hospital, Manhattan (New York City Almshouse System)." The left photograph shows four people sitting on a porch, with a woman standing in the middle. The right photograph depicts a gazebo with a pathway leading to it, surrounded by trees and grass. Both photographs have a vintage look and feel.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

The image is a photograph of two sepia-toned images affixed to a light grey background. Above the photographs is text that reads "Harlem Hospital, Manhattan" and below it in smaller letters "New York City Almsbouse System". Each photograph has a number in the top corner: 318 for the one on the left, 320 for the one on the right.

The photograph on the left shows four people posed outside on a porch. Two men are seated. The man on the left wears a dark suit and holds a bowler hat. The man on the right wears a similar suit and holds a pair of glasses. Standing behind them are a woman in a white dress and a man in a dark suit. The porch has a railing and columns. Text beneath the image reads "PART HOUSE STAFF".

The photograph on the right depicts a gazebo on a grassy lawn. Behind the gazebo is a building. In the distance, there is a structure labeled "STABLES". There are trees in the yard. Text beneath the image reads "AMBULANCE HOUSE VIEW PYARD".

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

This is a vintage black and white photograph presented in a scrapbook-style format. The photograph features two separate images.

The first image on the left shows a group of five people posed on a porch. Three men and a woman are seated, while one man stands. They appear to be dressed in formal attire appropriate for the late 19th or early 20th century. The porch has a balustrade railing and the background reveals trees and another building, suggesting the location is a residence or public building. Below the image, it is labeled "PART HOUSE STAFF."

The second image on the right side depicts the "AMBULANCE HOUSE VIEW OF YARD". It features a decorative gazebo-like structure, surrounded by an open area with what appears to be a garden. Some fencing and trees are visible. The label "STABLES" is located under the gazebo.

The top of the page includes the title "Harlem Hospital, Manhattan (New York City Almshouse System)" printed in all caps, indicating this is a historical documentation, likely from an archive or collection of photographs. The photograph's style and subject matter create an authentic feeling, suggesting documentation of the hospital’s staff, buildings, and grounds.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image is a historical photograph from Harlem Hospital in Manhattan, New York City. It is divided into two sections, each depicting a different scene.

  1. Left Section (Photo 318):

    • This photo shows a group of hospital staff posing on the porch of a building, likely the "Path House."
    • There are five individuals in the photo: three men and two women.
    • The individuals are dressed in formal attire, with the men in suits and the women in dresses and hats, indicative of the fashion of the early 20th century.
    • The setting appears to be outdoors, with trees and another building visible in the background.
  2. Right Section (Photo 320):

    • This photo depicts the exterior of the "Ambulance House," which is a small, standalone structure.
    • The building has a distinctive, decorative design with lattice work and a peaked roof.
    • In front of the building, there are stables with horses visible inside.
    • The scene is set in a yard with some trees and a fence in the background.

The overall tone of the images suggests a historical context, likely from the early 20th century, capturing the architecture and staff of Harlem Hospital during that period.

Qwen

No captions written

Text analysis

Amazon

Harlem
Manhattan
Harlem Hospital. Manhattan
Hospital.
(New
Sytem)
Almowe
PURTHOUSE STAFY
VIEWOrYARD
City Almowe
City

Google

Harlem Hospital, Manhattan (New York City Almbouse Systrm) 18 AMBULANCE Houst VIEWrYARD STALES PARTHOUSE STAFF
Harlem
Hospital,
Manhattan
(New
York
City
Almbouse
Systrm)
18
AMBULANCE
Houst
VIEWrYARD
STALES
PARTHOUSE
STAFF