Human Generated Data

Title

Charity, Children: United States. New York. New York City. Randall's Island, Infants' Hospital: Infants

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.133

Human Generated Data

Title

Charity, Children: United States. New York. New York City. Randall's Island, Infants' Hospital: Infants

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.133

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Art 93.6
Canvas 88.5
Human 78.8
Person 78.8
Person 78
Home Decor 77.1
Person 74.7
Painting 72
Person 67.5
Person 67.3
Art Gallery 62.3
Person 58.8
Person 57.2
Poster 56.4
Advertisement 56.4
Drawing 56.2
Modern Art 55.3

Clarifai
created on 2019-06-05

illustration 98.5
art 96
picture frame 94.1
no person 94
print 92.9
people 92.8
antique 91.4
vintage 91.2
indoors 90.9
old 90.8
desktop 90.5
business 89.9
retro 89.5
wall 89
window 89
house 88.9
family 88
inside 87.6
furniture 87
decoration 86

Imagga
created on 2019-06-05

old 23
paper 19.9
grunge 17
sketch 16.2
vintage 15.7
drawing 15.3
texture 14.6
blank 14.6
sconce 14.5
wall 13
frame 12.7
bracket 12.7
aged 12.7
design 12.5
retro 12.3
ancient 12.1
card 11.9
envelope 11.4
container 11.4
business 10.9
building 10.8
structure 10.5
architecture 10.4
support 10.3
symbol 10.1
decoration 9.9
representation 9.8
antique 9.7
stucco 9.7
object 9.5
empty 9.4
money 9.4
space 9.3
house 9.2
sign 9
black 9
device 9
board 8.9
art 8.8
ribbon 8.6
sculpture 8.6
gift 8.6
finance 8.4
banking 8.3
note 8.3
package 8.1
currency 8.1
chandelier 8
home 8
box 8
holiday 7.9
3d 7.7
travel 7.7
rusty 7.6
bill 7.6
investment 7.3
cash 7.3
wrapping 7.3
new 7.3
bank 7.3
present 7.3
insulating material 7.2
celebration 7.2

Google
created on 2019-06-05

Photograph 95.6
Picture frame 76.9
Painting 70.9
Room 65.7
Photography 62.4
Art 58.1
Illustration 50.4

Microsoft
created on 2019-06-05

room 98.8
scene 98
gallery 98
indoor 88.5
picture frame 81.1
painting 61.3
old 43
different 33.5
several 10.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-7
Gender Female, 50.5%
Angry 49.5%
Disgusted 49.5%
Sad 50.4%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 50.4%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 14-23
Gender Male, 54.6%
Calm 46.4%
Happy 47.1%
Confused 46.2%
Sad 47%
Angry 46.7%
Surprised 45.7%
Disgusted 45.9%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Angry 49.7%
Disgusted 49.5%
Sad 49.6%
Calm 49.9%
Happy 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 9-14
Gender Female, 50.4%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.6%
Sad 50.3%
Confused 49.5%

AWS Rekognition

Age 1-5
Gender Female, 54.5%
Surprised 45%
Angry 45.1%
Disgusted 45%
Happy 45%
Calm 45%
Sad 54.8%
Confused 45.1%

AWS Rekognition

Age 4-9
Gender Female, 50.3%
Sad 49.8%
Disgusted 49.6%
Calm 49.7%
Confused 49.5%
Angry 49.9%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Sad 49.8%
Angry 49.6%
Happy 49.7%
Disgusted 49.5%
Calm 49.8%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.3%
Surprised 49.5%
Sad 50.5%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Happy 49.9%
Sad 50%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Angry 49.5%
Calm 50%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 49.9%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 53.2%
Angry 45.6%
Confused 46%
Calm 48.2%
Surprised 45.5%
Sad 49.2%
Happy 45.4%
Disgusted 45.2%

AWS Rekognition

Age 4-7
Gender Female, 50.1%
Happy 45.1%
Surprised 45.1%
Angry 45.1%
Calm 45.4%
Sad 54.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 17-27
Gender Female, 50.1%
Happy 49.5%
Disgusted 49.5%
Angry 49.6%
Confused 49.6%
Calm 49.8%
Surprised 49.7%
Sad 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50.2%
Angry 49.6%
Confused 49.6%
Happy 49.6%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 2-5
Gender Female, 50.3%
Calm 49.5%
Happy 50%
Confused 49.5%
Sad 49.8%
Angry 49.5%
Surprised 49.6%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Confused 45.5%
Disgusted 45.3%
Sad 47%
Surprised 46.9%
Calm 46%
Angry 46%
Happy 48.4%

AWS Rekognition

Age 20-38
Gender Male, 50%
Calm 49.7%
Confused 49.6%
Sad 49.8%
Surprised 49.6%
Happy 49.5%
Disgusted 49.6%
Angry 49.7%

AWS Rekognition

Age 30-47
Gender Female, 50.2%
Happy 49.6%
Sad 49.5%
Angry 49.5%
Surprised 49.6%
Calm 50.1%
Confused 49.7%
Disgusted 49.5%

Feature analysis

Amazon

Person
Person 78.8%
Person 78%
Person 74.7%
Person 67.5%
Person 67.3%
Person 58.8%
Person 57.2%

Categories

Imagga

interior objects 79.9%
paintings art 19.1%

Captions

Microsoft
created by unknown on 2019-06-05

a display in a room 71.1%
an old photo of a room 62.9%
an old photo of a person in a room 48.6%

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people sitting on steps with a man in a suit and tie -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows a group of infants dressed in white garments sitting on the steps of a building with a grand entrance. The architecture in the background features columns and a large doorway, and there are railings on either side of the stairs. The word "INFANTS" is typed below the photograph on the gray border.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a group of infants sitting on the steps in front of a grand architectural building. The children are dressed in white garments and are arranged in rows on the stairs leading up to an entrance. The building features tall columns and brickwork, suggesting a formal or institutional setting. The photograph is mounted on a mat board and labeled with the word "INFANTS" beneath the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of infants sitting on the steps of what appears to be a building. The infants are all dressed in white clothing and are seated in rows on the steps. The building in the background has arched windows and a grand entrance. The image is in black and white, indicating it is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical black and white photograph labeled "INFANTS" showing a group of very young children, all dressed in white clothing, arranged on what appears to be steps or stairs of what could be an institutional building, possibly an orphanage, school, or care facility. The setting has architectural features like columns and arches visible in the background. The children appear to be roughly the same age, likely toddlers, and are all wearing similar white dresses or gowns, which was common for very young children in the early 20th century regardless of gender. The image has an institutional, formal quality typical of documentary photography from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a vintage photograph of a group of infants sitting on the steps of a building, likely a hospital or orphanage. The photo is in sepia tone and features 19 infants, all dressed in white, arranged in three rows on the steps. The infants are seated in various positions, with some holding toys or objects. The background of the photo shows the entrance to the building, with a large doorway and a staircase leading up to it.

The overall atmosphere of the photo suggests a sense of innocence and vulnerability, as the infants are depicted in a state of quiet contemplation. The use of sepia tone adds a sense of nostalgia and timelessness to the image, evoking a feeling of a bygone era. The photo appears to be a formal portrait, possibly taken for documentation or commemorative purposes.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a sepia-toned photograph of a group of infants sitting on the steps of a building. The infants are dressed in white clothing and are arranged in three rows, with some sitting on the steps and others standing behind them. The background of the image shows the entrance to the building, which appears to be a large stone structure with a doorway and windows.

The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly at an orphanage or other institution for children. The sepia tone gives the image a nostalgic and vintage feel, while the arrangement of the infants on the steps creates a sense of order and structure.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

This image is a vintage photograph featuring a group of infants, all dressed in white dresses. They are seated on the stairs of a building, creating a sense of order and organization. The infants are arranged in rows, with some of them sitting on chairs. The image has a monochromatic filter, giving it an old-fashioned look. The word "INFANTS" is written at the bottom of the image, indicating the subject of the photograph.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The image shows a group of children, probably infants, sitting on the steps of a building. The children are dressed in white clothing. The image is black and white, and it is probably old. The image is mounted on a gray background. The word "INFANTS" is written in the bottom center of the image. The children are sitting on the steps of a building with a balcony and a staircase.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

Overall Impression:

The image is a sepia-toned photograph of a group of infants posed on a set of steps in front of a building. It appears to be an old photograph, possibly from the early 20th century.

Composition and Subject Matter:

  • Main Subject: The central focus is a group of infants, arranged on the steps of a building. They are all dressed in similar white dresses or gowns.
  • Arrangement: The babies are posed on the steps, some seated on small chairs or stools and some sitting directly on the steps. They are positioned in rows, creating a structured, formal arrangement.
  • Background: The background features the entrance of a building, possibly a church or institution, with large columns, arched doorways, and what appear to be tall windows or alcoves on either side. There is also a balustrade on the side.

Details:

  • Clothing: All the infants are wearing white outfits, giving a uniform look.
  • Tone: The photograph has a vintage, historical feel due to the sepia tones and the subjects.
  • Inscriptions: The word "INFANTS" is written in capital letters below the photograph.

Overall Atmosphere:

The photograph evokes a sense of formality, history, and the innocence of childhood. It's a snapshot capturing a moment in time with a group of young children.

Created by gemini-2.0-flash on 2025-05-25

The image shows a vintage photograph of a group of infants, presumably taken in the early 20th century. The black and white photo is placed on a larger gray paper background, and the word "INFANTS" is printed beneath it.

The infants are arranged in rows on the steps of a building with a large arched doorway behind them. Most of the infants are sitting, each dressed in white clothing, which was a common style for babies at the time. Some of the babies are sitting on small chairs, elevating them slightly.

The composition of the photograph and the subject matter suggest a formal portrait, possibly taken at a religious or charitable institution that cared for infants. The presence of a woman standing on the right side of the image, near the banister, further supports this idea, as she might be a caregiver or a member of staff.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a group of infants seated on a set of stairs in what appears to be a formal or ceremonial setting, possibly a church or a similar institution. The infants are dressed in long, white gowns, which are typical attire for baptisms or christenings. The photograph is in sepia tones, indicating it is an old picture, likely from the late 19th or early 20th century.

The infants are arranged in three rows:

  1. The top row has six infants seated on chairs.
  2. The middle row has five infants seated directly on the steps.
  3. The bottom row has six infants also seated on the steps.

There is a young boy standing to the right side of the bottom row, dressed differently from the infants, possibly in a suit. He is holding what appears to be a cane or a walking stick. The background features large, arched windows and brick walls, reinforcing the impression that the setting is a formal or religious building.

The word "INFANTS" is printed below the photograph, indicating the subject of the picture. The image is mounted on a gray cardboard backing, with two white tabs on the left side, suggesting it might be part of a photo album or a similar collection.

Text analysis

Amazon

INFANTS

Google

INFANTS
INFANTS