Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.: Glimpses of the Vacation Playgrounds

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3573.9

Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.: Glimpses of the Vacation Playgrounds

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3573.9

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 91.8
Outdoors 79.7
People 78.4
Nature 77.3
Building 69.5
Art 65.6

Clarifai
created on 2019-06-05

calamity 98.6
people 97.7
battle 97.1
no person 96
storm 96
military 95.1
vehicle 94.1
war 92
building 90.8
flood 90.2
transportation system 89.2
home 88.6
road 88.3
group 88
architecture 87.9
weather 87.8
adult 87.2
daylight 85.4
landscape 85
demolition 84.8

Imagga
created on 2019-06-05

snow 55.8
landscape 32.7
sky 31.6
weather 31.4
beach 23.9
travel 21.1
sea 21.1
sand 20.5
ocean 20.3
parking meter 19.7
tourism 17.3
tree 16.3
winter 16.2
coast 16.2
timer 15.6
clouds 15.2
building 14.4
shore 14.2
cold 13.8
horizon 13.5
outdoor 13
water 12.7
structure 12.4
timepiece 11.9
old 11.9
architecture 11.8
road 11.8
scenery 11.7
park 11.5
wave 11.2
cloud 11.2
summer 10.9
trees 10.7
industry 10.3
city 10
tourist 9.8
wall 9.4
desert 9.3
outdoors 9.1
tower 9.1
vacation 9
rural 8.8
seascape 8.6
construction 8.6
cityscape 8.5
bay 8.5
power 8.4
environment 8.2
industrial 8.2
measuring instrument 8.1
man 8.1
scenic 7.9
urban 7.9
day 7.9
rock 7.8
people 7.8
scene 7.8
empty 7.7
surf 7.7
frost 7.7
paradise 7.5
field 7.5
coastline 7.5
house 7.5
wood 7.5
ice 7.4
island 7.3
seaside 7.2
river 7.1
season 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

ground 99.3
outdoor 97.7
old 69.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-23
Gender Female, 50.4%
Surprised 49.6%
Confused 49.6%
Sad 49.6%
Calm 49.7%
Disgusted 49.7%
Happy 49.7%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Confused 49.5%
Sad 50.4%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Confused 49.5%
Surprised 49.6%
Angry 49.6%
Calm 49.6%
Sad 50%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Calm 50%
Disgusted 49.5%
Angry 49.7%
Surprised 49.5%
Happy 49.5%
Sad 49.7%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Sad 49.6%
Disgusted 49.5%
Calm 49.6%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Happy 50.1%

AWS Rekognition

Age 11-18
Gender Female, 50.5%
Happy 49.7%
Calm 49.6%
Confused 49.6%
Angry 49.7%
Disgusted 49.7%
Sad 49.7%
Surprised 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Confused 49.6%
Disgusted 49.5%
Calm 49.6%
Angry 49.5%
Happy 49.6%
Surprised 49.5%
Sad 50.1%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Calm 49.9%
Disgusted 49.5%
Sad 49.9%
Angry 49.6%
Happy 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50%
Disgusted 49.5%
Confused 49.5%
Angry 49.9%
Happy 49.5%
Calm 50%
Surprised 49.5%
Sad 49.6%

Feature analysis

Amazon

Person
Painting

Clarifai

Person
Building

AWS Rekognition

Person 91.8%

AWS Rekognition

Person 88.6%

AWS Rekognition

Person 85.5%

AWS Rekognition

Person 69.2%

AWS Rekognition

Person 64.2%

AWS Rekognition

Person 59.6%

AWS Rekognition

Person 58.4%

AWS Rekognition

Person 42.7%

AWS Rekognition

Painting 65.6%

Clarifai

Person 80.8%

Clarifai

Person 64.4%

Clarifai

Person 62.8%

Clarifai

Person 61.8%

Clarifai

Person 60.8%

Clarifai

Person 53%

Clarifai

Person 50.6%

Clarifai

Person 46.8%

Clarifai

Person 43%

Clarifai

Person 41.4%

Clarifai

Person 37.4%

Clarifai

Person 37%

Clarifai

Person 35.3%

Clarifai

Person 33.8%

Clarifai

Person 33.2%

Clarifai

Building 55.6%

Clarifai

Building 51.6%

Clarifai

Building 36.2%

Categories

Imagga
created on 2019-06-05

beaches seaside 94.5%
streetview architecture 3.1%
nature landscape 1.7%

Captions

Microsoft
created by unknown on 2019-06-05

an old photo of a city 81.2%
an old photo of a building 79.4%
old photo of a building 75.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people standing around a fence

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a group of people standing around a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This photo depicts a group of people outdoors, seemingly engaged in activity on a street or open space. The group consists of men and boys, many dressed in casual clothing such as shirts and caps, with some appearing to be laborers. They are gathered together in a seemingly chaotic scene near some construction materials or debris.

In the foreground, a paved area with bricks and scattered items leads to the group. A gate on the left and larger wooden structures add a sense of division or boundary to the space. Behind the gathering, there is a stark white wall and a taller dark brick building, creating a contrast in tones.

The image appears to capture mid-19th to early 20th-century urban life, possibly showing workers or a confrontation of some kind.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a group of mostly African American men gathered in an open area that appears to be an urban street or vacant lot. The men are engaged in what seems to be a confrontation or an act of defense. Some are standing, and others are crouched, holding sticks or makeshift weapons at the ready. In the foreground, there is debris scattered on the ground, possibly indicating previous unrest. The scene is framed by buildings on either side, one of which is a tall brick structure that casts a shadow. The activity and urgency in the image hint at a moment of tension, possibly related to civil unrest or a riot.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to be a historical photograph depicting a group of people, likely workers or laborers, gathered in an outdoor urban setting. The scene shows a group of men, some wearing hats and work clothes, standing or sitting together in what seems to be a construction site or work area. The buildings and structures in the background suggest an industrial or working-class neighborhood. The overall tone of the image conveys a sense of community and camaraderie among the individuals depicted.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This appears to be a vintage black and white photograph showing a group of people gathered in what looks like an urban setting or courtyard. The scene is framed by brick buildings and walls in the background, with a large white wall or surface visible. There appears to be some construction or work activity taking place, as there are various materials and debris scattered on the ground. The group of people are lined up or gathered along one of the walls. The photo has the grainy, slightly faded quality typical of early 20th century photography. There's also what appears to be an iron fence or gate visible on the left side of the image.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a group of children in a city street, likely from the late 19th or early 20th century. The children are gathered in a courtyard or alleyway, surrounded by buildings and debris. They appear to be engaged in various activities, such as playing, working, or simply standing around.

The image is a sepia-toned photograph, which suggests that it was taken using an older photographic process. The quality of the image is somewhat grainy and faded, but it still conveys a sense of the children's energy and vitality.

In the background, there are several buildings, including what appears to be a brick factory or warehouse. The buildings are old and worn, with crumbling facades and broken windows. The overall atmosphere of the image is one of poverty and neglect, with the children seemingly living in difficult circumstances.

Despite the challenges they face, the children in the image appear to be resilient and resourceful. They are dressed in simple clothing, but they seem to be making the most of their situation. Some of them are playing with makeshift toys or games, while others are working together to accomplish tasks.

Overall, the image provides a poignant glimpse into the lives of urban children during a time of great social and economic upheaval. It highlights the challenges they faced and the ways in which they adapted to their circumstances, and it serves as a powerful reminder of the importance of supporting and empowering vulnerable populations.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a sepia-toned photograph of a group of children gathered in an urban setting, likely during the early 20th century. The scene appears to be a courtyard or alleyway, with a large brick building on the right side and a fence on the left. The children are dressed in casual clothing, including hats and shirts, and seem to be engaged in various activities such as playing, talking, or simply standing around.

In the foreground, there are some objects scattered on the ground, including what appears to be a wheelbarrow and some tools. The overall atmosphere of the image suggests a sense of community and playfulness among the children, who seem to be enjoying each other's company in this urban environment.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a monochromatic photograph depicting a group of individuals engaged in what appears to be construction work. They are situated in an outdoor area that resembles a construction site, with visible tools and materials scattered around. The workers are dressed in hats and work clothes, indicative of manual labor. Some of them are standing, while others are kneeling or sitting, suggesting various stages of their work.

In the background, there are structures that could be buildings or construction supports, hinting at an urban setting. The ground appears uneven, with patches of dirt and small stones, typical of a construction environment. The overall atmosphere is one of activity and labor, with the workers focused on their tasks.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The vintage black-and-white photo shows a group of people gathered in an open area. Some of them are wearing hats, and some are wearing long sleeves. They seem to be working on the ground, with some of them holding tools. The ground is covered with dirt and small stones. A building with a tall wall is on the right side. A fence is on the left side, and a gate is in front of it.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

Overall Impression:

The image is a vintage photograph, likely from the early 20th century, depicting a group of people gathered in an outdoor setting. The image has a sepia tone, giving it a warm, historical feel.

Composition and Setting:

  • The main focus of the image is a group of people, mostly children and young adults.
  • They are standing on a large, open area that appears to be paved with bricks or similar material.
  • Behind the group are two large buildings, one with a plain, light-colored facade, and the other constructed of dark brick.
  • There is a low fence and some wooden structures in the scene.
  • The lighting suggests a sunny day.

People:

  • The group appears to be made up of both men and women. They may be a part of the construction of the building.
  • The individuals are dressed in simple clothing typical of the time period, including caps, shirts, and pants or skirts.
  • The group seems to be posing for a photograph. Some are waving, while others are standing still or sitting.

Atmosphere:

The overall atmosphere is one of camaraderie and perhaps a sense of community. It gives off a historical feeling.

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

The image is an old sepia-toned photograph that shows a group of young people standing in a partially enclosed outdoor space. The setting appears to be urban, given the presence of a tall, light-colored building or wall on the left and a darker brick building to the right.

In the foreground, the ground is a textured surface of brick or paving stones. Scattered across this area are loose bricks or pieces of debris. To the left, a metal structure (possibly a bench or part of a fence) casts a long, linear shadow, creating a stark contrast in the foreground.

The group of young people are gathered towards the middle of the frame. Most of them appear to be boys or young men, and they are dressed in a variety of clothing that seems typical for the period of the photograph. Some are wearing hats or caps. Many of the figures are gesturing or looking towards the camera, suggesting that they are aware of being photographed.

The overall mood of the image is somewhat candid and documentary, as if the photograph was taken to capture a moment in the lives of these young people. The lighting is flat, which is typical of old photographs taken on a sunny day. The quality of the print is aged, with some imperfections and tonal variations that add to its historical character.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a group of people, likely children and young adults, gathered on a rooftop in an urban setting. The scene appears to be from an earlier time period, possibly the early to mid-20th century, given the style of clothing and the quality of the photograph.

Key details include:

  1. Location: The rooftop setting is surrounded by brick buildings, suggesting an urban environment, possibly in a densely populated city area.
  2. People: The group consists of children and young adults. They are dressed in casual clothing, with some wearing shorts and light shirts, indicating warm weather.
  3. Activities: The individuals seem to be engaged in various activities. Some are standing and talking, while others appear to be sitting or playing.
  4. Structures: There are makeshift structures on the rooftop, including what looks like a wooden platform or stage, and some barriers or fences.
  5. Atmosphere: The overall mood seems relaxed and social, with people enjoying each other's company in an open-air setting.

The image captures a moment of community and leisure in an urban environment, reflecting a simpler time when rooftops were used as social spaces.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-16

The image appears to be a vintage photograph, likely from the early 20th century, showing a group of children playing on a street or alleyway. The children are spread out across the scene, engaging in what looks like a game or activity involving wooden planks or barricades. Some of them are standing, while others are sitting on the ground or leaning against the barricades. The street is paved with cobblestones, and there are various objects scattered around, including a small metal gate on the left side of the image and some debris on the ground. The backdrop includes a tall brick building and a partially visible structure on the right side, suggesting an urban environment. The overall atmosphere is casual and lively, capturing a moment of play in what seems to be a working-class neighborhood.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-16

This image appears to be a historical photograph, likely from the early 20th century, showing a group of children playing in an urban setting. The scene is in black and white, giving it a vintage look. The children are dressed in clothing typical of that era, with some wearing hats and others in short-sleeved shirts and shorts.

The area where they are playing looks like a paved courtyard or an open space between buildings. There are some objects scattered on the ground, possibly toys or debris. The children are engaged in various activities; some are standing, others are sitting, and a few seem to be in motion, suggesting they are actively playing. In the background, there is a tall brick building, and to the left, there is a gate and a staircase leading up to another building. The overall atmosphere of the image suggests a lively and energetic scene from a bygone era.

Text analysis

Amazon

A