Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: Outside the Gymnasium

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2897.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: Outside the Gymnasium

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2897.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.6
Human 99.6
Person 99.5
Person 99.2
Person 99
Person 98.5
Person 98.1
Person 97.6
Person 97.3
Person 96.3
People 95.7
Person 95.5
Person 95.3
Person 94.6
Person 91.4
Military 90.7
Military Uniform 90.7
Armored 88.6
Army 88.6
Person 88.1
Apparel 85.2
Clothing 85.2
Helmet 85.2
Person 84.3
Nature 80.5
Soldier 76.3
Person 75.1
Person 70.5
Team 66.7
Outdoors 65.5
Countryside 63.8
Troop 59.2
Rural 59
Person 53.4
Person 44

Clarifai
created on 2019-06-05

people 100
military 99.3
many 98.7
group together 98.6
soldier 98.5
administration 98.5
group 98.4
uniform 97.9
war 97.9
adult 97.7
military uniform 94.8
outfit 94
man 93.1
leader 92.8
wear 92
child 91.9
rifle 87.2
weapon 86.4
boy 86.4
police 86.1

Imagga
created on 2019-06-05

military uniform 82.9
uniform 68.5
clothing 49.7
consumer goods 33.3
city 31.6
covering 31.6
architecture 26.5
building 25.4
old 21.6
street 21.1
tourism 19.8
travel 19
urban 17.5
wall 17.1
commodity 16.6
ancient 16.4
military 16.4
private 16.2
town 15.8
statue 15.5
historic 14.7
stone 14.6
history 14.3
door 13.4
soldier 12.7
sculpture 12.5
war 12.5
monument 12.1
house 11.8
army 11.7
religion 11.6
historical 11.3
culture 11.1
structure 11.1
window 10.7
brick 10.3
cemetery 10.2
gun 10.1
industrial 10
dirty 9.9
landmark 9.9
helmet 9.5
church 9.2
art 9.1
road 9
transportation 9
weapon 8.8
antique 8.6
construction 8.5
tourist 8.4
famous 8.4
vacation 8.2
man 8.1
facade 7.9
conflict 7.8
warrior 7.8
male 7.8
arch 7.7
industry 7.7
exterior 7.4
danger 7.3
aged 7.2

Google
created on 2019-06-05

People 94.3
Team 70.5
History 66.1
Crew 52.6
Family 52.5

Microsoft
created on 2019-06-05

clothing 98.5
posing 97.6
person 95.3
military uniform 94.4
group 92
outdoor 89.1
old 84.2
man 70.8
footwear 69.8
smile 66.6
clothes 16.2

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 9-14
Gender Female, 54.4%
Disgusted 45.3%
Calm 51.5%
Surprised 45.3%
Sad 46.9%
Confused 45.1%
Angry 45.4%
Happy 45.6%

AWS Rekognition

Age 16-27
Gender Male, 52.9%
Sad 47.8%
Confused 45.1%
Calm 51.6%
Disgusted 45.2%
Happy 45.2%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.9%
Sad 46%
Confused 45.1%
Calm 51.1%
Disgusted 45.9%
Happy 45.2%
Angry 46.3%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Surprised 45.2%
Confused 45.3%
Sad 47.2%
Disgusted 45.4%
Calm 49%
Angry 47.9%
Happy 45.1%

AWS Rekognition

Age 4-9
Gender Female, 53.2%
Calm 45%
Angry 45.2%
Disgusted 45%
Sad 54.6%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 38-57
Gender Female, 51.1%
Happy 45.1%
Surprised 45.2%
Calm 48.4%
Angry 45.3%
Confused 45.1%
Sad 50.5%
Disgusted 45.4%

AWS Rekognition

Age 4-9
Gender Female, 52.6%
Calm 48.4%
Happy 45.5%
Angry 48.5%
Sad 46.4%
Surprised 45.3%
Confused 45.1%
Disgusted 45.7%

AWS Rekognition

Age 10-15
Gender Male, 50.9%
Surprised 45.6%
Confused 45.8%
Sad 50.8%
Disgusted 45.5%
Calm 46%
Angry 45.6%
Happy 45.8%

AWS Rekognition

Age 48-68
Gender Female, 54%
Confused 45%
Angry 45%
Disgusted 45.1%
Surprised 45%
Sad 45%
Happy 54.5%
Calm 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51.7%
Surprised 45%
Confused 45%
Sad 54.5%
Calm 45%
Happy 45%
Disgusted 45%
Angry 45.4%

AWS Rekognition

Age 20-38
Gender Male, 53%
Angry 45.3%
Disgusted 45.2%
Sad 45.8%
Confused 45.1%
Happy 45.1%
Surprised 45.2%
Calm 53.2%

AWS Rekognition

Age 35-52
Gender Female, 52.5%
Confused 45.1%
Calm 45.4%
Angry 45.1%
Sad 46%
Happy 53.2%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Disgusted 45.1%
Confused 45.1%
Angry 52.7%
Calm 45.2%
Surprised 45.1%
Happy 45.1%
Sad 46.8%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Confused 45%
Calm 45%
Angry 45.2%
Sad 54.7%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Calm 52.5%
Surprised 45.4%
Disgusted 45.2%
Confused 45.2%
Happy 45.4%
Angry 45.4%
Sad 45.9%

AWS Rekognition

Age 10-15
Gender Female, 52.2%
Disgusted 45.2%
Confused 45.2%
Angry 45.4%
Calm 47.6%
Surprised 45.2%
Happy 45.4%
Sad 51.1%

AWS Rekognition

Age 35-52
Gender Female, 51.8%
Surprised 45.1%
Confused 45.2%
Happy 45.1%
Angry 45.3%
Calm 46.4%
Sad 52.4%
Disgusted 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Disgusted 45.6%
Calm 46.1%
Surprised 45.3%
Angry 45.8%
Sad 51.5%
Confused 45.3%
Happy 45.4%

AWS Rekognition

Age 29-45
Gender Male, 54.3%
Sad 53.4%
Disgusted 45.2%
Angry 46%
Surprised 45%
Calm 45.1%
Confused 45.2%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.1%
Angry 51.9%
Surprised 45.3%
Confused 45.1%
Sad 46%
Disgusted 45.6%
Happy 45.8%
Calm 45.2%

AWS Rekognition

Age 17-27
Gender Female, 51.8%
Confused 45.3%
Calm 47.3%
Happy 45.2%
Surprised 45.2%
Sad 50.9%
Angry 45.8%
Disgusted 45.3%

AWS Rekognition

Age 16-27
Gender Male, 54.7%
Surprised 45.3%
Calm 46.2%
Happy 45.1%
Sad 48.1%
Confused 46.6%
Angry 48.2%
Disgusted 45.5%

AWS Rekognition

Age 11-18
Gender Female, 52.1%
Surprised 45.1%
Sad 46.1%
Happy 45.1%
Disgusted 45.1%
Confused 45.1%
Calm 46.5%
Angry 51.9%

AWS Rekognition

Age 11-18
Gender Female, 54.8%
Happy 46.2%
Surprised 45.4%
Angry 45.8%
Sad 49.4%
Confused 45.3%
Disgusted 45.5%
Calm 47.5%

AWS Rekognition

Age 15-25
Gender Female, 54.1%
Sad 45.6%
Disgusted 45.2%
Surprised 45.1%
Angry 52.8%
Happy 45.5%
Calm 45.7%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 54%
Confused 45.1%
Calm 45.1%
Disgusted 45.1%
Happy 45.1%
Angry 45.5%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Angry 45.4%
Happy 45.2%
Disgusted 46.9%
Sad 45.2%
Confused 45.1%
Calm 52%
Surprised 45.2%

AWS Rekognition

Age 10-15
Gender Male, 51.8%
Disgusted 45%
Surprised 45.1%
Angry 45.3%
Confused 45.1%
Sad 45.1%
Calm 54.3%
Happy 45.1%

AWS Rekognition

Age 4-7
Gender Female, 52.6%
Sad 45.1%
Angry 54%
Calm 45.3%
Confused 45%
Happy 45.4%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 11-18
Gender Male, 51.2%
Sad 51.3%
Angry 46.5%
Calm 46.1%
Confused 45.6%
Happy 45.1%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Calm 47.6%
Angry 49.4%
Disgusted 45.1%
Sad 47.3%
Surprised 45.1%
Happy 45.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Calm 45.9%
Angry 45.4%
Disgusted 45.2%
Sad 51.8%
Surprised 45.3%
Happy 46.2%
Confused 45.2%

AWS Rekognition

Age 9-14
Gender Female, 54.6%
Confused 45.1%
Calm 45.2%
Angry 45.1%
Sad 45.4%
Happy 53.3%
Disgusted 46%
Surprised 45.1%

AWS Rekognition

Age 38-57
Gender Male, 53.2%
Surprised 45.2%
Happy 45.2%
Confused 45.1%
Sad 45.8%
Calm 47.7%
Disgusted 48.1%
Angry 47.8%

Microsoft Cognitive Services

Age 17
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Helmet
Person 99.6%
Person 99.5%
Person 99.2%
Person 99%
Person 98.5%
Person 98.1%
Person 97.6%
Person 97.3%
Person 96.3%
Person 95.5%
Person 95.3%
Person 94.6%
Person 91.4%
Person 88.1%
Person 84.3%
Person 75.1%
Person 70.5%
Person 53.4%
Person 44%
Helmet 85.2%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of children in uniform posing for a picture -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This is a vintage photo featuring a group of children, mostly boys, gathered on steps outside a building. The children are wearing dark-colored, winter-appropriate clothing typical of the early 20th century, with heavy coats and boots. Some hold books or other items, suggesting a school or community gathering. One child in the center stands with crutches, drawing attention. The architecture of the building in the background includes wooden panels and brick, with double doors visible at the top of the stairs. A smaller wooden structure is seen on the left, while the right side reveals part of an outdoor covered area, possibly a courtyard or porch. The overall tone of the image is historic and somber.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a group of children, mostly boys, posed for a group photo on steps outside a building with brick walls. They are dressed in warm, worn clothing typical of the late 19th or early 20th century, including coats, knickerbockers, and boots. A few boys are holding objects such as books or papers. One boy is prominently seated at the front center of the group, using crutches. The setting appears to be an urban or industrial environment, possibly near factories or workhouses, as suggested by the architectural features and the utilitarian clothing of the children.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a group of children gathered on the steps of a building, with some standing and others sitting. The children are dressed in winter clothing, including coats, hats, and boots. Some of them hold items such as a sled, a book, or a crutch.

In the background, there is a brick building with a wooden door and a staircase leading up to it. A man in a white shirt and pants stands to the left of the group, while another man in a dark coat and hat stands to the right, holding a sled.

The overall atmosphere of the image suggests that the children are waiting for something or someone, possibly a school bus or a teacher. The presence of the man with the sled implies that they may be preparing for a winter activity, such as sledding or snowball fighting.

The image appears to be an old photograph, possibly from the early 20th century, given the clothing and hairstyles of the children. The quality of the image is somewhat grainy and faded, but it still conveys a sense of nostalgia and warmth.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a group of children posing on the steps of a building. The children are dressed in dark coats and hats, with some wearing boots. They appear to be between the ages of 6 and 12.

In the foreground, a man stands on the left side of the image, wearing a light-colored shirt and dark pants. He has his hands on his hips and is looking at the camera. To the right of the man, a boy sits on the ground, holding a large piece of paper or cardboard.

The background of the image shows a brick building with a wooden door and a staircase leading up to it. The sky above is overcast, suggesting that the photo was taken on a cloudy day.

Overall, the image appears to be a vintage photograph of a group of children gathered outside a building, possibly a school or community center. The exact location and date of the photo are unknown, but it is likely from the early 20th century based on the clothing and hairstyles of the children.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of a group of children and an adult man standing on the stairs of a building. The children are dressed in winter clothes, including coats, hats, and boots. The adult man in the center of the image is holding a crutch and is wearing a hat. Some of the children are holding a piece of paper, and one of them is holding a shovel. The image has a watermark in the upper right corner that reads "Saf 3 18."

Created by amazon.nova-pro-v1:0 on 2025-06-06

A black-and-white photo of a group of children, mostly boys, standing and sitting on the stairs in front of a building. Some of them are wearing hats, shoes, and coats. One of them is holding a certificate, while the other is holding a stick. A man is standing on the left side, leaning on the door. A boy is standing on the right side, holding a rope. The photo has a watermark that reads "Saf 18."

Google Gemini

Created by gemini-2.0-flash on 2025-05-24

Here is a description of the image:

General Description:

The image is a vintage, black and white photograph featuring a large group of children and a couple of adults posing outside of what appears to be a schoolhouse or similar building. The composition is organized in a way that the children are arranged on steps, creating a tiered effect.

Details:

  • People: The majority of the subjects are young boys, all dressed in similar, modest, turn-of-the-century clothing. They mostly wear dark coats, caps, and knee-high socks. Some hold what appear to be drawings or certificates. An older man stands to the side. He's wearing working clothes.

  • Setting: The background building has a plain, functional look. A couple of doors with a building structure in the back. The area seems to be lightly covered with snow or slush.

  • Arrangement: The children are posed informally, some standing, some sitting, and some on different levels of the steps. There's a sense of a school class or organization group.

  • Quality/Style: The photograph has the characteristic grainy texture and tones of an old print. It exudes a sense of history and social documentation.

Notes:

  • There are some words in the top right that are not clear
  • One of the men has crutches.

Created by gemini-2.0-flash-lite on 2025-05-24

The image captures a black and white photograph of a group of young boys posing for a picture. The boys are all dressed in warm winter clothing, including coats, hats, and some are wearing boots. They are standing and sitting on steps in front of a wooden building. The photograph has an old-fashioned feel, giving the impression that it was taken some time ago. A man is standing to the left of the group. Some of the boys are holding up what appear to be drawings or papers. One boy is standing with the aid of crutches. The photo looks like it was taken outdoors on a possibly cold or snowy day.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a group of children and a few adults gathered outside a wooden building. The children are dressed in heavy winter clothing, including coats, hats, and boots, suggesting that the photograph was taken during the colder months. The children appear to be of varying ages, and some are seated on the steps, while others are standing or sitting on the ground.

A few notable details include:

  • Two children in the front row are holding crutches, indicating they may have mobility issues.
  • A child on the right side of the image is holding a sled, which is a common winter toy.
  • Some children are holding what appear to be papers or signs, although the text is not legible.
  • The adults in the image are standing to the sides and appear to be supervising the children.
  • The building behind them has a rustic appearance with wooden walls and a slanted roof.

The overall scene suggests a gathering or event, possibly related to a school or community activity, given the organized grouping and the presence of adults who seem to be in charge. The date "5.3.1918" is written in the top right corner, indicating that the photograph was taken on March 5, 1918.

Text analysis

Amazon

S