Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: En Route

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3043.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: En Route

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3043.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.8
People 95
Apparel 89
Clothing 89
Military Uniform 80.2
Troop 80.2
Armored 80.2
Army 80.2
Military 80.2
Crowd 70.3
Team 68.9
Shorts 67.4
Sports 61
Team Sport 61
Ballplayer 61
Softball 61
Baseball 61
Athlete 61
Sport 61
Hat 60.7
Cap 60.7
Soldier 56.7
Advertisement 55.2
Officer 55.1

Clarifai
created on 2019-06-06

people 100
group together 98.6
uniform 98.2
adult 98
group 97.6
wear 97.6
many 97.4
outfit 96.1
military 94.5
man 94.5
child 93.1
portrait 92.5
woman 91.5
administration 88.4
war 86.2
soldier 86.1
several 86
retro 85.4
recreation 84.5
leader 84.3

Imagga
created on 2019-06-06

military uniform 63.4
uniform 55.3
stretcher 37.8
clothing 37.2
litter 30.2
consumer goods 25.4
man 24.8
conveyance 22.8
covering 22.6
male 21.4
people 21.2
person 21.2
outdoors 19.4
athlete 18.8
helmet 17.3
ballplayer 15.9
sport 15.3
walking 15.1
player 14.9
beach 14.3
child 14.1
travel 14.1
adult 13.6
outdoor 13
commodity 12.7
sunset 12.6
military 12.5
innocent 12.4
danger 11.8
soldier 11.7
family 11.6
mountain 11.6
hiking 11.5
contestant 11.5
sky 11.5
boy 11.3
love 11
protection 10.9
army 10.7
vacation 10.6
together 10.5
couple 10.4
men 10.3
summer 10.3
two 10.2
lifestyle 10.1
leisure 10
active 9.9
kin 9.7
outside 9.4
happiness 9.4
water 9.3
field 9.2
ocean 9.1
recreation 9
father 8.9
destruction 8.8
parent 8.8
day 8.6
adventure 8.5
old 8.4
silhouette 8.3
fun 8.2
happy 8.1
autumn 7.9
armor plate 7.9
hiker 7.9
sand 7.9
sea 7.8
life 7.8
rock 7.8
portrait 7.8
nuclear 7.8
war 7.7
rifle 7.7
risk 7.7
walk 7.6
mother 7.4
landscape 7.4
holding 7.4
girls 7.3
gun 7.2
activity 7.2
dad 7.1

Google
created on 2019-06-06

Photograph 96.3
People 94.9
Snapshot 82.9
Photography 62.4
Team 59.4
Family 55.3
Art 50.2

Microsoft
created on 2019-06-06

outdoor 98.5
clothing 98.2
person 97.5
man 91.9
posing 88.6
standing 86.1
player 81.3
old 76
white 72.8
black 69.5
footwear 68.6
group 63.9
smile 52.1
team 33.1
crowd 1.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Surprised 45.1%
Happy 45.1%
Sad 46.2%
Angry 46.5%
Disgusted 45.6%
Confused 45.2%
Calm 51.2%

AWS Rekognition

Age 20-38
Gender Male, 52.4%
Confused 45.1%
Disgusted 45.1%
Calm 45.1%
Sad 52.6%
Angry 45.1%
Happy 47.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Angry 48.6%
Calm 46.7%
Sad 48.3%
Surprised 45.3%
Disgusted 45.8%
Happy 45.1%
Confused 45.3%

AWS Rekognition

Age 57-77
Gender Female, 53.6%
Confused 45.1%
Calm 45.1%
Disgusted 45.4%
Sad 53.9%
Happy 45.1%
Angry 45.4%
Surprised 45.1%

AWS Rekognition

Age 17-27
Gender Female, 52.6%
Disgusted 49.3%
Confused 45.3%
Surprised 45.1%
Calm 45.3%
Happy 45.4%
Angry 45.6%
Sad 49.2%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 45.2%
Happy 45.2%
Calm 45.4%
Disgusted 45.7%
Confused 45.3%
Sad 52.2%
Angry 45.9%

AWS Rekognition

Age 12-22
Gender Male, 52.8%
Disgusted 45.3%
Confused 45.2%
Calm 52.1%
Surprised 45.3%
Happy 45.1%
Sad 46.4%
Angry 45.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Angry 45.4%
Surprised 45%
Disgusted 45.1%
Calm 45.4%
Sad 53.9%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 54.1%
Sad 53.5%
Calm 45.5%
Happy 45.1%
Surprised 45.1%
Angry 45.8%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Surprised 45.1%
Happy 45.1%
Confused 45.1%
Calm 52.8%
Disgusted 46.1%
Sad 45.3%
Angry 45.4%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Poster

Clarifai

Tree
Footwear
Boy
Clothing
Human face
Man

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 93.3%

AWS Rekognition

Person 92.4%

AWS Rekognition

Person 84.6%

AWS Rekognition

Poster 55.2%

Clarifai

Tree 86.5%

Clarifai

Footwear 74.8%

Clarifai

Footwear 73.1%

Clarifai

Footwear 66%

Clarifai

Footwear 65.7%

Clarifai

Footwear 65.5%

Clarifai

Footwear 64.2%

Clarifai

Footwear 63.2%

Clarifai

Footwear 59%

Clarifai

Footwear 54.8%

Clarifai

Footwear 54.7%

Clarifai

Footwear 53.9%

Clarifai

Footwear 51.1%

Clarifai

Footwear 46.8%

Clarifai

Footwear 46.5%

Clarifai

Footwear 41.1%

Clarifai

Footwear 34.1%

Clarifai

Footwear 33.1%

Clarifai

Boy 67.1%

Clarifai

Boy 64.6%

Clarifai

Boy 57.8%

Clarifai

Boy 56.3%

Clarifai

Boy 54.3%

Clarifai

Boy 52.8%

Clarifai

Boy 51.2%

Clarifai

Boy 45.5%

Clarifai

Boy 36.5%

Clarifai

Clothing 61.4%

Clarifai

Clothing 43.2%

Clarifai

Clothing 41.9%

Clarifai

Clothing 37.4%

Clarifai

Human face 54.5%

Clarifai

Human face 43.4%

Clarifai

Human face 33.9%

Clarifai

Man 41.8%

Categories

Imagga
created on 2019-06-06

people portraits 89.4%
paintings art 8.8%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image features a group of young boys standing together outdoors in a wooded area. They are dressed uniformly in short-sleeve shirts, knee-length trousers, boots, and caps, suggesting they are part of a team or organization. Some are holding bags or canteens, indicating they may be preparing for a hike or outdoor activity. At the bottom of the photograph, the words "En Route" are written, further hinting they are embarking on a journey or adventure.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a group of nine young boys standing together outdoors, presumably in a wooded or natural setting, as suggested by the trees visible in the background. They are dressed in similar attire, wearing light-colored shirts, knee-length shorts, long socks, and boots, as well as carrying various small items like canteens or bags. The boys appear to be prepared for a hike or outdoor activity. The photograph is mounted on a mat with the handwritten words "En Route" beneath it, suggesting they are on a journey or adventure.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of young boys in outdoor attire, likely members of a scout or youth organization. They are standing together in a wooded area, with the text "En Route" written below the image. The boys appear to be dressed in similar uniforms, suggesting they are part of the same group or organization. The image has a vintage, black and white aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage black and white photograph of a Boy Scout troop. The scouts are lined up in a row, wearing their traditional scout uniforms consisting of light-colored shirts and shorts or pants with knee-high socks. They appear to be outdoors with some trees or foliage visible in the dark background. The image has a caption at the bottom that reads "F.T. Route." The photograph has the characteristic look of being from several decades ago, possibly mid-20th century, given its style and quality.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of a group of young boys standing in a line, with trees in the background.

  • The photo is in black and white.
  • The photo is a group of young boys standing in a line.
  • The boys are wearing white shirts and pants.
  • Some of the boys have hats or caps on their heads.
  • The boys are standing on a dirt path.
  • There is a large rock behind the boys.
  • The background is trees.
  • The photo has a caption at the bottom that says "En Route" in handwriting.

The image appears to be a vintage photograph of a group of young boys on an outdoor adventure or expedition.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

This image is a vintage black-and-white photograph of a group of young boys standing in a line on a dirt path, with trees and bushes in the background. The boys are dressed in casual clothing, including short-sleeved shirts, pants, and boots. Some of them are holding hats or bags.

The photograph appears to be from an earlier era, possibly the early 20th century, based on the clothing and hairstyles of the boys. The image has a sepia tone, which adds to its vintage appearance.

At the bottom of the image, there is handwritten text that reads "En Route." This suggests that the boys may be on a journey or adventure, possibly a camping trip or hike. Overall, the image captures a moment in time of a group of young boys enjoying the outdoors together.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image shows a group of young boys standing together in a grassy area, possibly on a farm. They are all wearing similar outfits, including white shirts, suspenders, and pants. Some of them are holding baseball bats, and one of them is holding a baseball. The boys are standing in a row, and some of them are looking in different directions. The image has a black-and-white filter, giving it a vintage look. The words "En Route" are written in the bottom right corner of the image.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of young boys standing in a line. The photo appears to be from the early 20th century, given the style of clothing and the photographic technique. The boys are dressed in uniforms that resemble those of a sports team, possibly baseball or football. They are wearing short-sleeved shirts, long pants, and boots. Some of them have their arms crossed, while others are holding what appear to be baseball gloves or other sports equipment. The background shows a natural setting with trees and grass, suggesting that the photo was taken outdoors, possibly on a sports field or in a park. The image has a vintage look, with a slight sepia tone and a textured appearance, which adds to its historical charm. The title "En Route" is written at the bottom of the image, possibly indicating that the boys are on their way to a game or event.

Google Gemini

Created by gemini-2.0-flash on 2025-05-23

Here is a description of the image:

The black-and-white photograph shows a group of nine boys and young men standing on a path in front of a dense, dark forest. The image is set within a thick gray border, and beneath the photograph, in elegant script, is the phrase "En Route."

The group consists of eight young boys and one taller, older male who stands in the back center, possibly their leader or chaperone. The boys are dressed in similar attire: light-colored, short-sleeved shirts, khaki-colored trousers, and dark knee-high boots. Several of them carry items, such as bags slung over their shoulders or hats in their hands, indicating they may be on a journey or outing. One boy in the center has what looks like a canteen strapped to his belt.

The setting appears to be a park or forested area, with large rocks visible in the background and dense trees creating a dark backdrop. The path they are standing on is uneven, suggesting a natural, unpaved trail.

Created by gemini-2.0-flash-lite on 2025-05-23

Here's a description of the image:

Overall Impression:

The image is a sepia-toned photograph. It captures a group of young men standing in a natural outdoor setting. The style suggests it might be a vintage photo, possibly from the early to mid-20th century. The scene is likely a snapshot of a group of young men on a hike or outing.

Composition and Setting:

  • Subject: A group of around a dozen young men is the main focus. They appear to be around teenage or young adult age.
  • Background: The backdrop is a dense, dark area of trees and foliage, creating a natural outdoor environment.
  • Foreground: The young men are standing on a dirt path or a grassy area.

Details about the Individuals:

  • Attire: They are all dressed in similar outfits, suggesting a uniform or a shared activity. They appear to be wearing collared shirts, pants (possibly breeches or knickerbockers), and boots or tall socks. Some are wearing what appears to be a canteen and other gear.
  • Posing: They are standing in a loose arrangement. They're looking at the camera. Some have their arms at their sides, while others are holding hats or small bags.
  • Expression: Their expressions are mostly neutral. They seem relaxed and comfortable.

Additional Elements:

  • Text: The photo has the handwritten text "En Route" at the bottom, which strongly suggests the group is on a journey, hike, or outing.
  • Quality: The sepia tone and slightly soft focus are characteristic of older photography styles.

In Conclusion:

The photograph evokes a sense of a bygone era, possibly of a boys' club, scouting group, or a similar outdoor activity. The "En Route" inscription hints at an adventure or expedition. The scene is likely an evocative memory of youth and camaraderie.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a vintage black-and-white photograph depicting a group of young boys, likely scouts or part of a similar outdoor group, standing in a line on what appears to be a hiking trail. They are dressed in uniforms that include short-sleeved shirts, shorts or knickerbockers, and knee-high socks with boots. Some of the boys are wearing hats, and a few have neckerchiefs.

The boys are posed outdoors, with trees and foliage in the background, suggesting a natural, wooded setting. The caption at the bottom of the image reads "En Route," which is French for "on the way," indicating that they are on a journey or hike. The overall atmosphere of the photograph suggests camaraderie and a sense of adventure.

Qwen

Text analysis

Amazon

Foute
En Foute
En

Google

En RoUte
En
RoUte