Human Generated Data

Title

Social Settlements: United States. District of Columbia. Washington. Noel House: Noel House, Washington, D.C.: Ready to start for camp.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.226.2

Human Generated Data

Title

Social Settlements: United States. District of Columbia. Washington. Noel House: Noel House, Washington, D.C.: Ready to start for camp.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.226.2

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.6
Human 99.6
Person 99.6
Person 98.9
Person 98.8
Person 98.5
Person 98.4
Person 98.1
Person 98
Person 97.4
Person 97.2
Person 97.1
Person 97.1
Clothing 95.4
Apparel 95.4
Person 93.5
People 91.6
Person 78.6
Crowd 75.3
Text 65.8
Painting 65
Art 65
Family 64.2
Photography 60
Photo 60

Clarifai
created on 2025-01-10

people 99.9
group 99.1
many 98.4
adult 98.2
child 98.2
group together 98.2
man 97.8
woman 96.9
wear 96.1
several 95.1
monochrome 92.7
recreation 92.4
boy 91.9
sit 91.6
family 91.1
lid 88.4
veil 88.3
war 88.1
furniture 87.5
uniform 86

Imagga
created on 2022-06-25

sculpture 32.2
statue 29.8
kin 27.8
ancient 25.9
old 25.1
art 24.9
history 22.4
stone 20.5
architecture 20.3
religion 19.7
monument 19.6
tourism 15.7
travel 15.5
culture 15.4
antique 15.2
historic 14.7
god 14.3
building 13.4
decoration 13.3
ruler 13.3
vintage 13.2
temple 13.2
historical 12.2
detail 12.1
marble 12
carving 11.5
landmark 10.8
city 10.8
people 10.6
wall 10.3
room 9.9
world 9.8
paper 9.7
memorial 9.6
symbol 9.4
brass 9.4
religious 9.4
grunge 9.4
famous 9.3
man 9.3
church 9.2
aged 9
currency 9
face 8.5
figure 8.5
classroom 8.3
cash 8.2
holy 7.7
spirituality 7.7
money 7.7
texture 7.6
dollar 7.4
tourist 7.4
bank 7.2
love 7.1
newspaper 7

Google
created on 2022-06-25

Hairstyle 95.1
Suit 85.7
Social group 82.4
Font 79.7
Vintage clothing 79
Event 73
Art 70.4
Room 68.1
Classic 68
History 67.5
Monochrome 67.3
Stock photography 63.1
Paper product 63
Retro style 60.4
Team 59.5
Hat 59.4
Crew 58
Sitting 56.5
Visual arts 54
Chair 53.2

Microsoft
created on 2022-06-25

text 98.1
clothing 97.1
person 95.1
man 87.8
posing 87.4
woman 81.1
old 79.1
group 75.7
newspaper 51.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-43
Gender Male, 98.2%
Confused 85.1%
Calm 8.9%
Surprised 7.2%
Fear 6%
Happy 2.5%
Sad 2.4%
Angry 0.7%
Disgusted 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Calm 97.5%
Surprised 7%
Fear 5.9%
Sad 2.2%
Confused 0.5%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Male, 74.4%
Calm 90.4%
Surprised 7%
Fear 6.7%
Confused 3.4%
Sad 2.3%
Angry 1.2%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 9-17
Gender Female, 61.3%
Calm 92%
Surprised 6.7%
Fear 6%
Confused 3.5%
Angry 2.6%
Sad 2.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Male, 97.8%
Happy 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Calm 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 27-37
Gender Male, 97.8%
Calm 79.4%
Confused 8.1%
Surprised 7.6%
Fear 6.3%
Happy 5.6%
Sad 2.9%
Angry 0.8%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 54.8%
Angry 36.3%
Surprised 7.2%
Fear 6.2%
Confused 4.3%
Sad 2.4%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 96.8%
Surprised 6.5%
Fear 5.9%
Sad 2.5%
Angry 0.9%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Angry 64.4%
Calm 29%
Surprised 7.4%
Fear 6.2%
Sad 2.3%
Confused 2.2%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 70%
Confused 11.3%
Surprised 7.1%
Sad 6.9%
Fear 6.4%
Angry 5.1%
Disgusted 1.1%
Happy 1%

AWS Rekognition

Age 23-33
Gender Female, 74.1%
Sad 40.1%
Confused 38.4%
Calm 11.6%
Fear 11%
Surprised 9%
Angry 8.9%
Disgusted 1.5%
Happy 0.9%

AWS Rekognition

Age 16-22
Gender Male, 95.7%
Calm 97.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 38-46
Gender Female, 91.8%
Happy 96.3%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Calm 1.8%
Confused 0.2%
Disgusted 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Person 99.6%
Person 99.6%
Person 98.9%
Person 98.8%
Person 98.5%
Person 98.4%
Person 98.1%
Person 98%
Person 97.4%
Person 97.2%
Person 97.1%
Person 97.1%
Person 93.5%
Person 78.6%
Painting 65%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-29

a photograph of a group of people standing around a group of children -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts a group of individuals, including adults and children, gathered outdoors and posing near a wall covered in advertisements and posters. The advertisements include visible text such as "Fairy Soap" and "Riverview Monday August," suggesting a historical setting. Some of the individuals are seated while others stand, holding various objects like musical instruments and rolled papers. There is a mix of attire, including hats, jackets, and formal pieces, indicating it may be an event or gathering. A large baby illustration is also present on one of the ads in the background. The overall scene conveys a vintage, community-style snapshot.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image shows a group of individuals, mostly young boys, gathered around a street corner. They are in front of a large advertisement that reads "FAIRY" and "SOIL POW[D]ER" on the wall behind them. Some boys hold various objects, such as a trumpet and pieces of paper. The group includes people dressed in period clothing typical of the early 20th century, such as suits, hats, and knickers. The atmosphere suggests a casual gathering or possibly a street performance. There are also various posters advertising events or products visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a sepia-toned photograph of a group of boys posing in front of a wall with advertisements.

  • The group consists of approximately 15 boys, ranging in age from around 8 to 18 years old.
    • They are all dressed in casual clothing, with some wearing hats and others not.
    • Some of the boys are sitting on the ground, while others are standing or leaning against each other.
  • In the background, there are several large advertisements on the wall, including one for "FAIRY" and another for "RIVER VIEW MONDAY AUG."
    • The advertisements appear to be for local businesses or events.
  • The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly in the United States or Europe.
    • The style of clothing and the type of advertisements suggest a time period before the mid-20th century.

The image appears to be a nostalgic snapshot of a group of boys posing together in front of a wall with advertisements.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a sepia-toned photograph of a group of young boys posing in front of a wall with advertisements. The boys are dressed in casual attire, including caps, jackets, and pants. Some of them are sitting on the ground, while others are standing or leaning against the wall.

In the background, there are several advertisements visible, including one for "FAIRY" and another for "RIVER VIEW MONDAY AUG." The overall atmosphere of the image suggests that it was taken during the early 20th century, possibly in the 1910s or 1920s. The boys appear to be enjoying themselves, and the photograph captures a moment of carefree youthfulness.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

A black-and-white photo of a group of boys and a man posing for a photo. The boys are sitting on the ground, while the man is standing behind them. The boys are holding different objects, such as a trumpet, a book, a bag, and a guitar case. The man is holding a book and a piece of paper. Behind them are posters with the words "FAIRY" and "OIL POWER" and a cartoon character.

Created by amazon.nova-pro-v1:0 on 2025-06-07

A black-and-white photo shows a group of young boys and a man standing in front of a wall with posters. The man is wearing a hat and tie, while the boys are wearing hats and some are wearing suspenders. Some of them are sitting on the ground, while others are standing. They are holding musical instruments, and some are holding papers. On the left side, there is a guitar case.

Google Gemini

Created by gemini-2.0-flash on 2025-05-25

Here is a description of the image:

The image is a vintage sepia-toned photograph of a group of young boys and a man posing in front of some advertising posters and what appears to be a hand-painted sign.

The subjects consist of thirteen boys, most wearing caps or hats, and one adult male. They are dressed in casual clothing appropriate to the era, including jackets, sweaters, and flat caps. The man is wearing a light-colored suit and a hat, which sets him apart from the boys.

The background features a cluttered urban scene. Behind the group, there are advertisements painted on a wall, including one that features a chubby baby figure and the words "Toilet Towels" and another that reads "Fairy." There is also a hand-painted sign that includes the words "Shrine Charity Excursion to River View Monday Aug," indicating an event taking place.

Several of the boys are holding instruments, suggesting they may be a band or musical troupe. In the foreground, there is a case for a stringed instrument like a guitar or banjo. Some of the boys are seated on the ground, while others are standing or perched on something behind them.

The photograph has a slightly faded and worn quality, which contributes to its historical feel. The overall impression is one of a bygone era, capturing a moment in time for this group of young people.

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

The image appears to be a sepia-toned photograph, likely from the early 20th century. It depicts a group of boys and young men posing outdoors, likely in front of a wall or building with advertisements.

Key elements:

  • The group: There are around 14 individuals in the photograph. Most are dressed in clothing appropriate for the era – jackets, caps, and some with knickerbockers or long socks.
  • Props: There's a guitar in a case, indicating some musical connection. There are also some bags or containers, possibly carrying other instruments or supplies. One of the boys holds a trumpet. Some appear to be holding small notebooks.
  • Background: The background is adorned with posters and advertisements. Some are partially visible, including one for "FAIRY" and another that mentions "RIVER VIEW" and "AUGUST," indicating the season. A sign for "Shrine Charity Contribution to River View" can also be seen.
  • Atmosphere: The photograph has a vintage feel. The attire of the group suggests a sense of camaraderie and youthful adventure. The presence of musical instruments could indicate they were performers.

Overall, it's a historical snapshot of a group of young people, potentially musicians or performers, posing for a photo in a public space during a bygone era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a vintage sepia-toned photograph featuring a group of people, likely a band or musical troupe, posing together. The group consists of both adults and children, and they are arranged in two rows.

In the back row, there are seven individuals standing. Some are wearing suits and ties, while others are dressed in more casual attire. One person is holding a cornet, indicating that they are a musician. The background features various advertisements and signs, including one for "Fairy" soap and another promoting a river view event.

In the front row, there are six children seated on the ground. Some of them are holding musical instruments, such as a guitar and a banjo, suggesting they are also part of the musical group. The children are dressed in a mix of clothing, including hats, jackets, and boots.

The overall setting appears to be outdoors, possibly in a town or city street, given the presence of the advertisements and signs. The photograph captures a moment in time, likely from the early 20th century, showcasing a group of musicians or performers.

Text analysis

Amazon

RIVER
VIEW
MONDAY
a
FAIRY
little
OIL
RIZ
50,2
WE
AUG.
SHRINE
ATHLETI-
Elyou a little 7 for
CLUBT
CLUBT 71
7
71
PAR
for
Elyou

Google

TRAC ya OIL OWE So, 12 FAIRY ou a little in your ba ARINE RIVER K VIEW MONDAY AUG
TRAC
ya
OIL
OWE
So
,
12
FAIRY
ou
a
little
in
your
ba
ARINE
RIVER
K
VIEW
MONDAY
AUG