Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 206. Class & Faculty of 1901.

Date

1901

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.1

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 206. Class & Faculty of 1901.

People

Artist: Unidentified Artist,

Date

1901

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.5
Military 98.6
Military Uniform 98.6
People 91.7
Armored 90.8
Army 90.8
Troop 90.8
Clothing 85.7
Footwear 85.7
Apparel 85.7
Officer 77.6
Crowd 76.5
Soldier 73.3
Marching 67.6
Weapon 57.8
Gun 57.8
Weaponry 57.8
Guard 57.7

Clarifai
created on 2019-06-05

people 99.9
many 99.4
group 99.3
adult 98
child 97.2
military 96.6
group together 96.3
man 94.9
woman 94.7
wear 94.6
school 93.5
education 93.4
war 92.8
boy 92
leader 91.8
uniform 91.5
soldier 90.7
administration 90.6
music 88.4
outfit 85

Imagga
created on 2019-06-05

helmet 75.4
armor plate 49.2
uniform 31.3
plate 28.1
man 26.2
military uniform 23.5
people 22.3
male 21.3
military 21.2
person 19.7
soldier 19.5
clothing 19.2
sport 18.3
shield 17.1
weapon 16.7
danger 15.4
army 14.6
protection 14.5
war 14.4
gun 13.5
adult 13
men 12.9
warrior 11.7
silhouette 10.7
outdoor 10.7
rifle 10.6
group 10.5
black 10.2
outdoors 9.7
consumer goods 9.5
industrial 9.1
toxic 8.8
protective 8.8
nuclear 8.7
mask 8.6
walking 8.5
private 8.3
action 8.3
competition 8.2
to 8
combat 7.9
radioactive 7.8
camouflage 7.8
radiation 7.8
conflict 7.8
destruction 7.8
brass 7.8
chemical 7.7
gas 7.7
statue 7.6
horse 7.6
power 7.5
dirty 7.2
suit 7.2
team 7.2
activity 7.2
history 7.1
portrait 7.1
summer 7.1
travel 7

Google
created on 2019-06-05

Photograph 94.8
People 93.9
Team 82.8
Troop 74.2
Uniform 70.8
History 68.8
Crew 68.5
Military officer 59.6
Military person 57.5
Family 56.1

Microsoft
created on 2019-06-05

group 98.9
clothing 97.9
person 97.8
posing 97.4
ground 97.4
military uniform 94.5
man 94
outdoor 93.7
people 85.4
standing 83.7
footwear 79.7
old 59.7
clothes 34.2

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Sad 45.2%
Happy 45.2%
Surprised 45.2%
Disgusted 45.8%
Angry 45.2%
Calm 53.2%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Male, 54.8%
Confused 45.2%
Calm 50.6%
Happy 45.2%
Surprised 45.1%
Sad 48.6%
Angry 45.2%
Disgusted 45.1%

AWS Rekognition

Age 15-25
Gender Male, 54.8%
Surprised 45.1%
Confused 45.1%
Sad 46.9%
Calm 52%
Disgusted 45.3%
Happy 45.2%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Calm 53.2%
Angry 45.1%
Surprised 45.1%
Confused 45.1%
Sad 46%
Happy 45.1%
Disgusted 45.4%

AWS Rekognition

Age 23-38
Gender Female, 50.9%
Surprised 45.3%
Sad 45.4%
Happy 45.2%
Disgusted 46.2%
Confused 45.2%
Calm 52%
Angry 45.7%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Angry 45.2%
Sad 45.8%
Confused 45.1%
Disgusted 45%
Calm 53.8%
Surprised 45.1%
Happy 45%

AWS Rekognition

Age 27-44
Gender Female, 55%
Confused 45.4%
Happy 45.2%
Sad 52.4%
Surprised 45%
Angry 46.2%
Disgusted 45.3%
Calm 45.5%

AWS Rekognition

Age 30-47
Gender Male, 54.1%
Sad 45.1%
Disgusted 46%
Confused 45.1%
Happy 45%
Calm 53.5%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Happy 45.1%
Confused 45.3%
Calm 53.3%
Surprised 45.2%
Sad 45.9%
Disgusted 45.1%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Sad 45.8%
Confused 45.2%
Calm 48.1%
Disgusted 45.8%
Happy 49.7%
Angry 45.3%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 46.8%
Calm 51.7%
Confused 45.5%
Surprised 45.2%
Happy 45.1%
Angry 45.5%
Sad 45.1%

AWS Rekognition

Age 35-55
Gender Male, 53.9%
Angry 45.4%
Happy 45.2%
Disgusted 45.2%
Sad 49.9%
Confused 45.3%
Calm 48.9%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Calm 53.1%
Disgusted 45.2%
Sad 45.4%
Angry 45.2%
Happy 45.6%
Surprised 45.3%
Confused 45.2%

AWS Rekognition

Age 19-36
Gender Male, 54.8%
Angry 45.1%
Disgusted 45.1%
Sad 45.3%
Confused 45.1%
Happy 45.1%
Surprised 45.1%
Calm 54.3%

AWS Rekognition

Age 27-44
Gender Male, 52.1%
Disgusted 47.4%
Sad 46.9%
Confused 45.5%
Calm 47.5%
Surprised 45.5%
Happy 45.7%
Angry 46.4%

AWS Rekognition

Age 35-53
Gender Male, 54%
Happy 45%
Surprised 45.1%
Angry 45.1%
Sad 45.1%
Confused 45.1%
Calm 54.2%
Disgusted 45.4%

AWS Rekognition

Age 23-38
Gender Male, 53.8%
Disgusted 45.1%
Confused 45%
Angry 45.1%
Sad 45.2%
Surprised 45.1%
Happy 45%
Calm 54.5%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Happy 45.1%
Sad 45.3%
Surprised 45%
Confused 45%
Calm 54.5%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Male, 50.8%
Angry 45.3%
Happy 45.1%
Surprised 45.2%
Calm 53.3%
Confused 45.2%
Sad 45.8%
Disgusted 45.2%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Calm 48.8%
Sad 47.9%
Disgusted 45.3%
Happy 45.2%
Surprised 45.4%
Angry 47.2%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Calm 48%
Angry 45.3%
Surprised 45.1%
Confused 45.4%
Disgusted 45.5%
Happy 45.2%
Sad 50.4%

AWS Rekognition

Age 26-44
Gender Female, 54.9%
Happy 45.1%
Disgusted 49%
Sad 49%
Confused 45.1%
Angry 46.6%
Surprised 45.1%
Calm 45.2%

AWS Rekognition

Age 4-7
Gender Male, 52.7%
Sad 45.7%
Disgusted 47.5%
Calm 50.2%
Angry 45.5%
Surprised 45.5%
Confused 45.3%
Happy 45.2%

AWS Rekognition

Age 30-47
Gender Male, 53.6%
Surprised 45.2%
Happy 45.1%
Confused 45.2%
Sad 45.3%
Calm 53.6%
Disgusted 45.2%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Disgusted 45.1%
Surprised 45.2%
Sad 52.7%
Calm 45.9%
Angry 45.4%
Happy 45.3%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 51.5%
Confused 45.2%
Disgusted 45.2%
Surprised 45.2%
Sad 45.7%
Angry 45.3%
Calm 52.5%
Happy 45.9%

AWS Rekognition

Age 27-44
Gender Female, 50.5%
Disgusted 49.5%
Calm 49.9%
Surprised 49.5%
Angry 49.7%
Sad 49.8%
Confused 49.5%
Happy 49.5%

Microsoft Cognitive Services

Age 35
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Shoe

Clarifai

Clothing
Man
Footwear
Person
Human face
Window

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 96.2%

AWS Rekognition

Person 95%

AWS Rekognition

Person 95%

AWS Rekognition

Person 94.5%

AWS Rekognition

Person 94%

AWS Rekognition

Person 93%

AWS Rekognition

Person 92.4%

AWS Rekognition

Person 68.8%

AWS Rekognition

Person 49.8%

AWS Rekognition

Shoe 85.7%

Clarifai

Clothing 74.9%

Clarifai

Clothing 68.7%

Clarifai

Clothing 68.7%

Clarifai

Clothing 65.6%

Clarifai

Clothing 61.3%

Clarifai

Clothing 59.2%

Clarifai

Clothing 55.4%

Clarifai

Clothing 55.4%

Clarifai

Clothing 54.9%

Clarifai

Clothing 54.5%

Clarifai

Clothing 53.6%

Clarifai

Clothing 51.3%

Clarifai

Clothing 49.5%

Clarifai

Clothing 48.7%

Clarifai

Clothing 46.3%

Clarifai

Clothing 45.7%

Clarifai

Clothing 44.3%

Clarifai

Clothing 44.1%

Clarifai

Clothing 42.5%

Clarifai

Clothing 41.5%

Clarifai

Clothing 37.3%

Clarifai

Clothing 37.2%

Clarifai

Clothing 33.7%

Clarifai

Man 64.8%

Clarifai

Man 62.1%

Clarifai

Man 51.3%

Clarifai

Man 46.7%

Clarifai

Man 42.4%

Clarifai

Man 37.6%

Clarifai

Man 35.7%

Clarifai

Man 34.1%

Clarifai

Man 33.3%

Clarifai

Footwear 54.7%

Clarifai

Footwear 54.7%

Clarifai

Footwear 50.9%

Clarifai

Footwear 50.5%

Clarifai

Footwear 49.6%

Clarifai

Footwear 48.7%

Clarifai

Footwear 47.7%

Clarifai

Footwear 47%

Clarifai

Footwear 46.8%

Clarifai

Footwear 46.4%

Clarifai

Footwear 41.1%

Clarifai

Footwear 36.6%

Clarifai

Person 49.8%

Clarifai

Human face 40%

Clarifai

Human face 38.5%

Clarifai

Human face 38.1%

Clarifai

Human face 36.3%

Clarifai

Human face 35.9%

Clarifai

Human face 35.4%

Clarifai

Human face 34.7%

Clarifai

Human face 34.4%

Clarifai

Human face 33.9%

Clarifai

Human face 33.9%

Clarifai

Window 33.2%

Categories

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-29

a photograph of a group of men and women in suits and hats

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people in hats and suits posing for a photo

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This historic image captures a formal group portrait with people posed in three rows in front of a brick building. The individuals are dressed in formal attire, typical of late 19th or early 20th-century fashion, including suits, ties, and hats. Some of the men are holding canes. There are American flags positioned behind the group, adding a patriotic element to the scene. The setting appears outdoors, with visible dirt ground and architectural details such as windows and a door in the background. The image reflects a serious and formal occasion.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows a group of individuals posing for a formal photograph in front of a brick building. The group consists of approximately 19 people, with some seated in the front row and others standing behind them. The individuals are dressed in formal attire typical of the late 19th or early 20th century, including suits and hats. American flags are visible in the background, positioned on either side of the group near the building's entrance. The brick building features large windows, and there is a person visible through a window above the group. The ground appears to be dirt or a similarly unpaved surface.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a large group of men, approximately 30-40 individuals, posing together in front of a brick building. The men are dressed in formal attire, wearing suits, hats, and ties. Some are standing while others are seated. The group appears to be gathered for an official or formal occasion, possibly a meeting or event. The image has a vintage, black and white appearance, suggesting it was taken in the late 19th or early 20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a vintage black and white photograph that appears to be from the late 1800s or early 1900s. It shows a large group of people formally posed outside a brick building. The group is dressed in the fashion typical of that era - the men are wearing dark suits and bowler hats, while there appears to be a few women in long dresses among them. The photograph is taken in what looks like a formal group portrait style, with people arranged in rows, some seated in the front and others standing behind them. The brick building in the background has large windows typical of institutional or commercial architecture of that period. The ground appears to be dirt or unpaved, which was common for that time. The image quality and sepia toning are characteristic of early photography techniques.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a sepia-toned photograph of a group of people posing in front of a brick building. The group consists of approximately 25 individuals, with 15 men and 10 women, all dressed in formal attire, including suits, hats, and dresses. The men are seated on chairs, while the women are seated on chairs or standing behind them. A few individuals hold American flags, and one man is holding a cane.

In the background, a large brick building with windows and a door is visible. A window on the right side of the building shows a man looking out, and an American flag is visible on the left side of the building. The ground in front of the building appears to be dirt or sand.

The overall atmosphere of the image suggests that it was taken during a formal event or ceremony, possibly in the late 19th or early 20th century. The formal attire and the presence of American flags suggest a sense of patriotism and respect for authority. The image may have been taken for a historical record or as a commemorative photograph.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a sepia-toned photograph of a group of people posing in front of a brick building. The group consists of approximately 30 individuals, with most of them wearing dark suits and hats. Some of the men are holding canes or flags, while others have their hands in their pockets. The group is arranged in three rows, with the back row standing, the middle row sitting on chairs, and the front row sitting on the ground.

In the background, there is a large brick building with several windows. One of the windows has a person sitting in it, looking out at the group. The overall atmosphere of the image suggests that it was taken during a formal event or gathering, possibly in the late 19th or early 20th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

The photo is in black and white, and it appears to be a group of men and women who are probably posing for a photograph. They are sitting on chairs and standing in front of a brick building. Some of them are wearing hats, and some are wearing bow ties. There are two flags on the side of the building, and there is a person standing in front of the window.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image shows a group of people dressed in formal attire, posing for a photograph in front of a brick building. The group consists of men and women, with some individuals wearing hats and others not. The building has a white-framed window and a door, and there are American flags visible in the background. The image has a sepia tone, suggesting it may be an old photograph.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-30

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage photograph featuring a large group of people posing in front of a brick building. The style suggests it was taken in the late 19th or early 20th century.

People:

  • Composition: The group is a mix of men and one woman, and they are likely members of an organization or a formal gathering.
  • Attire: Most of the men are wearing dark suits, many with bowler hats. The woman is dressed in a long dark dress and shawl. The attire is typical of the period.
  • Positions: Some people are sitting, others are standing behind them. The arrangement gives the impression of a formal group portrait.

Setting:

  • Background: The background is a brick building with large windows and an American flag.
  • Environment: The group is gathered on what appears to be an outdoor space, possibly a courtyard or a grassy area in front of the building.

Other Details:

  • Tone: The photograph has a sepia tone, typical of older photographs.
  • Quality: The image has a sense of history and offers a glimpse into the past.

Created by gemini-2.0-flash on 2025-05-30

Here is a description of the image:

The photograph captures a large group of people, mostly men, posed in front of a brick building, likely in the late 19th or early 20th century based on their attire and the photographic style. The building features windows and a solid door. Two American flags are placed behind them.

The people are dressed in formal wear, primarily suits, waistcoats, and hats, which are typical of the era. Some of the men have facial hair, such as mustaches and beards. A couple of women are included in the group, also dressed in formal attire.

The group is arranged in rows, with some people sitting on chairs in the front row and others standing behind them. One person is visible in a window of the building. The ground in front of the group appears to be dirt or gravel.

The photograph is in sepia tone, which is characteristic of older photographs. The overall impression is that it is a formal portrait of a group, possibly associated with a club, organization, or educational institution.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a group of people posing for a formal photograph in front of a brick building. The group consists of men and women, all dressed in formal attire typical of the late 19th or early 20th century.

  • Attire: The men are wearing suits with vests, ties, and hats, while the women are dressed in long dresses with hats or bonnets. Some of the men are also wearing medals or ribbons on their jackets.
  • Setting: The photograph appears to be taken outdoors, with the group arranged in three rows: seated in the front, standing in the middle, and standing in the back. The building behind them has a brick facade with windows.
  • Flags: There are two American flags visible in the image, held by individuals standing in the back row.
  • Composition: The group is composed of individuals of various ages, with some older individuals seated in the front row and younger ones standing behind.

The overall atmosphere of the photograph suggests a formal gathering or event, possibly related to a civic or community organization.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-16

This is a sepia-toned historical photograph of a group of people posing for a photograph in front of a brick building with windows. The group is divided into rows, with some standing and others sitting. The individuals are dressed in formal attire, including suits, hats, and some bowler hats. In the background, an American flag is visible on the left side of the building. The ground appears to be unpaved, and the overall setting suggests a formal or significant occasion, possibly from the late 19th or early 20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-16

This is a sepia-toned historical photograph of a group of people posing for a formal portrait outside a brick building. The group is arranged in several rows, with some individuals standing and others seated. Most of the people are dressed in formal attire typical of the late 19th or early 20th century, including suits, dresses, and hats. There are four women visible in the image, all seated in the front row. Two American flags are visible in the background, held by some of the men. The building has large windows, and one person is visible looking out from a window on the right side of the image. The ground appears to be dirt or gravel.

Text analysis

Google

HER
HER