Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 209. Class & Faculty of 1904.

Date

1904

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.4

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 209. Class & Faculty of 1904.

People

Artist: Unidentified Artist,

Date

1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3563.4

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 99.5
Person 99.3
Person 98.5
Person 98.4
Person 97.5
Military 97.1
Military Uniform 97
People 96.8
Armored 95
Army 95
Troop 94.6
Person 92.5
Person 91.4
Person 88
Person 83.4
Outdoors 82.6
Person 82.1
Soldier 80.9
Nature 78.6
Officer 69.3
Person 63.8
Team 63.2
Crowd 63
Countryside 57.1
Police 55
Person 42.8

Clarifai
created on 2019-06-05

people 99.9
group 98.9
many 98.7
adult 97.6
group together 96.9
administration 93.9
military 93.8
wear 93.2
man 93.1
woman 92.3
child 91.4
soldier 91.1
war 91
leader 90
uniform 89.3
outfit 89.1
education 86.3
several 83.5
boy 80.4
school 76.6

Imagga
created on 2019-06-05

military uniform 81.1
uniform 77.5
clothing 54.2
consumer goods 32.7
covering 28.6
helmet 24.1
military 23.2
soldier 21.5
statue 19.7
man 19.5
people 18.4
male 17.7
person 17.7
protection 17.3
danger 17.3
weapon 17.1
commodity 16.2
gun 15.8
war 15.6
photographer 15.3
army 14.6
sport 14.1
mask 13.7
sculpture 13.5
old 13.2
armor plate 12.7
history 12.5
monument 12.1
ancient 12.1
historic 11.9
camouflage 11.9
travel 11.3
adult 11.2
rifle 10.3
tourism 9.9
men 9.4
architecture 9.4
battle 8.8
art 8.6
historical 8.5
traditional 8.3
city 8.3
planner 8.3
vintage 8.3
industrial 8.2
dirty 8.1
landmark 8.1
activity 8.1
destruction 7.8
warrior 7.8
black 7.8
toxic 7.8
defense 7.8
protective 7.8
portrait 7.8
nuclear 7.8
outdoor 7.6
plate 7.3
color 7.2
building 7.2
to 7.1

Google
created on 2019-06-05

Photograph 96.2
People 95
Social group 90.5
Snapshot 84.7
Photography 62.4
Family 62.1
History 57.6
Vintage clothing 57
Crew 53.8
Team 52.3

Microsoft
created on 2019-06-05

posing 99.3
clothing 97.9
person 97.8
group 94.4
man 78.5
old 77.1
smile 60.9
footwear 50.7
team 45.7
clothes 15.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 30-47
Gender Male, 51.4%
Sad 46.6%
Calm 46.2%
Surprised 45.3%
Disgusted 47.6%
Angry 47.9%
Happy 46%
Confused 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.9%
Confused 45.2%
Sad 45.1%
Surprised 45.1%
Disgusted 45.3%
Calm 54%
Happy 45%
Angry 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Happy 45.1%
Surprised 45.1%
Angry 45.3%
Sad 51.1%
Confused 45.3%
Disgusted 45.2%
Calm 47.9%

AWS Rekognition

Age 35-53
Gender Male, 54.3%
Angry 46.2%
Calm 49.7%
Confused 45.3%
Sad 45.5%
Happy 45.3%
Disgusted 47.8%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Sad 45.7%
Surprised 45.5%
Happy 45.4%
Disgusted 46.8%
Angry 46%
Calm 50.4%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Confused 45.2%
Sad 45.5%
Calm 52.9%
Happy 45.3%
Angry 45.3%
Surprised 45.4%
Disgusted 45.4%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Angry 45.2%
Surprised 45.1%
Confused 45.1%
Sad 53.4%
Disgusted 45.1%
Happy 45.9%
Calm 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Happy 46.3%
Angry 47.3%
Sad 47.9%
Calm 47.1%
Confused 45.3%
Disgusted 45.8%
Surprised 45.3%

AWS Rekognition

Age 38-57
Gender Female, 54.7%
Surprised 45.4%
Confused 45.4%
Sad 46.6%
Calm 45.5%
Disgusted 45.6%
Happy 45.3%
Angry 51.4%

AWS Rekognition

Age 20-38
Gender Female, 53.7%
Happy 45.6%
Confused 45.4%
Disgusted 46%
Sad 46.2%
Calm 50.3%
Angry 45.8%
Surprised 45.7%

AWS Rekognition

Age 26-44
Gender Female, 53.6%
Calm 52.8%
Sad 45.5%
Confused 45.3%
Angry 45.3%
Disgusted 45.3%
Happy 45.5%
Surprised 45.3%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Happy 45.4%
Angry 45.6%
Surprised 45.5%
Calm 47.7%
Sad 45.5%
Confused 45.3%
Disgusted 50.1%

AWS Rekognition

Age 26-43
Gender Male, 51.1%
Happy 45.7%
Angry 45.5%
Surprised 45.5%
Calm 50.8%
Sad 45.9%
Confused 45.4%
Disgusted 46.2%

AWS Rekognition

Age 20-38
Gender Male, 52.1%
Calm 48.7%
Confused 45.2%
Sad 45.5%
Surprised 45.4%
Happy 45.3%
Disgusted 45.7%
Angry 49.2%

AWS Rekognition

Age 26-43
Gender Male, 52.6%
Calm 52%
Confused 45.3%
Angry 46.3%
Surprised 45.3%
Disgusted 45.4%
Sad 45.6%
Happy 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50%
Surprised 45.5%
Angry 47%
Calm 47.6%
Disgusted 45.9%
Confused 45.3%
Happy 46.3%
Sad 47.4%

AWS Rekognition

Age 26-43
Gender Female, 53.1%
Calm 46.3%
Disgusted 45.2%
Confused 45.1%
Angry 45.4%
Sad 52.3%
Surprised 45.1%
Happy 45.6%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Sad 54.8%
Surprised 45%
Happy 45%
Angry 45.1%
Confused 45.1%
Disgusted 45%
Calm 45%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 48.2%
Calm 50.7%
Surprised 45.1%
Confused 45.1%
Angry 45.3%
Disgusted 45.2%
Happy 45.4%

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Surprised 45.3%
Confused 45.4%
Happy 45.7%
Angry 45.4%
Calm 52.4%
Sad 45.5%
Disgusted 45.3%

AWS Rekognition

Age 20-38
Gender Male, 51.1%
Calm 52.6%
Disgusted 45.7%
Confused 45.2%
Angry 45.7%
Sad 45.3%
Happy 45.2%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Female, 51.2%
Disgusted 46.6%
Surprised 45.4%
Calm 51.6%
Angry 45.7%
Happy 45.1%
Sad 45.2%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Sad 52.9%
Happy 45.1%
Angry 45.2%
Calm 46.5%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Person 99.7%
Person 99.5%
Person 99.3%
Person 98.5%
Person 98.4%
Person 97.5%
Person 92.5%
Person 91.4%
Person 88%
Person 83.4%
Person 82.1%
Person 63.8%
Person 42.8%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing around a bench -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image shows a group of people, mainly men, gathered together for a posed photograph outside a brick building. Some are standing while others are seated in the front row. The individuals are dressed in formal or semi-formal clothing, including suits, ties, coats, and hats. The setting appears to be outdoors on a dirt ground, and the brick architecture features windows behind the group. The composition suggests an organized gathering, perhaps for a group portrait or event.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a group of people posing for a photograph in front of a brick building. There are twenty individuals in the group, with the people arranged in several rows. Most of them are wearing formal attire, including suits, overcoats, and hats. The building behind them has visible windows and a door. The setting appears to be outdoors, as there is soil or dirt at the ground level. Overall, the image gives the impression of a formal or significant gathering, possibly from an earlier time period given the style of clothing and sepia tone of the photograph.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph of a large group of men, women, and children standing and sitting outside a brick building. The individuals are dressed in clothing typical of the late 19th or early 20th century, with many wearing hats, suits, and dresses. The group appears to be gathered for some kind of occasion or event, though the specific context is unclear from the image alone. The overall scene conveys a sense of community and togetherness among the people depicted.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-12

The sepia-toned photograph depicts a large group of well-dressed individuals, likely from the early 20th century based on their attire. The group consists of approximately 18-20 people, mostly men but also a few women, posing together in front of a brick building.

The men are wearing suits, many with bow ties and hats such as bowler hats and flat caps. The women are wearing long dresses typical of the era. Everyone has a fairly serious expression, as was common in photographs from that time period.

It seems to be a group photo taken to commemorate some occasion, possibly related to their shared profession or social circle. The formal dress and posed nature suggests it was a planned photograph to document the gathering of this particular group of people.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a vintage black and white photograph that appears to be from the early 1900s. It shows a formal group portrait of about 20 people posed in front of a brick building. The subjects are dressed in the fashion typical of that era - the men are wearing dark suits and hats, while the few women present are in long dark dresses. The group is arranged in three rows, with some people seated in the front and others standing behind them. The photograph has the sepia tones characteristic of early photography, and the brick building behind them has tall windows visible in the background. The overall composition suggests this might be a professional or organizational group photo, which was common during that time period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a sepia-toned photograph of a group of people posing in front of a brick building. The group consists of approximately 25 individuals, with some standing and others sitting on the ground or on a bench. They are all dressed in formal attire, with men wearing suits, hats, and ties, while women wear long dresses and coats.

The background of the image features a large brick building with windows, which appears to be an old school or university. The overall atmosphere of the photograph suggests that it was taken during the late 19th or early 20th century, based on the clothing and hairstyles of the individuals in the photo.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a sepia-toned photograph of a group of people posing for a picture in front of a brick building.

  • The group consists of approximately 20 individuals, with 5 people sitting in the front row and the rest standing behind them.
    • The people are dressed in formal attire, with the men wearing suits and hats, and the women wearing long dresses and hats.
    • The group appears to be a family or social gathering, with some people standing together and others sitting separately.
  • The background of the image shows a brick building with a window and a door.
    • The building appears to be a residential or commercial structure, possibly a home or office.
    • The window and door suggest that the building has a functional purpose, such as providing natural light and access to the interior.
  • The overall atmosphere of the image is one of formality and respectability.
    • The group's attire and posture suggest that they are trying to present themselves in a dignified and respectable manner.
    • The image may have been taken for a special occasion, such as a wedding or anniversary celebration.

The image provides a glimpse into the lives of people from the past, showcasing their fashion sense, social norms, and architectural styles.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The image is a vintage black-and-white photograph of a group of people standing and sitting in front of a brick building. The group consists of men and women, all dressed in formal attire typical of the early 20th century. The men are wearing suits, ties, and hats, while the women are wearing dresses and hats. Some individuals are standing, while others are seated on a bench. The building in the background has large windows and a door, suggesting it might be a school, church, or community center. The ground appears to be made of dirt or gravel, indicating that the photo was taken outdoors. The overall atmosphere of the image is formal and serious, with the individuals appearing to pose for the photograph.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image shows a group of people standing and sitting in front of a brick building. The group is composed of both men and women, all dressed in formal attire, including suits and hats. The image has a sepia tone, suggesting it is an old photograph. The people in the image appear to be posing for a group photo, with some standing and others sitting on a bench.

Google Gemini

Created by gemini-2.0-flash on 2025-05-22

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage group photograph, likely taken outdoors in the early 20th century. The sepia tones suggest it's an older print, possibly silver gelatin. The group consists of about 20 people, mostly men, and they are dressed in period attire.

Setting:

The backdrop appears to be a brick building with windows. There are some planks of wood scattered on the ground near the building's foundation. The ground looks like bare earth or compacted dirt.

People:

  • Most of the men are wearing hats, including fedoras, bowlers, and caps. They are dressed in suits or jackets and ties.
  • There are a few women in the group, dressed in long dresses typical of the era.
  • In the front row, there are three men and a woman seated on what looks like a bench.

Composition:

The people are arranged in rows, with some standing behind the seated individuals. The composition is fairly formal and static, as was common in group photos of the time.

Additional Observations:

  • The faces of the people have good contrast, suggesting the photo was well-lit when taken.
  • The condition of the photograph seems good, with only minor aging present.

Created by gemini-2.0-flash-lite on 2025-05-22

Here is a description of the image:

The image is a vintage photograph featuring a group of people posing outdoors. The composition is a group portrait. There are around twenty people of different ages. Most of the group is dressed in formal attire, typical of the early 20th century: suits, hats, and dark coats dominate. Two women are present, both dressed in dark, long dresses. Several men are seated on what appears to be a bench or a step. The background consists of a brick building with a window and a door to the left. The ground in front of the group is made of dirt and sand. The photo has a sepia tone.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a vintage group photograph, likely taken in the late 19th or early 20th century. The group consists of approximately 24 individuals, both men and women, posed in front of a brick building. The attire of the people suggests a formal occasion or gathering, with most men wearing suits and hats, and women dressed in long dresses typical of the period.

The group is arranged in three rows:

  • The front row includes four people seated on chairs. Two women and two men are seated, with the men wearing suits and hats and the women in long dresses.
  • The middle row has people standing behind the seated individuals. This row includes a mix of men and women, all dressed formally.
  • The back row consists of men standing on an elevated surface, possibly a bench or steps, to ensure visibility in the photograph.

The brick building behind them has large windows, and the setting appears to be outdoors, possibly in a courtyard or near an entrance. The ground is unpaved, and there are some construction materials or debris visible to the left side of the image. The overall atmosphere of the photograph is formal and composed, capturing a moment of significance for the group.