Human Generated Data

Title

Untitled (demonstration, New York City)

Date

c. 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5594

Human Generated Data

Title

Untitled (demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5594

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Human 99.4
Person 99.4
Person 99.4
Person 99.2
Person 99.2
Person 98.4
Person 97.5
Person 97.4
Apparel 91.8
Hat 91.8
Clothing 91.8
Person 91.5
Crowd 86.9
Person 79.8
Helmet 77.1
People 73.8
Military 72.4
Military Uniform 70.2
Police 69.1
Person 62.6
Person 61.7
Pedestrian 58.6
Officer 58.1
Parade 55.3
Fireman 55.2
Person 49.6

Clarifai
created on 2019-11-11

people 99.9
group 99
many 98.7
group together 98.3
adult 98.2
administration 98
man 96.8
military 96.7
wear 95
leader 94
war 94
police 91.6
soldier 91.4
crowd 91.1
uniform 90.6
woman 88.5
veil 87.1
offense 85.8
law 85.7
outfit 85.4

Imagga
created on 2019-11-11

old 21.6
man 20.9
statue 19
people 18.4
religion 17.9
sculpture 17.7
architecture 16.4
monument 15.9
travel 14.8
metropolitan 14.3
room 14.3
person 14.3
historical 14.1
ancient 13.8
art 13.2
male 13
kin 12.2
history 11.6
religious 11.2
home 11.2
classroom 11.2
tourism 10.7
world 10.7
sitting 10.3
life 10.2
historic 10.1
adult 9.9
building 9.9
worker 9.8
men 9.4
culture 9.4
stone 9.3
vintage 9.2
tourist 9.2
business 9.1
human 9
group 8.9
antique 8.8
indoors 8.8
couple 8.7
women 8.7
god 8.6
house 8.3
church 8.3
grandfather 8
looking 8
clothing 8
monk 7.9
pray 7.7
temple 7.7
casual 7.6
happy 7.5
senior 7.5
traditional 7.5
city 7.5
work 7.4
inside 7.4
love 7.1
day 7.1

Google
created on 2019-11-11

Microsoft
created on 2019-11-11

person 98.5
clothing 97.8
text 95.7
outdoor 90.8
man 85.4
human face 85.1
group 75.1
people 72.1
woman 70
old 59.4
crowd 1.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 99.6%
Sad 0.1%
Happy 97.8%
Surprised 0.1%
Fear 0%
Angry 0%
Calm 1.9%
Disgusted 0%
Confused 0.1%

AWS Rekognition

Age 22-34
Gender Male, 89.5%
Angry 9.9%
Calm 17.5%
Disgusted 5.7%
Confused 33.4%
Sad 16.2%
Surprised 6%
Fear 10.2%
Happy 1.1%

AWS Rekognition

Age 26-40
Gender Female, 54.7%
Surprised 45.1%
Happy 45%
Fear 45%
Angry 45.5%
Confused 45.2%
Calm 53.6%
Sad 45.6%
Disgusted 45.1%

AWS Rekognition

Age 23-37
Gender Female, 52.6%
Disgusted 45%
Sad 45.3%
Confused 45.1%
Happy 45%
Calm 52.1%
Fear 45%
Angry 47.2%
Surprised 45.2%

AWS Rekognition

Age 22-34
Gender Male, 53.8%
Surprised 45.4%
Happy 45.1%
Disgusted 45.1%
Calm 50.2%
Fear 45.2%
Sad 45.7%
Angry 48.2%
Confused 45.1%

AWS Rekognition

Age 23-35
Gender Female, 53.5%
Sad 45.1%
Surprised 45%
Happy 45.7%
Disgusted 45%
Angry 45%
Confused 45%
Fear 45%
Calm 54.2%

AWS Rekognition

Age 37-55
Gender Male, 52.9%
Angry 45.4%
Calm 50.4%
Happy 45.1%
Fear 45.8%
Surprised 46%
Disgusted 45.6%
Sad 46.4%
Confused 45.3%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 50.4%
Fear 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 24-38
Gender Female, 50.3%
Calm 49.7%
Fear 49.5%
Disgusted 49.7%
Angry 49.8%
Surprised 49.5%
Sad 49.6%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 7-17
Gender Female, 52.2%
Happy 45.3%
Angry 51.2%
Calm 46.4%
Confused 45.3%
Disgusted 45.6%
Sad 45.6%
Fear 45.4%
Surprised 45.3%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Helmet
Person 99.4%
Person 99.4%
Person 99.2%
Person 99.2%
Person 98.4%
Person 97.5%
Person 97.4%
Person 91.5%
Person 79.8%
Person 62.6%
Person 61.7%
Person 49.6%
Hat 91.8%
Helmet 77.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-27

a photograph of a group of people standing in front of a building -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The sepia-toned image depicts a group of individuals standing outdoors near a large building with stone columns and tall windows, suggesting an urban setting. The people are dressed in mid-20th century attire, such as hats, overcoats, and suits, reflecting the fashion of that era. Street lamps line the edge of the pavement, and there is visible architectural detail and depth in the cityscape background.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image depicts a group of people standing in a line or gathering on a city sidewalk. The individuals are dressed in clothing typical of the early to mid-20th century, including overcoats, hats, and suits. The scene is set against the backdrop of a large building with classical architectural features such as tall windows and columns. The setting appears to be a city street, with additional buildings and streetlamps visible in the background. The image is sepia-toned, giving it a vintage appearance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a historical black and white photograph depicting a crowded street scene in what seems to be an urban setting. The image shows a large group of people, both men and women, standing on the sidewalk in front of what looks like a multi-story building with architectural details. The individuals are dressed in clothing typical of the early to mid-20th century, with many wearing hats, coats, and other attire of that era. The overall atmosphere suggests this is likely a street scene from a city, though the specific location is not clear from the image alone.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a historical black and white photograph, likely from the early-to-mid 20th century, showing a crowd of people on what looks like a city street. The people in the image are wearing period-appropriate clothing, including many hats which was typical of the era. The crowd appears to be gathered along a building with a stone or brick facade. The architectural style visible in the background suggests this is in an urban setting, possibly a downtown area. The sepia tones and photographic quality are characteristic of photography from that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-06

The image is a sepia-toned photograph of a group of people standing in front of a large stone building, likely taken in the early 20th century.

People:

  • A woman with short dark hair and a dark sweater stands in the foreground, facing the camera.
  • To her left, a man wearing a dark hat and coat looks to his right.
  • Behind them, several other people are visible, including a man in a uniform and a woman in a long dress.
  • Some individuals are holding papers or bags.

Building:

  • The building behind the group is made of stone and features many windows and columns.
  • It appears to be a government or institutional building, possibly a courthouse or post office.

Street:

  • The street in front of the building is empty, except for a few people standing near the curb.
  • A streetlamp is visible on the right side of the image.

Overall:

  • The image captures a moment in time, possibly during a public event or ceremony.
  • The formal attire and serious expressions of the people suggest a sense of importance or occasion.
  • The sepia tone gives the image a nostalgic and timeless feel.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-06

The image is a black-and-white photograph of a crowd of people standing in line on a sidewalk in front of a large building. The crowd is made up of men and women, all dressed in formal attire, with some wearing hats. They are standing in a line that stretches along the sidewalk, with some people looking at the camera and others looking away.

In the background, there is a large building with columns and windows. The building appears to be a government building or a courthouse, given its grand architecture and the formal attire of the people in the crowd. The overall atmosphere of the image suggests that the people are waiting for something, possibly a court hearing or a government event.

The image has a sepia tone, which gives it a vintage feel. The quality of the image is good, with clear details of the people and the building. The image appears to be an old photograph, possibly from the early 20th century, given the style of clothing and the architecture of the building.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

An old black-and-white photo shows a group of people standing on a sidewalk. They are all wearing hats and shoes. Some of them are looking at something in front of them. The man on the left is wearing a leather jacket. Behind them is a building with several windows and a streetlight. On the right side, there is a car parked on the side of the road.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a vintage black-and-white photograph showing a group of people standing outside a large building. The building has a classical architectural style with columns and large windows. The people are dressed in formal attire, typical of the early 20th century, with men wearing suits and hats and women in dresses and hats. They appear to be waiting in line or gathered for an event. The photograph captures a moment of social interaction and historical fashion.

Google Gemini

Created by gemini-2.0-flash on 2025-05-11

Here's a description of the image:

This is a sepia-toned photograph capturing a group of people gathered in front of a large building with classical architectural features like columns and repeated windows. The scene appears to be outdoors, possibly a street or plaza.

The people in the foreground seem to be a crowd, with a mix of men and women. Many of the men are wearing hats, a common attire for the era. In the middle of the crowd, there's a uniformed police officer. A woman with curly hair is looking directly at the camera with a slight smile.

The overall atmosphere suggests a historical or vintage setting, possibly a gathering for an event or demonstration. The depth of field is shallow, which puts more emphasis on the individuals closer to the lens.

Created by gemini-2.0-flash-lite on 2025-05-11

Here's a description of the image:

The image is a sepia-toned photograph featuring a crowd of people gathered outdoors, likely in a city setting. The scene appears to be historical, possibly dating back several decades due to the clothing styles. A large, imposing building forms the backdrop, with a row of columns along its side. The building's architecture has a classical feel, possibly suggesting a governmental or institutional structure.

In the foreground, numerous individuals are visible. Many are wearing hats, which was common attire during that period. There's a mix of ages and genders. A uniformed officer, possibly a police officer, is standing amidst the crowd. The expressions on the people's faces vary, with some looking directly at the camera. Some people appear to be casually standing and chatting, while others seem more focused on something off-camera.

The composition suggests a snapshot of a moment in time, potentially capturing a public event or gathering. The overall mood feels somewhat formal due to the clothing and the building's grandeur. The sepia tone adds to the historical atmosphere of the photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image depicts a historical scene from what appears to be the early 20th century, based on the style of clothing and the overall setting. A group of people, both men and women, are gathered outside a large, imposing building that has a classical architectural style with tall columns. The individuals in the crowd are dressed in period attire, with many of the men wearing suits and hats, and the women in long dresses and coats. Some people are looking towards the camera, while others seem to be engaged in conversation or observing something off-camera.

The scene appears to be urban, possibly in a city center, given the presence of streetlights and the style of the buildings. The atmosphere suggests that the people might be waiting for something or someone, possibly indicating a significant event or gathering. The overall tone of the image conveys a sense of anticipation and community, capturing a moment in time from a bygone era.