Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3160

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3160

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 100
Walking 99.9
People 98.5
Path 98.2
Sidewalk 98.2
Footwear 97.8
Back 92.9
Body Part 92.9
Shorts 85.8
City 75.7
Face 74.9
Head 74.9
Boot 63
Overcoat 60.8
Silhouette 57.1
Pedestrian 56.5
Road 56.3
Street 56.3
Urban 56.3

Clarifai
created on 2018-05-10

people 99.7
group together 99.3
many 97.7
group 97.5
child 96
adult 95.6
offense 95.5
man 95.1
police 92.2
military 92.1
administration 90.6
street 90.6
several 88.9
wear 87.5
five 86.2
pavement 85.8
law enforcement 84.3
battle 83
war 81.9
interaction 81

Imagga
created on 2023-10-05

skate 51.7
people 34.6
man 34.4
silhouette 30.6
male 26.3
men 25.8
group 22.6
motion 19.7
business 19.4
street 18.4
walking 18
person 17.5
city 17.5
businessman 16.8
action 15.8
urban 15.7
photographer 15.5
adult 15.3
black 14.6
sport 14.5
crowd 14.4
weapon 14.4
silhouettes 13.6
walk 13.3
corporate 12.9
sword 12.9
women 12.7
success 11.3
world 11.2
speed 11
suit 11
active 11
pose 10.9
fashion 10.6
human 10.5
body 10.4
work 10.2
team 9.9
clothing 9.8
fast 9.4
blur 9.3
outdoor 9.2
rush 8.9
job 8.8
office 8.8
child 8.8
boy 8.7
ice 8.6
meeting 8.5
manager 8.4
training 8.3
executive 8.3
fun 8.2
outdoors 8.2
exercise 8.2
happy 8.2
pedestrian 8.1
posing 8
cool 8
rushing 7.9
cold 7.8
knee pad 7.7
movement 7.5
professional 7.5
sidewalk 7.5
teamwork 7.4
sports 7.4
teen 7.4
back 7.4
competition 7.3
teenager 7.3
figure 7.3
lifestyle 7.2
looking 7.2
dance 7.2
equipment 7.1
attractive 7

Google
created on 2018-05-10

white 96.2
black 95.9
photograph 95.8
man 94.4
black and white 90.7
standing 87.6
male 82.8
human behavior 82.3
photography 81.8
snapshot 81.8
monochrome photography 78.8
monochrome 70.3
fun 52.2

Microsoft
created on 2018-05-10

person 97.1
outdoor 91.3

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 16-24
Gender Male, 63.9%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%

AWS Rekognition

Age 23-33
Gender Female, 67.5%
Calm 98.8%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Disgusted 0.4%
Happy 0.2%
Angry 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 4
Gender Female

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Boy
Child
Male
Adult
Man
Shoe

Clarifai

Footwear
Boy
Man
Human face
Human head
Human arm
Human leg
Human hair

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 88.2%

AWS Rekognition

Person 71.9%

AWS Rekognition

Boy 99.2%

AWS Rekognition

Boy 98.8%

AWS Rekognition

Child 99.2%

AWS Rekognition

Child 98.8%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 98.8%

AWS Rekognition

Adult 99.1%

AWS Rekognition

Man 99.1%

AWS Rekognition

Shoe 97.6%

AWS Rekognition

Shoe 93.3%

AWS Rekognition

Shoe 89.8%

AWS Rekognition

Shoe 86.5%

AWS Rekognition

Shoe 81.4%

AWS Rekognition

Shoe 81.2%

AWS Rekognition

Shoe 79.4%

AWS Rekognition

Shoe 78.9%

AWS Rekognition

Shoe 76.3%

AWS Rekognition

Shoe 73.2%

AWS Rekognition

Shoe 68.8%

Clarifai

Footwear 95.6%

Clarifai

Footwear 95.5%

Clarifai

Footwear 94.1%

Clarifai

Footwear 93.9%

Clarifai

Footwear 92.3%

Clarifai

Footwear 92%

Clarifai

Footwear 91.5%

Clarifai

Footwear 90.6%

Clarifai

Footwear 85.8%

Clarifai

Footwear 84.5%

Clarifai

Footwear 83.2%

Clarifai

Footwear 81.7%

Clarifai

Footwear 75.5%

Clarifai

Footwear 69.7%

Clarifai

Footwear 59.9%

Clarifai

Footwear 57.1%

Clarifai

Footwear 52.1%

Clarifai

Footwear 41.5%

Clarifai

Footwear 36%

Clarifai

Footwear 35.2%

Clarifai

Boy 71.4%

Clarifai

Boy 69.2%

Clarifai

Boy 56.1%

Clarifai

Boy 55.9%

Clarifai

Man 51.9%

Clarifai

Man 40.4%

Clarifai

Human face 48%

Clarifai

Human face 47%

Clarifai

Human head 38.9%

Clarifai

Human arm 37.6%

Clarifai

Human arm 37%

Clarifai

Human leg 37.1%

Clarifai

Human leg 36.6%

Clarifai

Human leg 36.2%

Clarifai

Human leg 35.1%

Clarifai

Human leg 33.4%

Clarifai

Human hair 34%

Categories

Imagga
created on 2023-10-05

events parties 43.1%
people portraits 36.1%
pets animals 7.7%
streetview architecture 6.6%
paintings art 2.6%
nature landscape 2.4%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a group of children playing with a frisbee

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of boys playing soccer on the street

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image shows a group of boys, dressed in early 20th-century clothing, standing on a city street. They appear to be engaged in playful or rough interaction, with a dynamic posture suggesting movement. The environment includes a sidewalk, street lamps, and urban details, such as buildings and possibly a barrier or fence in the background. Their clothing includes caps, knickerbockers, and boots typical of the era.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a black-and-white photograph depicting a group of boys gathered on a city street. They are dressed in attire typical of early 20th century working-class children, including newsboy caps, knickerbockers, and high socks. The boys appear to be engaged in conversation or interaction, with one boy in particular seemingly being playfully nudged or pushed by another. The street they are on is lined with sidewalks and urban infrastructure such as streetlamps and possibly a building or structure visible on the right side of the image. The setting conveys a sense of urban life, likely in a neighborhood characterized by bustling activity.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a group of people, mostly young men, walking together on a city street. They appear to be dressed in casual clothing from a past era, with some wearing coats and others in more casual attire. The image is in black and white, giving it a vintage feel. The individuals are walking closely together, suggesting they may be friends or acquaintances. The setting seems to be an urban environment, with buildings and other people visible in the background.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph showing several young people from behind, likely from a historical period based on their clothing style. They are wearing what appears to be work clothes or casual attire including rolled-up pants or knickers, work boots, and casual shirts. The image has a documentary or street photography quality to it, capturing people in an everyday moment on what appears to be a sidewalk or street. The style of dress suggests this photo was likely taken in the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of boys standing on a sidewalk, with their backs to the camera. The boys are dressed in casual clothing, including shorts, long-sleeved shirts, and boots. They appear to be engaged in conversation or play, with some of them gesturing or pointing towards the street.

In the background, there are several other people visible, including a woman in a long dress and a man in a suit. The overall atmosphere of the image suggests a sense of community and social interaction among the boys, as well as a connection to the urban environment.

The image is likely a photograph taken in the early 20th century, given the clothing and hairstyles of the individuals depicted. The quality of the image is somewhat grainy, which may be due to the age of the photograph or the fact that it was scanned or digitized from an original print.

Overall, the image provides a glimpse into the daily lives of children in an urban setting during a bygone era. It highlights the importance of social relationships and community in shaping the experiences of young people, and serves as a reminder of the ways in which childhood has changed over time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black and white photograph of four boys walking down a street, with the backs of their bodies facing the camera. The boy on the left is wearing a dark jacket, light-colored pants, and tall boots. The boy in the middle is wearing a dark jacket, dark pants, and dark boots. The boy to the right of him is wearing a dark jacket and dark pants. The boy on the far right is wearing a light-colored shirt, light-colored shorts, dark socks, and dark boots.

In the background, there are several people standing on the sidewalk, including a man in a long coat. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s. The clothing and hairstyles of the boys and the people in the background are consistent with this time period.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The black-and-white photograph shows a group of children standing on the sidewalk. They are wearing long-sleeve shirts, shorts, and boots. The children seem to be engaged in a conversation, with their attention focused on something in front of them. Behind them, there is a blurry image of a person wearing a hat and a person standing near a vehicle. The sidewalk has a concrete surface with some cracks.

Created by amazon.nova-pro-v1:0 on 2025-06-05

A black-and-white photograph shows a group of children standing on the sidewalk. The children are wearing long sleeves, pants, and boots. The boy in the middle is holding the hands of the two children on both sides. The boy on the right is wearing a belt. A boy in a suit is standing behind them. A person is standing on the right side. A pole is on the sidewalk.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-02

Certainly! Here's a description of the image:

Overall Impression:

The photograph is a black and white image capturing a candid moment on a city street. It appears to be from an earlier time period, given the clothing and style of the picture. It has a sense of spontaneity and motion.

Specifics:

  • Subjects: The primary focus of the image is a group of young boys. They seem to be in the middle of some type of roughhousing or playing on a sidewalk. The boys are wearing casual clothes.
  • Composition: The composition is dynamic. The figures are clustered, suggesting interaction and activity. The angle of the shot is from behind, giving a viewer their perspective as a bystander.
  • Background: In the background, there are hints of a street scene - a road, other people, and possibly a vehicle (like a car or cart).
  • Atmosphere: The photograph captures a sense of energy and the free spirit of childhood.

Let me know if you would like a more detailed analysis of any aspect!

Created by gemini-2.0-flash on 2025-06-02

The black and white photograph depicts a group of boys engaged in playful activity on what appears to be a city street or sidewalk. The focus is on the children from behind, revealing their clothing styles and interaction. One boy in the center is being playfully tackled or restrained by another boy. He is wearing a cap and dark jacket. The other boy has on a black jacket and matching shorts. He is bent low, suggesting he is actively engaging in the tussle. To the left, a taller boy stands watching, his back to the viewer. The boy is wearing a jacket and long pants tucked into high socks. To the right of the scuffle, a fourth boy wears a short-sleeved shirt and shorts. Another person stands at the right, wearing a lighter-colored coat. In the background, there's a hint of a street scene with what seems to be a horse-drawn carriage, along with other figures.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph capturing a group of children standing on a street. The children are seen from behind, facing away from the camera, and appear to be watching something in the distance. The children are dressed in what seems to be early to mid-20th-century attire, with some wearing knickerbockers, knee-high socks, and simple shoes. The setting appears to be urban, possibly in a city, with a sidewalk and street visible. There are other people in the background, some of whom are also watching the same event that has captured the children's attention. The overall mood of the image is one of curiosity and anticipation. The photograph has a vintage feel, suggesting it was taken several decades ago.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image is a black-and-white photograph capturing a group of children engaged in an activity on a sidewalk. The children, dressed in casual clothing typical of a bygone era, appear to be playing a game that involves a line or a circular formation, as suggested by their positioned feet and the way they are holding hands or arms. The children's attire includes dark jackets, sweaters, and trousers, along with tall boots, which suggests the photo may have been taken in cooler weather. The setting is an urban street, with the sidewalk extending into the background where other people can be seen walking or standing. The overall atmosphere of the image evokes a sense of nostalgia and captures a candid moment of childhood play.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This is a black-and-white photograph depicting a group of children playing a game on a sidewalk. The children appear to be engaged in a line game, possibly "follow the leader" or a similar activity, where they are holding onto each other's waists. They are dressed in clothing that suggests the photograph was taken in the early to mid-20th century, with some wearing caps and others wearing jackets and vests. The setting appears to be an urban environment, with buildings and a street visible in the background. The overall mood of the image is candid and captures a moment of childhood play.