Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2961

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2961

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Fence 99.6
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Cap 99.3
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
People 99.2
Baseball Cap 90.1
Hat 77.5
Prison 77.1
Coat 71.6
Coat 70.1
Hat 60.3
Overcoat 57.6
Jacket 56.8
Glove 55.2

Clarifai
created on 2018-05-10

people 99.9
adult 98
two 97.3
wear 96.9
three 96.7
group together 96.4
man 95.1
portrait 95
veil 94.5
administration 94
outfit 93.7
uniform 92.1
group 91.2
lid 91
leader 90.5
military 89.9
baseball 89.2
one 88.9
war 87.8
barbed wire 87.7

Imagga
created on 2023-10-06

fence 42.9
man 36.3
male 35.6
hat 33.9
person 29.8
prison 29.7
batting cage 24.1
barrier 22.5
people 20.6
baseball equipment 19.7
adult 19.4
sport 18.7
senior 16.9
correctional institution 16.8
portrait 16.2
sports equipment 15.8
outdoors 15.7
smiling 14.5
handsome 14.3
old 13.9
happy 13.8
guy 13.2
industry 12.8
penal institution 12.6
obstruction 12.3
face 12.1
net 11.4
uniform 11.3
looking 11.2
men 11.2
clothing 11
elderly 10.5
boy 10.4
shirt 10.3
safety 10.1
athlete 9.7
western 9.7
wire 9.5
outside 9.4
institution 9.4
mature 9.3
smile 9.3
cowboy 9.2
field 9.2
security 9.2
hand 9.1
one 9
activity 9
game 8.9
worker 8.9
lifestyle 8.7
construction 8.5
military uniform 8.5
black 8.4
outdoor 8.4
protection 8.2
work 7.9
player 7.8
mesh 7.8
ballplayer 7.8
sky 7.6
style 7.4
sports 7.4
metal 7.2
aged 7.2
engineer 7.2
job 7.1
old-timer 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 88.6
old 51.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.5%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 91.6%
Surprised 6.4%
Fear 6%
Sad 3.1%
Angry 2.1%
Confused 1.4%
Disgusted 1.3%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 72.1%
Sad 21.3%
Surprised 6.7%
Confused 6.2%
Fear 6%
Angry 1.6%
Happy 0.9%
Disgusted 0.4%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Coat
Person 99.3%
Person 99.3%
Person 99.2%
Adult 99.3%
Adult 99.3%
Adult 99.2%
Male 99.3%
Male 99.3%
Male 99.2%
Man 99.3%
Man 99.3%
Man 99.2%
Hat 77.5%
Hat 60.3%
Coat 71.6%
Coat 70.1%

Captions

Microsoft
created by unknown on 2018-05-10

a black and white photo of a man 96.9%
a man standing in front of a fence 95.2%
an old photo of a man 95.1%

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of men standing next to each other -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows three individuals dressed in vintage-style clothing, including jackets and flat caps, seated in front of a chain-link fence. Beyond the fence, there is a building with columns and visible railings, suggesting an industrial or institutional setting. To the right of the building, a smaller structure or shed is visible. The overall atmosphere indicates historical or early 20th-century attire and environment.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a black and white photograph depicting three individuals wearing flat caps and jackets, sitting together in front of a chain-link fence. The background shows a building with large windows or openings and some structural elements, as well as a smaller adjacent structure. The scene appears to be outdoors, and the individuals are positioned closely to one another. The overall attire and setting suggest a historical or vintage context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows three men standing behind a chain-link fence. They appear to be wearing hats and coats, suggesting this is likely a cold or winter setting. The fence in the background has some posters or signs attached to it, but the details are not clearly visible. The men have serious expressions on their faces, conveying a sense of hardship or difficulty. Without being able to identify the individuals, the image seems to depict a scene of men facing some kind of adversity or confinement.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, possibly the early-to-mid 20th century. Three men are shown wearing typical working-class attire of the period, including flat caps (also known as newsboy or driving caps) and what appear to be work jackets or coats. They are positioned in front of a chain-link fence, and there appears to be a building visible in the background. The image has the documentary-style quality common to photographs of industrial or working-class settings from this time period. The composition is straightforward and appears unstaged, giving it an authentic, candid quality.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

This image is a black-and-white photograph of three men standing in front of a chain-link fence. The men are dressed in dark clothing and caps, with the man on the left wearing a flat cap, the man in the middle wearing a beret, and the man on the right wearing a newsboy cap. The man on the left has his arm around the man in the middle.

In the background, there is a building with a balcony, suggesting that the photo was taken in an urban or suburban area. The overall atmosphere of the image appears to be somber and serious, with the men's facial expressions and body language conveying a sense of gravity or concern.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image depicts three men standing in front of a chain-link fence, with a building visible in the background. The men are dressed in dark clothing and flat caps, and appear to be of European descent. The man on the left is wearing a dark jacket and a flat cap, while the man in the middle is wearing a dark jacket and a flat cap, with a white shirt visible underneath. The man on the right is also wearing a dark jacket and a flat cap, with a white shirt visible underneath.

The chain-link fence behind the men is made up of diamond-shaped links, and appears to be quite tall. In the background, there is a large building with multiple windows and balconies. The building appears to be made of stone or brick, and has a classical architectural style.

Overall, the image suggests that the men are prisoners or detainees, possibly in a correctional facility or a refugee camp. The chain-link fence and the building in the background create a sense of confinement and isolation, while the men's attire and demeanor suggest a sense of resilience and determination.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white photo shows three men sitting on a bench behind a fence. They are wearing hats and jackets. The man on the left is wearing a hat with a strap, while the man in the middle is wearing a hat with a ribbon. The man on the right is wearing a hat with a ribbon. Behind them is a house with a balcony. The house is surrounded by a fence.

Created by amazon.nova-lite-v1:0 on 2025-06-01

In the black-and-white photograph, three men are standing next to each other, wearing hats and coats, and posing for a picture. The man on the left is wearing a flat cap, while the man in the middle is wearing a beanie cap. The man on the right is wearing a flat cap as well. Behind them is a fence with a building behind it. The building has a balcony with a railing.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

Here's a description of the image:

This black and white photograph shows three men wearing newsboy caps, positioned in front of a chain link fence. The man in the center appears to be smiling slightly, while the men on either side have more somber expressions.

In the background, visible through the fence, is a building with pillars and a balcony, suggesting a grand or institutional structure. A smaller, more modest building is also visible to the right. The overall composition gives the impression of a contrast between the men and the setting, potentially hinting at themes of class, observation, or separation.

Created by gemini-2.0-flash-lite on 2025-05-29

Here's a description of the image:

Overall Impression: This is a black and white photograph, likely from the early to mid-20th century. It captures three men posed in front of a chain-link fence. The photograph has a slightly worn appearance, suggesting it's an older image.

The Men:

  • Central Figure: The central figure is smiling directly at the camera. He is wearing a flat cap, a buttoned dark shirt, and a darker jacket. There's a small pin or badge on his shirt.
  • Left Figure: The man on the left is wearing a flat cap and a dark jacket. His expression is more stern or neutral.
  • Right Figure: The man on the right has a similar flat cap to the others, and a dark jacket. His facial features include a mustache.

Setting and Background:

  • Chain-Link Fence: The men are positioned in front of a chain-link fence. This suggests they might be near a public space, a park, or perhaps part of a work area.
  • Background Buildings: Beyond the fence, there are hints of architectural features. In the background, there's a large building with columns and possibly a balcony. To the right of the fence appears to be the corner of a smaller building, possibly wooden.

Overall Atmosphere: The photograph gives the impression of being candid or posed for a casual portrait. It's a portrait of the era, captured with a vintage feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring three older men standing behind a chain-link fence. The men are wearing caps and heavy coats, suggesting that the weather might be cold. The man on the left appears to be looking slightly to his left with a serious expression, while the man in the center is looking directly at the camera with a slight smile. The man on the right is also looking at the camera, but his expression is more neutral. The background includes a building with railings and some structures that appear to be part of an industrial or institutional setting. The overall mood of the photograph is somber, and the setting suggests a historical context, possibly related to a significant event or period.