Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1659

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1659

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 99.1
Coat 90
Photography 81.8
Face 78
Head 78
Outdoors 75.9
Portrait 66
Water 62.8
Cap 57
Nature 56.3
Archaeology 56
Art 55.3
Painting 55.3
Waterfront 55.1

Clarifai
created on 2018-05-11

people 99.9
group together 99.5
adult 98.8
man 98.1
woman 97.1
two 96.9
group 96.7
wear 94.2
four 94
recreation 92.5
military 91.8
watercraft 91.3
many 90.8
several 90
three 89.5
veil 89.5
vehicle 87.6
one 87
five 86.6
child 84.7

Imagga
created on 2023-10-06

beach 54.6
sea 49.4
ocean 45.4
water 44.1
sand 36.9
shore 31.8
sky 30.6
coast 27.8
landscape 26
summer 23.8
coastline 22.6
sunset 22.5
vacation 22.1
travel 21.8
shoreline 19.2
people 19
sun 18.5
man 17.5
silhouette 17.4
rock 16.5
island 16.5
person 16.1
relax 16
waves 15.8
outdoors 15.7
lake 15.6
wave 15.5
holiday 14.3
bay 14.2
scenic 13.2
peaceful 12.8
fisherman 12.8
tropical 12.8
tourism 12.4
outdoor 12.2
boat 11.5
paddle 11.5
paradise 11.3
sunrise 11.3
relaxation 10.9
scenery 10.8
leisure 10.8
mountain 10.7
male 10.4
clouds 10.1
stone 10.1
peace 10.1
outrigger 9.8
fun 9.7
seaside 9.7
tourist 9.5
dusk 9.5
sunny 9.5
rocks 9.4
device 9.4
sport 9.3
mountains 9.3
active 9.2
park 9.1
horizon 9
tide 8.8
pier 8.8
pacific 8.7
natural 8.7
seascape 8.6
ship 8.6
outside 8.6
evening 8.4
color 8.3
calm 8.2
child 8.2
love 7.9
stabilizer 7.9
day 7.8
adult 7.8
coastal 7.8
sandy 7.8
serene 7.5
vacations 7.5
holidays 7.5
warm 7.4
freedom 7.3
recreation 7.2
activity 7.2
romantic 7.1
tree 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 97.9
outdoor 97.5

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 91.2%
Surprised 6.5%
Fear 5.9%
Sad 5.6%
Disgusted 0.4%
Confused 0.3%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Male, 98.1%
Sad 95.1%
Calm 51.5%
Surprised 6.3%
Fear 5.9%
Confused 0.4%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat

Clarifai

Man
Footwear
Human face
Human head
Human hand
Hat

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 97.3%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 98.8%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 97.3%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 98.8%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 97.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.3%

AWS Rekognition

Hat 57.4%

Clarifai

Man 88.9%

Clarifai

Man 86.8%

Clarifai

Man 85.9%

Clarifai

Man 85.1%

Clarifai

Man 82.7%

Clarifai

Footwear 64.8%

Clarifai

Footwear 63.8%

Clarifai

Footwear 49.8%

Clarifai

Human face 59%

Clarifai

Human face 57.6%

Clarifai

Human face 34.6%

Clarifai

Human head 36.5%

Clarifai

Human head 34.4%

Clarifai

Human hand 34.9%

Clarifai

Human hand 33.4%

Clarifai

Hat 34%

Categories

Imagga
created on 2023-10-06

beaches seaside 65.9%
nature landscape 14.7%
paintings art 14.6%
pets animals 3.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of men sitting on a train track

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of men sitting on a bench smoking cigarettes

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This black-and-white image depicts a group of men sitting on a stone wall or ledge. The men appear to be dressed formally, wearing suits and hats, which suggests a historical setting, likely from the early to mid-20th century. One man in the foreground is using or examining a thin object, possibly a matchstick or cigarette. Their postures convey a relaxed, contemplative atmosphere. The background features an open, dusty ground, suggesting an outdoor rural or urban setting.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a group of men sitting on a stone or rock wall. They are dressed in classic attire, featuring suits, jackets, and hats that suggest a fashion style from the early to mid-20th century. One man in the center is holding a long object in his hands, possibly a piece of paper or a cigarette. The men appear to be engaging with one another in a casual, seated setting. The background shows a barren, possibly dirt-covered ground. The overall scene gives an impression of a relaxed moment among a group of men, possibly taking a break or engaging in conversation outdoors.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows a group of men, likely miners or workers, sitting on a rocky outcrop. They are all wearing hats and coats, and appear to be resting or taking a break. The scene is captured in a black and white photograph, giving it a somber and historic feel. The men seem to be in a remote or rugged outdoor setting, perhaps during a work shift or break. The image conveys a sense of hardship and the difficult conditions these men likely faced in their work.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white historical photograph showing several men sitting on what appears to be a stone wall or ledge. They are dressed in typical early 20th century attire, wearing suits and fedora-style hats. The men appear to be engaged in some kind of activity - perhaps writing or working with small objects in their hands. One man is wearing a white shirt with a dark vest, while the others are in dark suits. The setting looks rather barren or rocky, with an empty landscape visible in the background. The image has the grainy quality characteristic of early photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-30

The image depicts a group of men gathered in a rural setting, likely in the early 20th century. The scene is set against a backdrop of a dirt road or field, with the men seated on rocks and a wooden plank.

  • Men's Attire:
    • The men are dressed in formal attire, consisting of suits, vests, and hats.
    • Their clothing suggests a sense of formality and respectability.
  • Seating Arrangement:
    • The men are seated in a semi-circle, with some facing each other and others looking away.
    • This arrangement implies a sense of camaraderie and social interaction among the group.
  • Tools and Objects:
    • One of the men is holding a tool, possibly a hammer or a knife.
    • Another man is holding a small object, possibly a piece of paper or a tool.
  • Background:
    • The background of the image features a dirt road or field, with a few rocks and stones scattered about.
    • The overall atmosphere of the image is one of informality and relaxation, despite the men's formal attire.

In summary, the image captures a group of men gathered in a rural setting, engaged in social interaction and possibly working on a project. The men's formal attire and the tools they hold suggest a sense of purpose and industriousness, while the relaxed atmosphere of the image conveys a sense of camaraderie and enjoyment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-30

The image depicts a black-and-white photograph of six men in suits and hats, sitting on a low stone wall. The men are dressed in dark suits, white shirts, and fedoras or bowler hats. They appear to be engaged in various activities, such as smoking cigarettes or holding objects.

In the foreground, one man is prominently featured, wearing a dark suit, white shirt, and fedora. He is holding a long, thin object in his hands, possibly a stick or a tool. To his left, another man is visible, also wearing a dark suit and fedora. He is leaning forward, with his hands clasped together in front of him.

Behind these two men, three more individuals can be seen, all dressed in similar attire. One of them is smoking a cigarette, while another appears to be holding a small object in his hand. The sixth man is partially obscured by the others, but he seems to be wearing a bowler hat.

The background of the image shows a dirt road or path, with a few rocks and pebbles scattered about. The overall atmosphere of the photograph suggests that it was taken in a rural or countryside setting, possibly during the early 20th century. The men's clothing and hairstyles are consistent with this time period, and the lack of modern technology or infrastructure in the background supports this interpretation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

In the image, five men are sitting on a stone wall in a rural area. They are dressed in suits and hats, suggesting that they are workers or laborers. One of the men is holding a cigarette in his hand, and another is smoking a cigar. The men appear to be taking a break from their work, perhaps chatting or resting. The image has a black-and-white filter, giving it a vintage or historical feel.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The black-and-white photo features a group of five men sitting on a pile of rocks, possibly on a mountain. They are all wearing hats and formal attire, including ties, long-sleeved shirts, and pants. One of them is holding a cigarette in his hand, and another one is holding a cigarette and a lighter. The man on the right is wearing a watch. They are all looking in the same direction.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Impression:

The image is a black and white photograph depicting a group of men in a somber setting. The scene has a vintage feel, possibly from the early to mid-20th century.

Setting and Composition:

  • Location: The men are seated on what appears to be a rough-hewn stone structure, possibly a low wall or embankment. Behind them is a barren, possibly dusty, landscape.
  • Arrangement: They are clustered together, suggesting a shared experience or purpose.
  • Lighting: The lighting is likely natural, with soft shadows, which suggests that the photograph was taken in natural daylight.

People:

  • Attire: The men are all dressed in similar attire, consisting of suits, dress shirts, and hats. This formality suggests a specific time period and maybe a profession or social group.
  • Posture and Expression: The men sit huddled or are sitting with the backs facing towards the wall, with mostly downcast eyes or bent heads, suggesting a sense of contemplation, sadness, or weariness.

Details:

  • Focus: The image appears to be in focus, capturing the texture of the stone, the fabric of the clothing, and the subtle expressions on the men's faces.
  • Mood/Atmosphere: The scene evokes a feeling of austerity, perhaps loss or hardship.

Possible Interpretations:

  • The image might depict a group of men involved in a community gathering.
  • It could be a photo of men on a break from their jobs.

Overall, this photograph captures a moment of introspection, perhaps during a period of social unrest, or even a moment of mourning.

Created by gemini-2.0-flash on 2025-05-01

Here's a description of the image:

This is a black and white photograph showing five men seated on what appears to be a stone ledge or low wall. They all wear hats.

From left to right:

  • The first man is wearing a dark suit and a hat, with a tie. He appears to be looking forward.
  • The second man is wearing a vest over a light-colored shirt and also has a hat. He seems to be holding something small and light in his hands.
  • The third man is in a dark suit and hat, positioned slightly behind the second.
  • The fourth man has his head down, partially obscured, and is wearing a dark suit and hat.
  • The fifth man is sitting on the stone ledge and appears to be interacting with the stones in front of him. He is wearing a hat and a darker-colored jacket or coat.

The background is a plain, open area, likely a field or patch of bare ground. The image quality suggests the photograph is from the early to mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of men gathered outdoors, likely from the early to mid-20th century. The men are dressed in formal attire, including suits, vests, ties, and hats, which suggests that this could be a special occasion or a formal event. They appear to be sitting on a makeshift bench made of wooden planks and rocks.

The men are engaged in various activities: one man is holding a pipe, another is adjusting his clothing, and others are conversing or looking around. The setting is rustic, with a dirt ground and some vegetation visible, indicating a rural or semi-rural location. The overall atmosphere of the image is casual yet dignified, capturing a moment of relaxation and camaraderie among the group.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This black-and-white photograph depicts a group of men engaged in what appears to be a task that involves a small container or object. The setting is outdoors, on a dirt ground with a pile of rocks to the right. The men are dressed in formal attire of the early to mid-20th century, including suits, vests, ties, and fedoras. They are seated around a wooden platform or bench, focused on the object in the center. The central figure is holding a long, thin object that could be a stick or tool. The overall scene suggests a collaborative activity, possibly related to a project or experiment, given the attentive demeanor of the individuals and the specific arrangement of the tools and materials.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This is a black-and-white photograph showing six men sitting or squatting on a small, rough stone wall in an outdoor setting. The ground appears to be dirt or gravel. All the men are dressed formally in suits, ties, and fedora hats, suggesting the photo is from an earlier time period, likely the mid-20th century.

  • Two men on the left are seated and seem to be in conversation, with one holding a cigarette or similar object.
  • The man in the center is holding a long, thin object, possibly a stick or tool, and appears to be focused on something in his hands.
  • Two men on the right are in motion, with one leaning forward as if examining something or assisting the man beside him.
  • The overall mood of the image suggests a casual or work-related gathering, but the men's postures and expressions convey a sense of busyness or focus.