Human Generated Data

Title

Untitled (Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1618

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1618

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.9
People 96.6
Animal 92.8
Canine 92.8
Mammal 92.8
Pet 92.8
Formal Wear 89.4
Suit 89.4
Footwear 75.1
Outdoors 74.7
Face 73.7
Head 73.7
Overcoat 71.2
Cap 70.8
Accessories 63.1
Bag 63.1
Nature 57.3
Architecture 56.4
Building 56.4
Shelter 56.4
Photography 56
Portrait 56

Clarifai
created on 2018-05-11

people 100
group together 99.9
group 99.5
adult 98.8
many 98.6
child 97.8
several 97.3
administration 96.8
man 96.2
home 95.5
uniform 94.1
four 93.3
recreation 93.2
three 92.5
two 92.3
five 92.2
woman 92.2
outfit 92.1
baseball 92
wear 90.7

Imagga
created on 2023-10-06

athlete 29.5
sport 26.4
person 23.5
player 23
man 22.8
ballplayer 22.6
people 19
adult 18.9
black 17.5
male 17.3
contestant 16.2
world 14.4
lifestyle 13.7
exercise 13.6
fitness 13.6
human 13.5
silhouette 13.2
outdoor 13
run 12.5
boy 12.2
action 12.1
equipment 12
motion 12
model 11.7
portrait 11.6
posing 11.5
outdoors 11.3
men 11.2
leisure 10.8
clothing 10.7
health 10.4
body 10.4
active 10.2
sports equipment 10.2
training 10.2
dark 10
sensuality 10
ball 9.6
city 9.1
sunset 9
recreation 9
runner 8.8
women 8.7
wall 8.7
fashion 8.3
competition 8.2
fun 8.2
style 8.2
pose 8.2
guy 8.1
business 7.9
face 7.8
summer 7.7
running 7.7
youth 7.7
legs 7.6
field 7.5
free 7.5
strength 7.5
one 7.5
street 7.4
speed 7.3
teenager 7.3
dress 7.2
activity 7.2
hair 7.1
grass 7.1
cool 7.1
travel 7
sky 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 98.3
person 98.2
group 62
people 61.5

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 37-45
Gender Male, 100%
Sad 100%
Happy 11.3%
Surprised 6.4%
Fear 6.3%
Calm 1.2%
Angry 1.2%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Calm 59.9%
Happy 38.1%
Surprised 6.6%
Fear 6%
Sad 2.2%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Female, 85%
Calm 72.4%
Happy 21.8%
Surprised 6.9%
Fear 6%
Sad 2.7%
Confused 1.2%
Angry 0.9%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 86%
Happy 7.4%
Surprised 6.6%
Fear 5.9%
Sad 3.6%
Angry 1.1%
Disgusted 0.6%
Confused 0.3%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Female
Woman
Dog
Coat
Shoe
Handbag
Hat

Clarifai

Man
Clothing
Footwear
Tree
Human face
Human arm

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 97.2%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 97.2%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 97.2%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.2%

AWS Rekognition

Female 98.8%

AWS Rekognition

Woman 98.8%

AWS Rekognition

Dog 92.8%

AWS Rekognition

Coat 90.4%

AWS Rekognition

Shoe 75.1%

AWS Rekognition

Shoe 64.3%

AWS Rekognition

Handbag 63.1%

AWS Rekognition

Hat 62.8%

AWS Rekognition

Hat 58.4%

AWS Rekognition

Hat 57.6%

Clarifai

Man 93.6%

Clarifai

Man 78.6%

Clarifai

Man 64.6%

Clarifai

Man 62.6%

Clarifai

Man 48.6%

Clarifai

Man 38.7%

Clarifai

Clothing 92.6%

Clarifai

Clothing 91.5%

Clarifai

Clothing 85.9%

Clarifai

Clothing 33.2%

Clarifai

Footwear 70.5%

Clarifai

Footwear 65.3%

Clarifai

Footwear 61%

Clarifai

Footwear 59.9%

Clarifai

Footwear 55.5%

Clarifai

Footwear 47.3%

Clarifai

Footwear 47.1%

Clarifai

Footwear 44.8%

Clarifai

Footwear 44.6%

Clarifai

Footwear 37.4%

Clarifai

Footwear 35.4%

Clarifai

Tree 68.6%

Clarifai

Human face 44.7%

Clarifai

Human face 44.2%

Clarifai

Human face 35.9%

Clarifai

Human face 35.6%

Clarifai

Human arm 33%

Categories

Imagga
created on 2023-10-06

streetview architecture 43.4%
pets animals 20.6%
paintings art 17.8%
interior objects 8.9%
nature landscape 5.8%
people portraits 1.6%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of men and a dog outside a building

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of men standing around a dog

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The black-and-white image depicts a group of individuals casually standing and sitting outside a building with a textured wall and a wooden door. Several people are seated on steps near the door, one wearing a wide-brimmed hat, while others appear to be socializing. A dog is present near the group, walking in the foreground. In the background, there is a hilly landscape with scattered trees and a structure resembling a house or cabin. The scene suggests a rustic or rural setting and captures a moment of everyday life.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a black and white photograph depicting several men standing and sitting near a building. There are six individuals visible in the photograph, some standing against a rough-textured wall and others sitting near a doorway. The doorway has a wooden frame, and the window beside it appears damaged or obscured. The scene is outdoors, likely during the day, given the visible shadows and sunlight. Additionally, there is a dog walking in front of the seated men. The background includes trees and a building, suggesting a rural or semi-rural setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting a group of men standing outside a building. The men are wearing hats and casual clothing, suggesting this is likely a rural or small-town setting. There is a dog visible in the foreground, and several other people can be seen sitting or standing around the building's entrance. The overall scene conveys a sense of a quiet, everyday moment captured in time.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, possibly the 1930s or 1940s. Several people are gathered outside what appears to be a building with a stucco or textured wall and a doorway. The people are dressed in typical working-class attire of the period, wearing caps, hats, and casual work clothes. Some are standing while others are seated near the doorway. There's also a dog visible in the image near the seated individuals. The setting appears rural or small-town, with some vegetation visible in the background. The lighting suggests it was taken during daytime, and the casual poses of the subjects suggest this might be an informal gathering or perhaps workers taking a break.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of men gathered outside a building, likely a farmhouse or rural dwelling. The scene is set in the early 20th century, as evidenced by the clothing and hairstyles of the individuals.

In the foreground, five men are visible, each with distinct attire. The man on the left wears a dark jacket and pants, while the second man from the left sports a lighter-colored suit and hat. The third man from the left stands with his hands in his pockets, dressed in a button-down shirt and pants. The fourth man from the left sits on a step, wearing a dark jacket and pants, and the fifth man from the left sits beside him, also dressed in dark attire.

A dog is present in the foreground, sniffing the ground near the feet of the men. In the background, trees and a house or barn are visible, providing context for the rural setting.

Overall, the image captures a moment in time, showcasing the daily lives of rural workers or farmers in the early 20th century. The scene is characterized by simplicity, hard work, and a sense of community among the men.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black and white photograph of a group of men and a dog standing outside a building. The men are dressed in casual attire, with some wearing hats and jackets. They appear to be engaged in conversation or simply enjoying each other's company. The dog, likely a medium-sized breed, is positioned near the center of the image, adding a sense of warmth and companionship to the scene.

The background of the image features a rustic building with a wooden door and a window above it. The surrounding environment suggests a rural or countryside setting, with trees and bushes visible in the distance. The overall atmosphere of the image conveys a sense of camaraderie and relaxation, capturing a moment of everyday life in a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

In the image, there are five men in front of a building, possibly a house. The men are wearing hats and coats, and one of them is wearing a belt. They are standing and sitting on the steps in front of the building. One of them is holding a cigarette in his hand, and another one is looking at him. A dog is also present, sitting on the ground near the man on the right.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of a group of men gathered outside a building. The men are dressed in casual clothing, including hats, jackets, and trousers. Some of them are standing, while others are sitting on the ground. One man is holding a dog. The building has a door and a window, and there are trees and grass in the background. The men appear to be engaged in a conversation or activity.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

Overall Impression:

This is a black and white photograph, likely taken outdoors, depicting a group of men seemingly taking a break or gathered outside a building. The style suggests it was taken in the mid-20th century.

Key Elements:

  • The Men: There are several men in the photograph, dressed in attire typical of the era (1930s-1950s). They're wearing hats (flat caps and fedoras), coats, and workwear. Their postures vary, suggesting casual interaction.
  • The Building: The men are situated near a building with a weathered, textured wall. There appears to be a door with glass panes.
  • The Dog: A dog, possibly a mixed breed, is in the foreground. It seems to be looking towards the seated men.
  • Setting: The background includes a hillside with trees and possibly some buildings. The ground is dirt or gravel.

Composition:

The photograph is likely a candid shot. The men are positioned somewhat informally, with a sense of casual camaraderie.

Possible Context:

The image likely captures a scene of working-class men. They may be coal miners or workers in some industrial or rural setting. It could be a break time photo of the group.

Created by gemini-2.0-flash on 2025-05-25

Here's a description of the image:

The image is a black and white photograph depicting a group of men outside a building. There are five men visible, along with a dog.

On the left side of the frame, a man stands wearing a cap, suit jacket, and trousers. He appears to be holding something small in his hands. To his right, another man stands in a hat, a coat and trousers with his hands in his pockets. Further to the right, a third man in a cap, is leaning against a textured wall. He is wearing a button-down shirt and trousers, and holds a garment.

Close to the right edge of the frame, a set of double doors is visible. On the doorsill, four of the men are sitting. One is wearing a hat and suit with his hands over his face. The remaining two are in caps and coats and looking towards the ground. At the right, there is one man and a dog. A thin dog walks between the men on the doorsill.

In the background, there appears to be a hillside with trees and a building higher up. The overall tone of the image is somewhat somber, and the attire of the men suggests a working-class setting. The photograph is bordered by a white frame.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph showing a group of men and a dog in an outdoor setting. The men are dressed in early to mid-20th-century attire, including suits, hats, and casual work clothes.

Three men are standing in the foreground. The man on the left is wearing a suit and a hat, with his hands clasped in front of him. The middle man, also in a suit and hat, has his hands in his pockets. The man on the right is dressed more casually in a short-sleeved shirt, pants, and a hat, with his hands on his hips.

In the background, several other men are seated on a bench or steps in front of a rustic building with a wooden door and window. They appear to be engaged in conversation or observing the scene. One man in the background is wearing a hat and holding a pipe. A dog is seen near the seated men, possibly interacting with one of them.

The setting appears to be rural or semi-rural, with trees and natural surroundings visible in the background. The overall mood of the photograph suggests a relaxed, informal gathering, possibly of workers or friends.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph showing a group of six men and a dog in front of a building with a stucco wall and a door. The scene appears to be from a past era, possibly the early to mid-20th century, judging by the men's clothing and the style of the building.

  • Men on the Left Side: Two men are standing on the left side of the frame, leaning slightly against the wall. Both are wearing hats, jackets, and pants, suggesting practical, work-related attire.
  • Men in the Middle: A man is standing in the middle, leaning against the wall. He is also wearing a hat, a jacket, and pants. His posture and attire suggest he is part of the group.
  • Men on the Right Side: Five men are seated on the right side of the frame. They are wearing similar attire to the standing men, with hats and jackets. One of the men appears to be wearing a cap and is sitting with his hands on his head, possibly in a thoughtful or tired posture.
  • Dog: A dog, possibly a hound or similar breed, is near the seated men, interacting with one of them.
  • Background: The building has a large door and what appears to be a window above it. The surrounding area includes some greenery and a hill in the background, suggesting a rural or semi-rural setting.

The overall atmosphere of the photograph conveys a sense of everyday life, possibly capturing a moment of rest or conversation among the group.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph depicts a group of men standing and sitting outside a building. The men are dressed in a mix of casual and work attire, with several wearing hats. Some are standing against the wall of the building, while others are sitting on the steps leading to a door. A dog is present in the scene, walking along the steps near the sitting men. The background shows some trees and another building, suggesting a rural or small-town setting. The overall atmosphere appears relaxed and casual, possibly capturing a moment of social interaction among the men.