Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

Date

July 30, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.760

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.760

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Photography 99.9
Sitting 98.7
Clothing 85.1
Face 83.5
Head 83.5
Outdoors 70.2
Pants 67.7
Tripod 67.1
Portrait 57.4
Stick 57.3
Nature 56.8
Photographer 56.6
Reading 56.1
Firearm 56.1
Gun 56.1
Rifle 56.1
Weapon 56.1
People 55.6
Bench 55.2
Furniture 55.2
Wood 55.1

Clarifai
created on 2018-05-11

people 99.9
adult 99
man 98.3
two 97.8
one 96.7
group together 94.8
wear 94.6
child 93.7
war 93.6
woman 92.8
administration 92.7
three 92.4
group 92.3
canine 91.3
military 89
sit 86.7
position 86.4
offspring 86.3
home 86
four 86

Imagga
created on 2023-10-06

man 28.2
weapon 27.7
tool 26.6
rake 26.3
outdoors 25.4
outdoor 25.2
people 22.3
male 19.9
person 19.5
leisure 18.3
sport 17.3
summer 16.1
grass 15.8
adult 14.9
bow and arrow 14.7
field 14.2
autumn 14.1
outside 12.8
recreation 12.5
park 12.4
child 11.8
meadow 11.7
instrument 11.7
activity 11.6
walking 11.4
forest 11.3
crutch 11.3
men 11.2
old 11.1
day 11
countryside 11
relax 11
active 10.8
fun 10.5
couple 10.5
boy 10.4
sky 10.2
device 10.2
lifestyle 10.1
vacation 9.8
family 9.8
hiking 9.6
work 9.5
sitting 9.4
happy 9.4
two 9.3
joy 9.2
landscape 8.9
staff 8.9
walk 8.6
tree 8.5
life 8.5
rifle 8.3
washboard 8.3
lake 8.2
freedom 8.2
gun 8.2
stick 8.1
farm 8
kid 8
businessman 7.9
love 7.9
spring 7.8
happiness 7.8
clothing 7.7
hand 7.6
hobby 7.6
garden 7.5
free 7.5
senior 7.5
farmer 7.4
rest 7.4
water 7.3
business 7.3
black 7.2
suit 7.2
mountain 7.1
portrait 7.1
working 7.1
rural 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

grass 99.2
person 97.6
sitting 96
man 92.6
outdoor 92.3
old 71.4
older 20.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Sad 67.4%
Angry 41.7%
Calm 13.5%
Confused 10.1%
Surprised 6.8%
Fear 6.1%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 64-74
Gender Male, 100%
Calm 93.3%
Surprised 6.4%
Fear 5.9%
Angry 4.6%
Sad 2.3%
Confused 0.7%
Disgusted 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Boy
Child
Coat

Clarifai

Clothing
Man
Human face
Plant
Footwear
Human arm
Human hair
House
Human hand
Human leg

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 95.3%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 98.6%

AWS Rekognition

Male 96.7%

AWS Rekognition

Male 95.3%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 95.3%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 69.9%

AWS Rekognition

Boy 98.6%

AWS Rekognition

Boy 96.7%

AWS Rekognition

Child 98.6%

AWS Rekognition

Child 96.7%

AWS Rekognition

Coat 85.1%

Clarifai

Clothing 86.7%

Clarifai

Clothing 69.2%

Clarifai

Clothing 38%

Clarifai

Man 81.6%

Clarifai

Human face 72.7%

Clarifai

Human face 65.5%

Clarifai

Plant 72.2%

Clarifai

Footwear 69.7%

Clarifai

Footwear 69%

Clarifai

Footwear 66.7%

Clarifai

Footwear 52.2%

Clarifai

Footwear 52.1%

Clarifai

Footwear 42.8%

Clarifai

Footwear 40%

Clarifai

Human arm 41.4%

Clarifai

Human arm 39.4%

Clarifai

Human arm 37.2%

Clarifai

Human hair 40.7%

Clarifai

House 40.1%

Clarifai

House 39.9%

Clarifai

Human hand 37.2%

Clarifai

Human hand 35.4%

Clarifai

Human leg 36%

Clarifai

Human leg 35.5%

Categories

Imagga
created on 2023-10-06

paintings art 71.6%
pets animals 15%
nature landscape 6.2%
streetview architecture 4.5%
people portraits 1.8%

Captions

Microsoft
created by unknown on 2018-05-11

a man sitting on a bench 85.7%
a vintage photo of a man sitting on a bench 84.4%
an old man sitting on a bench 84.3%

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man sitting on a porch with a camera and a camera

Created by general-english-image-caption-blip-2 on 2025-07-06

three men sitting on the porch of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image portrays a rural scene featuring a wooden porch attached to a house with horizontal paneling. Two individuals are seated on the porch—one with hands clasped sitting directly on the porch and another seated on a chair with legs crossed, wearing a hat. The ground in front is grassy, and a person's lower half, holding a cane, is visible in the foreground. Another figure stands near the doorway of the building behind the seated individuals. The environment suggests a casual and rustic atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a group of men gathered on a wooden porch in front of a house. The central figure on the left is seated on the porch steps, dressed in light-colored clothing, with his hands clasped. To the right, another man is sitting with his legs crossed and hands resting on his knee. He is wearing a long-sleeved shirt and dark trousers, along with a hat. The porch has vertical wooden panels, and a door is visible behind the standing shirt-sleeved man. In the foreground, a person is partially visible, holding a walking stick or cane, with grass and weeds covering the ground.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows two older men sitting on a wooden porch or steps in what appears to be a rural or small-town setting. One man is sitting with his hands in his lap, while the other is leaning back against the wall. They are both dressed in casual work clothes, suggesting they may be laborers or farmers. The background includes a wooden building and some grass or vegetation. The overall scene has a sense of quiet contemplation or rest.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, possibly the 1930s or 1940s. Two men are sitting on what looks like a wooden porch or steps in front of a building with horizontal siding. One man is wearing light-colored casual clothes and is smoking, while the other man is wearing darker clothes and a hat. There's also a partial view of another person standing or sitting to the left of the frame. The ground in front of the porch appears to be covered in tall grass or weeds. The image has a candid, documentary-style quality typical of Depression-era photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two men sitting on a porch, with one man smoking a cigarette.

The man on the left is wearing a light-colored shirt and pants, with his legs crossed. He has short dark hair and is holding a lit cigarette in his right hand. The man on the right is wearing a light-colored shirt, dark pants, and a dark hat. He is also sitting with his legs crossed, and his hands are resting on his knees.

In the foreground, there is a person's leg visible on the left side of the image, wearing light-colored pants. The background of the image shows a wooden porch with a door behind the two men. The porch appears to be attached to a house or building, and there is grass in front of it.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of two men sitting on the porch of a house, with another man standing in the doorway and a fourth man partially visible in the foreground.

Key Elements:

  • Two Men on the Porch: The man on the left is wearing a light-colored shirt and pants, while the man on the right is dressed in dark attire. Both men are seated on the porch, with the man on the left holding a lit cigarette.
  • Man in the Doorway: A third man is standing in the doorway, wearing dark pants and a white shirt. His upper body is visible, but his face is not clearly seen.
  • Man in the Foreground: A fourth man is partially visible in the foreground, with only his legs and torso visible. He appears to be wearing light-colored clothing.
  • House: The house features horizontal siding and a wooden porch with a railing. The door is open, allowing the man in the doorway to be seen.
  • Grass: The ground in front of the house is covered with tall grass, which adds to the rustic atmosphere of the scene.

Overall Impression:

The image conveys a sense of relaxation and camaraderie among the men, who seem to be enjoying each other's company on a warm day. The black-and-white tone of the photograph adds a nostalgic feel to the scene, evoking a sense of simplicity and tranquility.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The black-and-white photo depicts a scene of four people sitting on the porch of a house. Two of them are sitting on the porch, and the other two are standing in front of the door. The two sitting on the porch are looking at something, and one of them is holding a cigarette. The two standing in front of the door are looking at something on the porch. The porch has a wooden floor and a white wall.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white photo shows three men standing in front of a house with a porch. The two men are sitting on the edge of the porch, while the other one is standing on the grass. The man on the left is holding a cigarette in his hand, while the man on the right is wearing a hat and holding a cane. Behind them is a man standing on the porch, leaning on the wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

Overall Impression:

The photograph is a black and white shot that captures a moment of stillness and introspection. It depicts a scene on a porch of a modest home, with three men present. The overall mood is one of quiet observation.

Key Elements:

  • Men: There are three men featured. One man sits on the steps smoking, appearing contemplative. Another man is sitting with legs stretched and arms crossed. The third man, partially visible in the foreground, is holding a long, dark object that could be a tool of some kind, with his back to the camera. A fourth man is standing near the doorway, but he isn't as involved with the other two men's position.
  • Setting: The backdrop of the scene is a simple house with horizontal siding. The porch is weathered, with a grassy area in the foreground.
  • Atmosphere: The lighting and composition give a feeling of realism and documentary style. It could be a scene from a period of time where smoking cigarettes was common.

Possible Interpretations:

The image could represent a scene of rest or a break from work, the men engaged in personal thoughts, or a chance to reflect on a situation. The image might capture the details of everyday life.

Let me know if you'd like a more detailed breakdown of any aspect!

Created by gemini-2.0-flash on 2025-05-25

In a black and white photograph, two men sit on the porch of a house, lost in thought, while another man stands in the foreground, partially cropped.

To the left, one man sits with his legs spread apart, hands clasped in front of him, and a cigarette between his lips. His gaze is directed downwards, conveying a sense of contemplation. He is dressed in a light-colored shirt and pants.

To the right, another man sits with his legs crossed, one hand resting on his knee, and the other tucked under his arm. He wears a hat and a collared shirt. Behind him, the partial figure of another person is visible in the doorway of the house.

In the foreground, a man stands with his back to the viewer, holding a long object that appears to be a stick or tool. The grass in front of the porch is unkempt, adding to the rustic feel of the scene. The house itself is simple, with a horizontal siding pattern. The lighting is soft, casting subtle shadows that add depth to the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting two men sitting on a wooden porch of a house with horizontal siding. The man on the left is dressed in light-colored clothing, including a shirt with rolled-up sleeves, pants, and suspenders. He is smoking a cigarette. The man on the right is wearing a hat, a light-colored shirt, and dark pants. He is sitting with his hands on his knees and appears to be looking towards the camera. Another person is partially visible standing in the doorway behind them. The setting appears to be rural, as suggested by the grassy ground and the simple construction of the house. The overall atmosphere of the image suggests a moment of relaxation or casual conversation.

Qwen