Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

Date

July 30, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.327

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.327

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Pants 100
Bench 99.6
Furniture 99.6
Sitting 99.1
Shirt 97.6
People 97.3
Face 95.9
Head 95.9
Photography 95.9
Portrait 95.9
Footwear 90.1
Couch 87.1
Sun Hat 85.5
Outdoors 83.2
Formal Wear 81.4
Grass 70.6
Plant 70.6
Nature 70.3
Accessories 57.8
Tie 57.8
Shorts 57.4
Suit 57.2
Cap 57
Architecture 56.9
Building 56.9
Housing 56.9
House 56.3
Porch 56.3
Garden 56.2
Gardening 56.2
Coat 55.9
Gardener 55.4

Clarifai
created on 2018-05-11

people 99.9
group 98.8
group together 98.8
adult 98.7
man 97.6
woman 95.5
several 94.7
four 93.7
three 93.6
administration 93
leader 91.7
five 89.7
wear 89.4
many 88.8
sit 87.9
offspring 85.4
two 84.7
war 80
recreation 79.4
military 77.8

Imagga
created on 2023-10-07

grass 33.2
man 29.6
field 28.5
outdoor 26
person 23
outdoors 22.4
outside 22.3
people 21.8
male 20.1
summer 18.7
landscape 17.9
kin 17.3
boy 16.5
child 15.6
farmer 15.6
sky 14.7
farm 14.3
countryside 13.7
active 13.5
meadow 12.6
hiking 12.5
park 12.4
men 12
happy 11.9
old 11.8
leisure 11.6
rural 11.5
country 11.4
walking 11.4
sitting 11.2
day 11
activity 10.8
kid 10.6
autumn 10.5
together 10.5
adult 10.4
rest 10.2
relax 10.1
environment 9.9
work 9.8
backpack 9.8
working 9.7
cowboy 9.7
agriculture 9.7
elderly 9.6
resting 9.5
spring 9.4
happiness 9.4
relaxing 9.1
fun 9
couple 8.7
forest 8.7
lifestyle 8.7
farming 8.5
two 8.5
clouds 8.5
free 8.4
joy 8.4
dog 8.3
teenager 8.2
children 8.2
family 8
to 8
businessman 8
smile 7.8
tool 7.8
sport 7.7
garden 7.5
dairy 7.5
senior 7.5
natural 7.4
freedom 7.3
sun 7.2
fall 7.2
portrait 7.1
mountain 7.1
rice 7.1

Microsoft
created on 2018-05-11

grass 100
outdoor 99.8
person 88.7
old 71.7
group 62.3
posing 50.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 58-66
Gender Male, 99.6%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 85.6%
Sad 9.2%
Surprised 6.3%
Fear 5.9%
Confused 2.5%
Angry 0.6%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.5%
Angry 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Shoe
Hat

Clarifai

Man
Footwear
Plant
Clothing
Human face
House
Human arm

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 95.8%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 95.8%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 95.8%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 95.8%

AWS Rekognition

Shoe 90.1%

AWS Rekognition

Hat 74.3%

AWS Rekognition

Hat 58.2%

Clarifai

Man 94.5%

Clarifai

Man 94.1%

Clarifai

Man 90.9%

Clarifai

Man 74.1%

Clarifai

Footwear 76.8%

Clarifai

Footwear 67.3%

Clarifai

Footwear 65%

Clarifai

Footwear 64.5%

Clarifai

Footwear 62.3%

Clarifai

Footwear 59.1%

Clarifai

Footwear 55.4%

Clarifai

Footwear 53.9%

Clarifai

Footwear 53.4%

Clarifai

Footwear 46.5%

Clarifai

Footwear 46.4%

Clarifai

Footwear 45.4%

Clarifai

Footwear 40.6%

Clarifai

Plant 68.7%

Clarifai

Clothing 54.3%

Clarifai

Human face 54.2%

Clarifai

Human face 52.5%

Clarifai

Human face 42.1%

Clarifai

House 39.6%

Clarifai

Human arm 35.9%

Clarifai

Human arm 34.6%

Categories

Imagga
created on 2023-10-07

paintings art 63.4%
nature landscape 23.4%
people portraits 5.5%
streetview architecture 4.3%
pets animals 2%
beaches seaside 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of men sitting on a bench in front of a house

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of four men sitting on a porch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts a group of four men outside a wooden house. Three of the men are seated on a porch with visible steps, while one man stands to the left, partially cut off in the frame. The porch features a vertical railing design and a visible pillar supporting the structure. The yard in front of them consists of unkempt grass and scattered leaves, creating a rustic atmosphere. The seated individuals appear dressed in formal or semi-formal clothing, including button-up shirts, ties, and hats, suggesting a time period from the early to mid-20th century. A chair is visible in the background near the wall of the house.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image shows four men in a monochrome photograph, sitting on the steps of a porch in front of a house with horizontal siding. The man on the far left is standing and wearing dark trousers and a light-colored shirt, with his hands in his pockets. The three men sitting on the steps are dressed in formal attire typical of the early to mid-20th century. They wear button-up shirts, with the man on the right sporting a patterned shirt and a brimmed hat. The porch has a simple wooden design with a visible chair or object in the background. The foreground features grass and scattered leaves, indicative of a yard or rural setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows four older men sitting on a wooden porch or platform. They appear to be wearing casual, working-class clothing such as overalls, button-down shirts, and hats. The men have a weathered, hardworking appearance, suggesting they may be farmers or laborers. They are seated in a grassy area, with a wooden structure or building visible behind them. The image has a black and white, vintage aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from an earlier era, possibly the 1930s or 1940s. Three men are sitting on what looks like a wooden porch or steps of a building with white siding. There's also a partial view of someone standing at the left edge of the frame. The seated men are dressed in typical working-class attire of the period - one wears suspenders, another is in a checkered shirt with a tie, and they're wearing hats common to that era. The image has a casual, candid quality, as if capturing a moment of rest or conversation among working men. There's overgrown grass or weeds visible in the foreground of the image.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

The image depicts a black-and-white photograph of four men sitting on the porch of a house. The men are dressed in casual attire, with the man on the left wearing dark pants and a white shirt, while the other three men wear light-colored shirts and pants. The man on the far right is also wearing a tie and a hat.

In the background, there appears to be a chair on the porch, and another person's legs can be seen standing behind the men. The porch is surrounded by grass, which suggests that the house is located in a rural or suburban area.

Overall, the image conveys a sense of relaxation and camaraderie among the men, who seem to be enjoying each other's company on a warm day.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image depicts a black-and-white photograph of three men sitting on a porch, with one man standing to the left. The men are dressed in casual attire, with the two seated men wearing suspenders and hats. The man standing is wearing dark pants and a light-colored shirt.

The porch is constructed from wooden planks and features a small step leading up to it. The background of the image shows a wall made of horizontal wooden boards, with a chair visible behind the seated men. The overall atmosphere of the image suggests a relaxed and informal setting, possibly a rural or small-town scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

A black-and-white image of a group of men sitting on the porch of a house. One of them is standing, and his hands are on his waist. The three men are sitting on a bench, and one of them is smoking a cigarette. They are all wearing hats and shoes. The porch has a wooden floor and a wooden railing. There is a chair on the left side of the porch.

Created by amazon.nova-lite-v1:0 on 2025-05-23

A black-and-white photo shows four men sitting on a wooden porch of a house. Three of them are sitting on the porch, while one is standing. The man on the left is standing with his hands on his waist. The man in the middle is smoking a cigarette. The man on the right is wearing a hat and glasses. The porch has a wooden railing, and there is a small wooden chair on the left side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-28

Here's a description of the image:

Overall Impression:

The photograph appears to be a vintage black and white shot, likely from the early to mid-20th century. It captures a group of men on what looks like the porch or steps of a building. The image has a slightly grainy quality, characteristic of older photography.

Composition:

  • The primary focus is on the four men. Three are seated on what appears to be porch steps. One is standing to the left.
  • The men are positioned relatively close to the camera, giving a sense of intimacy.
  • The scene is framed by the porch and the overgrown grass in the foreground.

People:

  • The Men: They are all men, wearing simple clothing that suggests a working-class or rural setting. They have a relaxed posture.
  • Clothing: The men are wearing a mix of button-down shirts, trousers, hats, and suspenders. One has a tie and is smoking a cigarette.
  • Expression: The men's facial expressions appear relaxed.

Setting:

  • Porch: They are on a porch or a set of wooden steps, likely attached to a house or building with siding.
  • Foreground: The ground is covered in tall grass and some debris, giving the impression of a somewhat unkempt outdoor area.
  • Background: A light-colored wall with horizontal siding.

Atmosphere:

The overall feel of the photograph is one of casualness and a moment captured in time. The style and quality evoke a sense of nostalgia.

Created by gemini-2.0-flash on 2025-04-28

Here's a description of the image:

This black and white photograph depicts a group of four men on a porch. Three are seated, while one stands. They are all wearing casual attire. The man on the left wears overalls and a hat, and the man on the right has a hat and is smoking. The porch is old and weathered, with a wooden railing. The ground in front of the porch is covered in grass and weeds. The overall impression is one of rural life in the early 20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a black-and-white photograph depicting four older men sitting and standing on the steps of a wooden porch. The setting appears to be rural, indicated by the grassy area in front of the porch and the wooden siding of the house.

Here's a detailed description of each individual:

  1. Man on the far left: He is standing with his back to the camera, wearing dark pants and a light-colored shirt. His hands are on his hips.

  2. Second man from the left: He is seated on the steps, wearing a white shirt, dark pants, and suspenders. He also has a light-colored hat on his head and is looking directly at the camera.

  3. Third man from the left: He is seated next to the second man, wearing a white shirt and light-colored pants. He has a serious expression and is looking straight ahead.

  4. Man on the far right: He is seated on the steps, wearing a checkered shirt, dark pants, and a light-colored hat. He is holding a cigarette in his right hand and appears to be looking off to the side.

The overall atmosphere of the image suggests a casual, relaxed moment, possibly capturing a gathering of friends or family members. The clothing and setting hint at an earlier time period, possibly the mid-20th century.

Qwen

No captions written