Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

Date

July 30, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.762

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.762

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Photography 99.9
Sitting 94.5
Bench 93.6
Furniture 93.6
People 83.2
Tripod 79.2
Face 77.6
Head 77.6
Clothing 77.2
Pants 72.2
Stick 69.1
Portrait 68.6
Outdoors 64.4
Firearm 56
Gun 56
Rifle 56
Weapon 56
Grass 55.8
Plant 55.8
Nature 55.4
Photographer 55.3

Clarifai
created on 2018-05-11

people 100
adult 99
group together 97.7
two 97.1
man 96.5
group 96.3
woman 95.4
three 94.6
one 92.2
four 91.1
child 90.8
home 89.5
campsite 88.5
wear 88.1
war 86.5
several 86.2
administration 85.6
offspring 84.4
canine 83.2
family 82.8

Imagga
created on 2023-10-05

tool 87.8
rake 79.2
shovel 27.5
man 26.9
outdoor 26
outdoors 20.9
male 20.6
lawn mower 19.3
people 19
hand tool 18.4
sport 18.1
adult 18.1
grass 17.4
person 16.4
weapon 16.2
park 15.6
garden tool 15.5
swing 15.1
field 15.1
leisure 14.9
barrow 14.5
forest 13.9
activity 13.4
landscape 13.4
summer 12.9
active 12.6
autumn 12.3
countryside 11.9
old 11.8
fall 11.8
recreation 11.7
handcart 11.6
men 11.2
outside 11.1
walking 10.4
work 10.2
lifestyle 10.1
environment 9.9
trees 9.8
sky 9.6
relax 9.3
freedom 9.1
sunset 9
wheeled vehicle 8.9
hiking 8.7
walk 8.6
hobby 8.5
garden 8.4
dark 8.4
fun 8.2
hat 8.2
bow and arrow 8.2
vacation 8.2
happy 8.1
suit 8.1
meadow 8.1
mountain 8
river 8
working 8
day 7.8
child 7.8
tree 7.7
mechanical device 7.7
adventure 7.6
lawn 7.5
free 7.5
senior 7.5
care 7.4
ecology 7.3
sun 7.2
farm 7.1
game 7.1
job 7.1
businessman 7.1
spring 7.1
rural 7
travel 7

Microsoft
created on 2018-05-11

grass 99.7
outdoor 97.6
old 47.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Angry 72.8%
Sad 9.2%
Calm 9.1%
Surprised 6.6%
Fear 6%
Confused 5.4%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 62-72
Gender Male, 100%
Calm 96.7%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 1.7%
Confused 0.6%
Disgusted 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Boy
Child
Hat

Clarifai

Clothing
Man
Footwear
Plant
Human face
House
Human hair
Human arm
Human hand
Human leg

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 97.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 97.9%

AWS Rekognition

Male 97.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 97.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 63%

AWS Rekognition

Boy 98.5%

AWS Rekognition

Boy 97.9%

AWS Rekognition

Child 98.5%

AWS Rekognition

Child 97.9%

AWS Rekognition

Hat 77.2%

Clarifai

Clothing 90.7%

Clarifai

Clothing 43%

Clarifai

Clothing 34.1%

Clarifai

Man 87%

Clarifai

Man 56%

Clarifai

Footwear 67.8%

Clarifai

Footwear 65.4%

Clarifai

Footwear 53.8%

Clarifai

Footwear 47.4%

Clarifai

Footwear 43.4%

Clarifai

Footwear 40.7%

Clarifai

Plant 64%

Clarifai

Human face 62.3%

Clarifai

Human face 60.1%

Clarifai

House 50.1%

Clarifai

Human hair 43%

Clarifai

Human arm 42.2%

Clarifai

Human arm 42%

Clarifai

Human arm 33.9%

Clarifai

Human hand 34.7%

Clarifai

Human leg 33.5%

Categories

Imagga
created on 2023-10-05

paintings art 69.9%
streetview architecture 19.5%
nature landscape 5.6%
pets animals 2.5%

Captions

Microsoft
created by unknown on 2018-05-11

an old photo of a man 86%
a black and white photo of a man 78.5%
old photo of a man 78.4%

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a rural setting with a wooden structure in the background, possibly a porch connected to a house. Two individuals are seated on the steps of the porch, one with a relaxed posture and the other leaning slightly to one side. Both are dressed in casual clothing, appearing to be work attire. Another figure stands nearby holding what looks like a long stick or cane, with grass covering the foreground. A fourth person, partially visible, stands near the door of the house wearing a belt and trousers. The overall atmosphere suggests a quiet, outdoor moment in a countryside or small-town setting.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts three men on a porch. Two men are sitting on the steps with their hands resting on their knees. They are wearing long-sleeved shirts and trousers. One has his legs crossed while the other sits with his legs apart. A third person, wearing pants with a belt, is standing in the background. In the foreground, there is a man with a cane or walking stick. The area in front of the porch is grassy, and the building has horizontal siding and a visible porch column.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image depicts two men sitting on the ground outside a wooden building. One man is sitting with his legs crossed, while the other is sitting with his legs stretched out. Both men appear to be wearing casual clothing, such as shirts and pants. The background shows a wooden structure, possibly a shed or small building, and the ground is covered in grass. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era. In the image, several people are sitting on what looks like a wooden porch or deck. They are dressed in work clothes typical of the early 20th century, with collared shirts and one person wearing what appears to be a bowler hat. The porch is elevated above an overgrown grassy area below. The building behind them appears to have horizontal wooden siding. The photo has a casual, informal quality to it, as if capturing a moment of rest or conversation during a workday.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

This image is a black-and-white photograph of four men sitting on the porch of a house. The man on the left is sitting on the porch, wearing a light-colored shirt and pants, with a cigarette in his mouth. He has a pen in his shirt pocket and is holding a cigarette lighter in his hands. The man on the right is also sitting on the porch, wearing a dark-colored hat, shirt, and pants, with suspenders. He is looking down at the ground.

In the foreground, there is a person's leg and a cane visible, but their face is not shown. In the background, there is a doorway to the house, and another person is standing in the doorway, but only their torso and arms are visible. The overall atmosphere of the image suggests a relaxed and casual gathering of friends or family members.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of two men sitting on the porch of a house. The man on the left is wearing a light-colored shirt, pants, and shoes, and is holding a lit cigarette in his right hand. He has a pen or pencil in his left shirt pocket and appears to be looking down at something in his hands. The man on the right is wearing a light-colored shirt, dark pants, and shoes, and is wearing a dark hat. He is looking down at the ground with his hands clasped together in front of him.

In the foreground, there is a person's back and arm visible on the left side of the image. They are wearing light-colored clothing and appear to be holding a long object, possibly a cane or walking stick. The background of the image shows the exterior of a house with light-colored siding and a porch. The porch has a railing and a door that is slightly ajar. The overall atmosphere of the image suggests a relaxed and casual setting, possibly a rural or small-town scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black-and-white photo shows three men on the porch of a house. Two of them are sitting on the wooden floor of the porch, while the other is standing on the grassy ground in front of them. The man on the left is holding a cane. The man in the middle is smoking a cigarette, while the man on the right is wearing a hat and holding a stick. Behind them is a wooden door.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph of a scene from the past, capturing a moment on the porch of a house. Two men are seated on the porch, one wearing a hat and the other holding a cigarette. The man with the cigarette is leaning back with his hands on his knees, while the other man has his hands resting on his lap. Behind them, a third man stands in the doorway, looking at the seated men. The porch has a wooden floor and a white wall, and there is a small patch of grass in front of the porch. The photograph has a vintage feel, with a soft focus and a warm, nostalgic tone.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Here is a description of the image:

The black and white photograph features three men on the porch of a house. One man sits on the porch with his legs crossed, smoking a cigarette. Another man sits on the edge of the porch, his hat covering his eyes, and his hands crossed. A third man stands in the foreground, holding a cane.

The house behind the men is simple, with a wood siding and a small porch. The lawn in front of the house is overgrown. The image has a grainy quality, and the details are not very sharp. The image is evocative of rural poverty.

Created by gemini-2.0-flash-lite on 2025-06-05

Here's a description of the image:

Overall Impression: The image is a black and white photograph capturing a scene of three men outdoors, seemingly resting on a porch. The style suggests it could be from the mid-20th century.

Key Elements and Composition:

  • Subject: The focus is on the men. Two are seated on a porch, while a third is partially visible on the left, holding what appears to be a cane or a staff.
  • Location: The backdrop appears to be a wooden house or building with horizontal siding. The men are positioned on a porch.
  • Atmosphere: The mood is relaxed, perhaps a moment of rest or a break. The presence of a cigarette held by one of the men contributes to this feeling.
  • Details:
    • The man in the center is sitting and smoking.
    • The man to the right is wearing a hat.
    • The man on the left is partially in the frame.
    • The foreground is filled with grass.

Technical Aspects:

  • The image is in black and white, which gives it a vintage feel.
  • The lighting appears to be natural, possibly from daylight.

Overall, the photograph evokes a sense of quiet observation of everyday life, possibly capturing a moment of leisure or conversation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a group of men sitting on the porch of a wooden house. The setting appears to be rural, and the photograph likely dates back to the early 20th century.

Here are the details:

  1. Setting: The house has a wooden exterior with horizontal siding. The porch has a wooden floor and steps leading up to it. The grass in front of the porch is somewhat overgrown.

  2. People:

    • There are three men visible in the image.
    • The man on the left is sitting on the porch steps. He is wearing a light-colored shirt, dark pants, and a hat. He appears to be looking downward or at something in his hands.
    • The man in the middle is seated on the porch floor with his back against the house. He is wearing a light-colored shirt and pants, and he appears to be holding something in his hands, possibly a cigarette or pipe.
    • The man on the right is also sitting on the porch steps. He is wearing a light-colored shirt, dark pants, suspenders, and a hat. He is looking towards the camera.
    • There is a partial view of a fourth person on the left side of the image, but only their clothing is visible, not their face.
  3. Mood: The overall mood of the photograph is relaxed and casual, suggesting a moment of rest or leisure.

  4. Time Period: The clothing and overall setting suggest that the photograph was taken in the early to mid-20th century.

This image captures a moment of everyday life in a rural setting, providing a glimpse into the past.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This is a black-and-white photograph depicting two individuals seated on the steps of a house. The person on the left is wearing a light-colored shirt and trousers, and is smoking a cigarette, holding the stem in their hand. The person on the right is dressed in darker clothing, including a hat, and is leaning slightly forward with one hand resting on their knee and the other by their side. Both appear to be engaged in a casual and relaxed conversation.

The house has a simple, modest appearance with wooden siding and a porch. There is another individual partially visible on the left side of the image, standing in the foreground. The ground in front of the porch is covered with grass and some scattered debris or branches. The overall atmosphere of the image suggests a calm, rural setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph depicts a rural scene in front of a wooden building with horizontal siding. Two men are seated on the steps of the porch. The man on the left is wearing light-colored pants and a shirt, holding a pair of glasses in his hands and appears to be smoking a cigarette. The man on the right is wearing darker clothing and a hat, sitting with his legs crossed and holding a stick. There are other individuals partially visible in the image, one standing in the doorway of the building and another person's legs and part of a camera visible in the foreground on the left side. The ground in front of the porch is grassy. The overall atmosphere suggests a casual, everyday moment captured in a rural setting.