Human Generated Data

Title

Untitled (unemployed trappers, Plaquemines Parish, Louisiana)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3186

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (unemployed trappers, Plaquemines Parish, Louisiana)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3186

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Photography 99.9
Face 99.9
Head 99.9
Portrait 99.9
Sun Hat 99.9
Food 94.7
Fruit 94.7
Plant 94.7
Produce 94.7
Body Part 87.4
Finger 87.4
Hand 87.4
Cap 56
Smoke 55.9
Sitting 55

Clarifai
created on 2018-05-10

people 100
adult 99.2
two 98.2
man 97.7
portrait 97.5
group 97.4
wear 96.3
veil 95.9
three 95.6
one 94.8
group together 93.3
administration 92.1
lid 91.5
woman 90.8
several 90.1
four 89.8
sit 86.9
war 81.9
recreation 81.5
elderly 81.3

Imagga
created on 2023-10-06

hat 66.6
cowboy hat 40.1
male 39
man 38.3
person 28.9
headdress 28.6
people 28.4
clothing 26
adult 25.2
happy 22.5
portrait 21.3
smile 19.2
sitting 18
face 16.3
looking 16
work 15.7
men 15.4
cowboy 15.1
worker 15.1
working 15
two 14.4
smiling 13.7
one 13.4
happiness 13.3
black 13.2
indoors 13.2
job 12.4
senior 12.2
building 12.1
guy 12
outdoors 11.9
casual 11.9
old 11.8
child 11.7
handsome 11.6
hand 11.4
old-timer 11.4
western 10.6
business 10.3
shirt 10.3
industry 10.2
covering 10.1
model 10.1
occupation 10.1
passenger 10.1
consumer goods 9.6
look 9.6
couple 9.6
home 9.6
boy 9.6
attractive 9.1
helmet 8.9
cheerful 8.9
lifestyle 8.7
construction 8.5
sit 8.5
pair 8.5
professional 8.5
travel 8.4
office 8.3
friendly 8.2
grandfather 8.2
alone 8.2
children 8.2
seller 8
businessman 7.9
sombrero 7.9
jacket 7.9
girlfriend 7.7
husband 7.6
head 7.6
fashion 7.5
mature 7.4
emotion 7.4
20s 7.3
world 7.3
industrial 7.3
computer 7.2
suit 7.2
hair 7.1
love 7.1
interior 7.1
country 7
together 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.8
man 96.9
outdoor 90.4
old 46.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Sad 99.8%
Angry 12.9%
Calm 12.4%
Surprised 6.4%
Fear 6.1%
Confused 1.9%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 95.3%
Surprised 6.3%
Fear 6.1%
Sad 2.9%
Confused 1.1%
Happy 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.5%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat

Clarifai

Human face
Man
Boy
Human nose
Sun hat
Clothing
Human hand
Human mouth
Tree
Human eye
Human hair
Glasses

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.3%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 98.8%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 98.8%

AWS Rekognition

Hat 97.9%

Clarifai

Human face 93.9%

Clarifai

Human face 87.5%

Clarifai

Human face 87.5%

Clarifai

Man 92.6%

Clarifai

Man 90.2%

Clarifai

Boy 58.3%

Clarifai

Human nose 44.6%

Clarifai

Human nose 42%

Clarifai

Human nose 40.9%

Clarifai

Sun hat 44.1%

Clarifai

Clothing 41.3%

Clarifai

Human hand 39%

Clarifai

Human mouth 38.9%

Clarifai

Human mouth 34.3%

Clarifai

Tree 36.4%

Clarifai

Human eye 34.8%

Clarifai

Human hair 34.2%

Clarifai

Glasses 33.6%

Categories

Imagga
created on 2023-10-06

paintings art 62.3%
pets animals 18.6%
nature landscape 15%
people portraits 3.4%

Captions

Microsoft
created by unknown on 2018-05-10

an old photo of a man 92.5%
a group of people sitting at a bus stop 61%
a man sitting on a bus 37.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

two men sitting on the ground with a hat on one of them

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man in a hat and a woman in a hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image shows two men sitting outdoors in front of a rustic wooden structure. One is wearing a denim jacket, and the other is dressed in a light-colored shirt and a straw hat. The atmosphere suggests a rural or agricultural setting, with weathered wood and simple clothing indicating hard work and modest living conditions. Their postures suggest they may be resting or engaged in a conversation.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts two individuals seated side by side against the backdrop of a wooden structure. The person on the left is wearing a long-sleeved denim shirt with rolled-up sleeves, buttons visible down the front, and light-colored trousers. Their arm is bent with their hand resting near their face. The person on the right is dressed in a long-sleeved, light-colored shirt with the sleeves also rolled up, wearing a straw hat. Their hands are resting on their knee. The setting suggests a rural or rustic environment, evoking a sense of simplicity and work.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows three men sitting together in what appears to be a rural or rustic setting. The men are dressed in casual, worn clothing, and one is wearing a wide-brimmed hat. The background suggests an old wooden structure or building. The image has a black and white, documentary-style aesthetic, capturing a moment of quiet contemplation or interaction between the individuals.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from an earlier historical period. It shows three people sitting outside what looks like a wooden building or structure. One person wears a dark jacket and sits with a contemplative expression, while another wears a light-colored shirt and a wide-brimmed hat. A third person can be partially seen in the background. The image has a documentary style quality typical of Depression-era or rural American photography, capturing what appears to be a moment of rest or reflection in what may be a rural or agricultural setting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

This image is a black-and-white photograph of three individuals, likely taken in the early 20th century. The photograph features two men and a child, all of whom appear to be African American.

The man on the left is attired in a dark jacket and light-colored pants, with his right hand raised to his chin. He has short hair and is seated with his legs crossed.

The man on the right wears a light-colored shirt and a wide-brimmed straw hat. He also has short hair and is seated with his legs crossed, facing the camera.

Behind the two men, a child is partially visible, wearing a light-colored shirt. The background of the image appears to be a wooden structure, possibly a cabin or shack.

The overall atmosphere of the photograph suggests that it was taken during a time of hardship or struggle, possibly during the Great Depression or the Jim Crow era in the United States. The individuals in the photograph seem to be posing for the camera, but their expressions are somber and serious. The photograph may have been taken by a documentary photographer or a sociologist seeking to capture the lives of African Americans during this period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of three individuals, likely taken in the early 20th century. The man on the left wears a dark shirt and light pants, with his hand resting on his chin. The man on the right sports a light-colored shirt and a straw hat, while the child in the background wears a plaid shirt.

The photograph appears to be taken outdoors, with a wooden building serving as the backdrop. The overall atmosphere suggests a casual, everyday moment captured by a photographer.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image is a black-and-white photograph of three individuals sitting on a wooden bench or platform. The setting appears to be outdoors, with a wooden structure visible in the background. The individuals are dressed in simple, rustic clothing, suggesting a rural or agricultural setting. The man on the left is wearing a denim jacket and has a contemplative expression, with his hand resting on his chin. The man in the middle is wearing a wide-brimmed hat and has a serious expression. The third person, a child, is sitting between the two men and is wearing glasses. The image captures a moment of quiet contemplation or reflection, with the individuals' expressions and body language suggesting a sense of introspection or contemplation. The overall tone of the image is somber and reflective, with a sense of simplicity and authenticity that is characteristic of black-and-white photography.

Created by amazon.nova-pro-v1:0 on 2025-05-26

The image is a black-and-white photograph of two men and a child. The men are sitting on the ground, facing the camera. The man on the left is wearing a jacket and has his hand on his chin. The man on the right is wearing a hat and a shirt. Behind them, there is a child standing, and in the background, there is a wooden structure.

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

In a grayscale photograph, two men are seated next to each other outside a weathered wooden structure, with a young child visible in the background between them. The man on the left, who appears younger, is wearing a button-down shirt or jacket and has his hand raised to his chin in a contemplative pose. His gaze is directed towards the viewer. The man on the right wears a light-colored button-down shirt and a wide-brimmed straw hat, casting a shadow over his face. He is looking off to the side, away from the camera. The wooden structure behind them appears to be a simple building with horizontal planks, showing signs of age and weathering. A wooden post is visible between the two men. The child in the background is partially obscured but appears to be looking towards the right side of the frame. The overall composition and subject matter suggest a candid shot, possibly capturing a moment in the lives of these individuals.

Created by gemini-2.0-flash-lite on 2025-04-30

The image is a black and white photograph depicting three people, likely taken outdoors. The main subjects are two men, one on the left and one on the right.

The man on the left, closer to the camera, has dark skin and is wearing a button-down denim shirt. He has his hand under his chin, giving the impression of contemplation.

The man on the right is wearing a straw hat with a wide brim. He is dressed in a light-colored shirt and has a serious expression.

Behind the two men, partially obscured, is a small child with dark skin who appears to be peeking out from behind the two men. The background consists of weathered wooden planks, suggesting the photo was taken in a rural environment. The overall mood of the image seems serious and possibly somber, reflecting the stoic expressions of the men.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting three individuals in what appears to be a rural setting. The two men in the foreground are seated on a wooden bench or platform. The man on the left is younger, wearing a dark jacket and pants, and has his left hand resting on his knee while his right hand is positioned near his face. He looks directly at the camera with a neutral expression.

The man on the right is older, wearing a light-colored shirt and a wide-brimmed hat. He is seated with his arms resting on his legs and looks slightly to the side, not directly at the camera. His expression appears contemplative.

In the background, partially obscured, is a third individual, possibly a woman, who is also seated and looking away from the camera. The setting includes a wooden structure, likely a house or a barn, with visible wooden planks and a weathered appearance. The overall atmosphere suggests a moment of rest or pause in a rural, possibly agricultural, environment.

Qwen

No captions written