Human Generated Data

Title

Cotton checker, Pulaski County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3104

Human Generated Data

Title

Cotton checker, Pulaski County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3104

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.8
Clothing 84.4
Apparel 84.4
Field 75.5
Outdoors 73.6
Reading 66.8
Soil 66.1
Face 62.1
Countryside 58.8
Nature 58.8
Paper 57.3
Poster 57.2
Advertisement 57.2

Clarifai
created on 2023-10-15

people 99.7
portrait 99.5
one 98.4
adult 98.4
man 98
uniform 97.7
military 96.8
lid 96.5
soldier 96.1
war 95.6
wear 93.2
two 92.5
outfit 89.5
army 87.9
cap 87.8
vintage 85.1
field 83.8
skirmish 83.5
boy 81.8
veil 77.8

Imagga
created on 2021-12-15

person 54
farmer 49.8
people 35.2
field 33.5
grass 30.9
male 30.6
man 30.3
summer 29.6
outdoors 29.2
outdoor 29.1
happy 27
hat 26.8
outside 25.7
meadow 25.1
countryside 24.7
lifestyle 22.4
adult 22
happiness 22
child 21.6
active 21.6
sky 21.3
boy 20.9
portrait 19.4
cowboy hat 18.8
smiling 16.7
scholar 16.5
sitting 16.3
fun 15.7
vacation 15.6
clothing 15.4
joy 15.1
leisure 15
park 14.8
freedom 14.6
free 14.1
father 13.9
intellectual 13.2
autumn 13.2
looking 12.8
dad 12.8
casual 12.7
relax 12.7
headdress 12.4
rural 12.4
country 12.3
senior 12.2
standing 12.2
one 12
work 11.8
spring 11.8
recreation 11.7
activity 11.7
natural 11.4
healthy 11.4
couple 11.3
pretty 11.2
men 11.2
landscape 11.2
rest 11.1
youth 11.1
childhood 10.8
family 10.7
kid 10.6
success 10.5
day 10.2
clouds 10.2
back 10.1
alone 10.1
smile 10
hay 9.9
farm 9.8
attractive 9.8
agriculture 9.7
hiking 9.6
parent 9.6
play 9.5
walking 9.5
sunny 9.5
enjoying 9.5
laughing 9.5
holiday 9.3
relaxation 9.2
fit 9.2
adolescent 9.2
teen 9.2
playing 9.1
children 9.1
relaxing 9.1
sun 8.9
together 8.8
look 8.8
cute 8.6
resting 8.6
sport 8.4
health 8.3
human 8.3
environment 8.2
player 8.2
wheat 8.2
exercise 8.2
cheerful 8.1
juvenile 8.1
love 7.9
worker 7.8
full length 7.8
two 7.6
hand 7.6
peace 7.3
fall 7.3
military uniform 7.1
handsome 7.1
little 7.1

Google
created on 2021-12-15

Sky 95.2
Shirt 93.9
Ecoregion 92.6
Cap 86.8
Plant 85.6
Grass 82.1
Grassland 79.8
Rural area 77.4
Landscape 77.1
Grass family 75.7
Agriculture 75.7
Field 71.5
Monochrome photography 70.8
Farmer 69.5
Monochrome 69.1
Prairie 68.5
Soil 63.7
Steppe 62.5
Elbow 59.4
Farm 59.3

Microsoft
created on 2021-12-15

outdoor 99.3
man 97.3
grass 95.5
person 94.4
clothing 88.2
text 87.9
sky 85.3
field 78.3
hat 66.4
human face 63.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Male, 90.4%
Calm 91.3%
Sad 4.4%
Angry 1.5%
Surprised 1.5%
Confused 0.4%
Disgusted 0.4%
Fear 0.3%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

No features identified

AWS Rekognition

Person 99.8%

AWS Rekognition

Hat 84.4%

Categories

Imagga
created on 2021-12-15

pets animals 72.3%
nature landscape 23.2%
paintings art 4.2%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a hat and a hat is holding a book

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows a person outdoors in a rural landscape with an expansive field in the background. The individual is wearing a light-colored button-up shirt with rolled sleeves and a flat cap, holding a book or notebook in their hand. The field behind them has scattered bundles of harvested crops, and the distant horizon is characterized by open land and sparse vegetation. The overall scene conveys a quiet, agricultural setting.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a person standing in a field, holding an open book or notebook in their hands as if they are reading or writing. The person is wearing a cap and a short-sleeved shirt with the sleeves rolled up. The field around them is expansive and appears to be an agricultural area, with rows of crops or plants and some stacks of material in the distance. The horizon is flat with a line of trees, and the sky is clear, suggesting a serene outdoor setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a man standing in a field, reading a book. He is wearing a cap and a light-colored shirt. The background appears to be a rural landscape with some trees or vegetation visible in the distance. The image has a black and white, documentary-style aesthetic.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be historical in nature. It shows a young man in profile standing in what looks like a rural or agricultural field. He's wearing a flat cap (newsboy cap), a light-colored shirt with rolled-up sleeves, and is holding what appears to be a book or notebook that he is reading or writing in. The background shows an open field with what might be harvested crops or hay bales in the distance. The image has a documentary or journalistic quality to it, possibly from the early-to-mid 20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man standing in a field, holding a book or notebook in his hands.

The man is wearing a light-colored short-sleeved shirt and a light-colored cap. He is facing to the right, but his head is turned slightly towards the camera. His left hand is holding the book or notebook, which appears to be open, while his right hand is holding a pen or pencil.

In the background, there is a field with tall grass and some trees in the distance. The sky above is overcast.

The overall atmosphere of the image suggests that the man is engaged in some kind of outdoor activity, possibly reading or writing in the field. The overcast sky adds a sense of serenity to the scene, and the man's relaxed posture suggests that he is enjoying the peaceful surroundings.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man standing in a field, holding a book and pen. The man is wearing a cap and a collared shirt with rolled-up sleeves. He is facing to the right, with his head turned slightly towards the camera. In his left hand, he holds a book, while his right hand grasps a pen.

In the background, there is a field with some trees visible in the distance. The sky above is overcast, suggesting that it may be an overcast day. The overall atmosphere of the image appears to be one of contemplation or study, as the man is engaged in reading or writing.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image depicts a black-and-white photograph of a man standing in a vast, open field. He is wearing a hat and a short-sleeved shirt, and he is holding a book in his hands. His body is slightly turned to the right, and he appears to be deeply engrossed in reading the book. The man's posture suggests a sense of focus and concentration, as he is standing still and looking down at the book. The field behind him is vast and appears to be a rural or agricultural setting, with some trees and bushes visible in the distance.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white photograph depicts a man standing in a field, holding a book. He is wearing a hat and a shirt. The man is looking down at the book while holding it in his hands. The field is covered with grass and has some dried plants. In the distance, there are trees, and the sky is clear. The man is probably reading the book while standing in the field.

Google Gemini

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

The black and white photograph features a man standing in a field. The man is African-American and is positioned in the foreground with his body facing to the right. He is wearing a cap and a light-colored shirt with the sleeves rolled up. The man is looking down at a book, which he holds open in his hands, and appears to be either reading or writing in it.

Behind the man, the field stretches out into the distance. Scattered throughout the field are what appear to be bundles or piles of harvested crops. The horizon is visible with a line of trees or low foliage in the background, suggesting a rural or agricultural setting. The sky overhead is bright, likely overcast.

The overall tone of the photograph is serene, with the man's focus on the book conveying a sense of quiet contemplation or diligence. The image has a vintage aesthetic.

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

Overall Impression: The image is a black and white photograph of a man standing in a field. It has a vintage feel, likely from the mid-20th century.

Subject: The central figure is a Black man, seen in profile. He wears a newsboy cap, a light-colored button-down shirt with rolled-up sleeves, and what appears to be dark pants. He's deeply engrossed in reading or writing in a book he holds in his hands.

Setting: The background is a large, grassy field with small haystacks or bundles of crops scattered around. The horizon is a distant treeline, and the sky appears overcast or slightly hazy.

Composition: The photograph is composed with the man slightly off-center, to the right, giving a sense of the wide open space. The focus is on the man and his activity, with the field providing context.

Mood and Possible Context: The image suggests a rural setting, possibly farmland. The man could be a farmer, a farmworker, or someone related to agricultural activities. The image gives a thoughtful or contemplative mood. It could be capturing a moment of reflection, study, or record-keeping amidst the landscape. The photograph could also be a work of art or a historical document that highlights an important part of history.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a man standing in a field. He is wearing a light-colored shirt and a cap, and appears to be holding a book or a notebook in his hands. The man is looking down at the book, seemingly engrossed in reading or writing. The field around him is sparsely vegetated with some grass and small plants, and there are a few scattered trees in the background. The overall setting suggests a rural or agricultural environment. The photograph has a somewhat historical feel, possibly from the mid-20th century, given the style of clothing and the black-and-white format.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-03

The black-and-white photograph depicts a man standing outdoors in a field. He is wearing a flat cap and a short-sleeved, light-colored shirt, and he appears to be holding and reading a book or a notebook. The background shows an open field with dry vegetation and a line of trees or bushes in the distance. The overall scene suggests a rural or agricultural setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-03

This black-and-white photograph depicts a man standing in an open field, likely rural or agricultural. He is wearing a light-colored, short-sleeved shirt and a flat cap. The man is holding an open book or notebook and appears to be writing or reading, suggesting he might be taking notes or studying. The field behind him is mostly barren with some patches of grass and a few scattered bundles of harvested crops. The sky is clear, indicating it might be a sunny day. The overall atmosphere of the image conveys a sense of simplicity and the man's dedication to his task amidst a natural setting.