Human Generated Data

Title

Untitled (sharecroppers, Pulaski County, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3179

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (sharecroppers, Pulaski County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3179

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Blouse 99.7
Clothing 99.7
Accessories 99.3
Jewelry 99.3
Necklace 99.3
Earring 97.4
Body Part 77.7
Finger 77.7
Hand 77.7
Wood 56.9
Happy 56.4
Smile 56.4
Neck 55.9
People 55.9
Lady 55.6
Mouth 55.1
Teeth 55.1

Clarifai
created on 2018-05-10

people 100
portrait 99.8
one 99.6
adult 99.5
man 99
elderly 98.6
two 97.5
wear 96.1
woman 90.6
facial expression 89.7
leader 89.3
sit 88.2
writer 86.3
music 86.1
monochrome 85.6
three 85.6
art 84.9
administration 81.4
group 76
old 75

Imagga
created on 2023-10-05

man 30.9
portrait 29.1
male 24.8
book jacket 23
person 21.3
money 21.3
currency 19.8
people 19.5
face 19.2
jacket 18.8
cash 18.3
old 18.1
one 17.2
close 16.6
cadaver 16.5
bank 16.1
adult 15.5
dollar 14.9
grandfather 14.8
world 14.4
paper 14.2
senior 14.1
black 13.8
banking 13.8
covering 13.6
wrapping 13.6
business 13.4
elderly 12.4
sculpture 12.4
vintage 12.4
bill 12.4
antique 12.1
ancient 12.1
mature 12.1
art 12
human 12
love 11.8
wealth 11.7
statue 11.6
pay 11.5
couple 11.3
rich 11.2
culture 11.1
finance 11
head 10.9
franklin 10.8
smile 10.7
hundred 10.7
happy 10.7
closeup 10.1
aged 10
ruler 9.8
financial 9.8
banknotes 9.8
retired 9.7
dollars 9.7
loan 9.6
eyes 9.5
savings 9.3
mask 9.2
painter 8.8
banknote 8.7
hair 8.7
finances 8.7
exchange 8.6
men 8.6
expression 8.5
bust 8.5
historic 8.3
husband 8.1
success 8.1
us 7.7
attractive 7.7
payment 7.7
economy 7.4
symbol 7.4
smiling 7.2
suit 7.2
romantic 7.1
family 7.1
mug shot 7
model 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

text 100
person 99.8
book 99.7
man 99.6
old 62.9
older 32.5

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 57-65
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2%
Angry 0.1%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 72
Gender Male

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man

Clarifai

Human face
Clothing
Man
Fashion accessory
Human hair
Human nose
Human hand
Human eye
Human mouth

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 99.4%

Clarifai

Human face 98.1%

Clarifai

Human face 94.2%

Clarifai

Clothing 97.7%

Clarifai

Man 77.2%

Clarifai

Fashion accessory 56.3%

Clarifai

Fashion accessory 34.5%

Clarifai

Human hair 50.7%

Clarifai

Human hair 43.6%

Clarifai

Human nose 48.3%

Clarifai

Human nose 40.6%

Clarifai

Human hand 41.9%

Clarifai

Human eye 40.9%

Clarifai

Human eye 36.5%

Clarifai

Human mouth 35%

Clarifai

Human mouth 33.1%

Categories

Imagga
created on 2023-10-05

paintings art 87.9%
pets animals 11.8%

Captions

Microsoft
created by unknown on 2018-05-10

an old photo of a man 94.6%
a man sitting on a book 65.6%
a man sitting on top of a book 65.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a woman sitting on a chair in front of a woman

Created by general-english-image-caption-blip-2 on 2025-07-07

an old black and white photo of two people sitting on a bench

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image shows two individuals sitting near a rustic wooden structure, possibly the exterior of a home. The person on the left is wearing a torn white shirt, revealing weathered hands and arms. The person on the right is dressed in a patterned garment, adorned with a beaded necklace. The overall atmosphere suggests a humble or rural setting, with an emphasis on texture in the worn clothing and aged wood in the background.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts two people sitting closely together. The person on the left is wearing a light-colored, long-sleeved shirt that is torn in several places, along with dark pants. Their hands are resting on their lap. The person on the right is wearing a checkered-patterned dress or top, accessorized with a necklace with beads or pearls. The background consists of wooden planks, suggesting that they might be sitting on a porch or in a rustic setting. The image is in black and white, and it conveys a sense of intimacy and togetherness.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows two elderly individuals, an older man and woman, sitting together in what appears to be a rustic, wooden structure. The man has a weathered, wrinkled face and a serious expression, while the woman has a pensive, contemplative look on her face. They seem to be engaged in some kind of conversation or interaction, though the exact nature of their relationship or the context of the scene is not entirely clear from the image alone. The black and white photograph has a timeless, documentary-style quality to it, capturing a moment in the lives of these two individuals.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a powerful black and white historical photograph showing two elderly individuals. On the left is someone wearing a light-colored shirt or garment, with their arms crossed. On the right is someone wearing a patterned dress or top and what appears to be a necklace. The image has a documentary-style quality typical of early to mid-20th century photography, and appears to capture a moment in African American history. The composition is intimate, with both subjects shown in close proximity, and the lighting creates strong contrasts typical of photography from this era. The wooden background and their clothing styles suggest this may have been taken in a rural or domestic setting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

This image is a black-and-white photograph of an elderly man and woman, likely from the early 20th century. The man, positioned on the left side of the image, wears a white shirt with the sleeves rolled up and a dark-colored pair of pants. He sits with his right arm resting on his right knee, while his left arm is bent at the elbow, with his hand curled into a fist. The woman, situated on the right side of the image, wears a checkered top and a beaded necklace. She has short hair and is gazing to her left.

The background of the image features a wooden structure, which appears to be a wall or a building. The overall atmosphere of the photograph suggests that it was taken in a rural setting, possibly during a time of hardship or struggle. The facial expressions of the individuals in the image convey a sense of resilience and determination, despite the challenges they may have faced.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image is a black-and-white photograph of an elderly man and woman sitting together. The man is wearing a white shirt with holes in it, and the woman is wearing a checkered dress with a pearl necklace. They are both sitting in front of a wooden wall, possibly a porch or a shed.

The man has a mustache and is looking to the left, while the woman is looking straight ahead. The woman's face is wrinkled, and she appears to be older than the man. The overall atmosphere of the image suggests that it was taken in a rural or countryside setting, possibly in the early 20th century.

The image appears to be a candid shot, capturing a moment in time between the two individuals. The contrast between the man's worn shirt and the woman's more elegant dress suggests a difference in their social status or occupation. The image may have been taken by a photographer who was interested in documenting the lives of ordinary people, or it may have been taken for a specific purpose, such as a family album or a historical record.

Overall, the image provides a glimpse into the lives of two elderly individuals who lived in a rural or countryside setting, and it offers a sense of the challenges and hardships that they may have faced.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image features two elderly individuals, an old man and an old woman, sitting side by side in a monochromatic setting. The old man has a white shirt and is wearing a white apron, while the old woman is wearing a checkered dress. Both are sitting on wooden surfaces, likely a porch or a veranda. The old man's hands are clasped together in his lap, and he has a serious expression on his face. The old woman has her hair tied back and is looking directly at the camera, her expression also serious. Behind them, there is a wooden structure, possibly a door or a wall. The image conveys a sense of simplicity and dignity, with the two elderly individuals sitting quietly and respectfully.

Created by amazon.nova-pro-v1:0 on 2025-05-25

The black-and-white photograph shows two people, a man and a woman, sitting on a wooden chair, probably in front of their house. The man is wearing a white long-sleeve shirt and has his hands on his lap. The woman is wearing a checkered shirt and a necklace. She has earrings and is looking at something. The wooden chair is placed in front of a wooden wall.

Google Gemini

Created by gemini-2.0-flash on 2025-05-22

The image is a black and white photograph depicting an older African American couple. The man is seated, wearing a light-colored, long-sleeved shirt with a wide, open collar, revealing a lower layer beneath. His hands are clasped in front of him, and his expression is neutral. A weathered mustache is visible on his face.

Beside him, the woman is positioned slightly lower, appearing to be seated or kneeling. She wears a patterned top, and a necklace adorns her neck. Her face is turned to the side, her gaze directed off-camera, with a thoughtful expression.

The backdrop is a textured, wooden wall or fence, adding a rustic element to the composition. The lighting is soft and even, highlighting the details of the subjects' faces and clothing.

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

The image is a black and white photograph featuring two older Black individuals, likely a man and a woman. They appear to be seated, possibly on a porch or near a wooden structure.

Key Features:

  • Subject: The man is on the left. He has a weathered face with a mustache. He is wearing a light-colored, loose-fitting shirt that appears to be simple in design, possibly worn. His hands are clasped in his lap. The woman on the right has a thoughtful expression. She has short, dark hair and is wearing a patterned top and a delicate necklace.
  • Setting: The background suggests a wooden structure, with vertical planks. The lighting is soft, creating shadows and highlighting the textures of the individuals' skin and clothing.
  • Overall Tone: The image conveys a sense of quiet dignity and perhaps a hint of melancholy. It suggests a moment of rest or reflection. The black and white format enhances the timeless and classic quality of the portrait.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image is a black-and-white photograph featuring two elderly individuals sitting outside a wooden structure. The person on the left appears to be an older man with a weathered face, wearing a light-colored, long-sleeved shirt. He has his hands clasped together in his lap. The person on the right appears to be an older woman, also with a weathered face, wearing a patterned garment and a necklace. Both individuals have serious expressions and seem to be in deep thought or contemplation. The wooden background suggests a rustic or rural setting. The overall mood of the photograph is somber and reflective, capturing a moment of quiet dignity.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph featuring two individuals sitting close to each other. The person on the left appears to be an older man with a beard and mustache, wearing a light-colored, slightly torn shirt. He is seated and has one hand resting on his lap while the other is placed on the arm of the chair or surface he is sitting on. The person on the right appears to be an older woman with darker skin, wearing a patterned garment that looks like a dress or apron, and a necklace. She is looking slightly to the side with a thoughtful expression. Both individuals are seated against a wooden background, which might be the exterior of a building or a fence. The image has a vintage quality, suggesting it might be from an earlier time period.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph of an older couple. The man on the left has a mustache and is wearing a tattered, sleeveless shirt. His right arm appears to be in a sling made from his shirt. The woman on the right has her hair pulled back and is wearing a patterned top and a necklace. They are seated against a wooden wall, and the overall appearance of the image suggests a historical or vintage setting. The photograph captures a moment of quiet contemplation or resignation.