Human Generated Data

Title

Untitled (sharecroppers, Pulaski County, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3181

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (sharecroppers, Pulaski County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3181

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Face 100
Head 100
Photography 100
Portrait 100
Accessories 99.8
Earring 99.8
Jewelry 99.8
Sun Hat 98.2
Glasses 97.6
Shirt 95.1
People 91.7
Pants 87.8
Cap 78.3
Door 72.6
Baseball Cap 71.5
Blouse 70.3
Necklace 67.1
Wood 67.1
Outdoors 64.5
Cowboy Hat 63.1
Beard 56.8
Happy 56.7
Smile 56.7
Undershirt 56.4
Laughing 56.1
Sunglasses 55.7
T-Shirt 55.1

Clarifai
created on 2018-05-10

people 100
portrait 99.6
adult 99.2
one 98.2
man 98.2
elderly 97.6
wear 96.9
lid 96
music 93.2
two 93
veil 91.2
facial hair 90.7
administration 90.5
sit 90.3
group 89.4
mustache 88.6
three 88.2
leader 87.9
musician 87.2
jazz 84

Imagga
created on 2023-10-06

grandfather 46.3
man 43
male 32.7
portrait 25.9
person 24.9
bow tie 24.5
people 22.3
old 22.3
hat 21.6
old-timer 20.9
senior 20.6
face 20.6
necktie 19.4
adult 16.8
men 15.4
black 14.4
looking 12
casual 11.9
head 11.7
religion 11.6
clothing 11.5
ancient 11.2
worker 11
sculpture 10.8
vintage 10.7
elderly 10.5
art 10.5
statue 10.5
work 10.2
garment 9.8
couple 9.6
mature 9.3
glasses 9.3
close 9.1
pose 9.1
style 8.9
happy 8.8
boy 8.7
love 8.7
model 8.6
culture 8.5
guy 8.4
hand 8.4
dark 8.3
human 8.2
one 8.2
father 8.2
aged 8.1
eye 8
posing 8
job 8
hair 7.9
sitting 7.7
skill 7.7
industry 7.7
god 7.6
husband 7.6
two 7.6
mask 7.5
smiling 7.2
handsome 7.1
family 7.1
interior 7.1
paper 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 100
man 99.8
old 66.5
helmet 22.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 57.4%
Sad 50.3%
Fear 8.3%
Surprised 6.5%
Angry 6.2%
Confused 2.2%
Disgusted 1.2%
Happy 0.2%

AWS Rekognition

Age 53-61
Gender Male, 91%
Sad 99.8%
Calm 13.5%
Happy 7.8%
Fear 7.6%
Surprised 6.7%
Confused 1.9%
Angry 1.2%
Disgusted 1%

Microsoft Cognitive Services

Age 73
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Jeans

Clarifai

Man
Human face
Clothing
Fedora
Human eye
Human arm
Human mouth
Human nose
Human hand

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.3%

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 99.3%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 99.3%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 99.3%

AWS Rekognition

Hat 97.2%

AWS Rekognition

Jeans 57.5%

Clarifai

Man 95.9%

Clarifai

Human face 91.8%

Clarifai

Human face 82.7%

Clarifai

Clothing 85.7%

Clarifai

Fedora 68.3%

Clarifai

Human eye 42.5%

Clarifai

Human eye 35.1%

Clarifai

Human arm 40.8%

Clarifai

Human arm 40%

Clarifai

Human mouth 38.5%

Clarifai

Human mouth 33.4%

Clarifai

Human nose 36.6%

Clarifai

Human nose 34.4%

Clarifai

Human hand 34%

Categories

Imagga
created on 2023-10-06

paintings art 97.4%
people portraits 1.5%

Captions

Microsoft
created by unknown on 2018-05-10

a black and white photo of a man 93.7%
an old photo of a man 93.6%
old photo of a man 93.5%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a man and woman sitting on a porch

Created by general-english-image-caption-blip-2 on 2025-07-07

an old black and white photo of two people sitting on a bench

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts two individuals seated in front of a rustic wooden structure. One person is wearing a white, loose-fitting shirt with rolled sleeves and dark trousers, paired with a hat. The other individual is dressed in a checkered patterned outfit and is adorned with jewelry, including hoop earrings and a necklace. The background highlights the texture of aged wooden boards, contributing to the overall vintage and rural atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image features two individuals sitting in front of a wooden structure. The person on the left is wearing a wide-brimmed hat and a white shirt with a V-neck opening. They are seated on a wooden chair. The person on the right is wearing a plaid shirt and large hoop earrings, seated slightly in front of the person on the left. The background consists of weathered wooden planks, suggesting a rustic or rural setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows two older African American individuals standing in a wooden doorway. The man on the left is wearing a hat and a white shirt, while the woman on the right is wearing a patterned dress and appears to be smiling. The background is a wooden structure, suggesting this is likely an older rural or small-town setting. The image has a black and white, vintage aesthetic, capturing a moment in time from what seems to be an earlier era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph showing two people. In the image, there is someone standing wearing a white shirt and a bowler hat, while another person is seated in front wearing what appears to be a checkered or gingham pattern dress. The photo appears to be taken against a wooden wall or structure background. The image has the grainy, high-contrast quality typical of early photography. Both subjects appear to be captured in a candid, natural moment, with the seated person showing a warm smile. The photograph seems to date from the late 19th or early 20th century based on the clothing styles and photographic technique.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of an elderly Black man and woman sitting in front of a wooden structure. The man is wearing a white shirt, dark pants, and a hat. He has a mustache and is holding a knife in his right hand. The woman is wearing a plaid shirt and has her hair pulled back. She is looking to the right of the camera.

The background of the image is a wooden structure with vertical planks. The overall atmosphere of the image suggests that it was taken in a rural or agricultural setting, possibly in the early 20th century. The image appears to be a candid shot, capturing a moment in time between the two individuals.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image is a black and white photograph of an elderly couple, likely taken in the early 20th century. The man, standing on the left, wears a tall hat, a white shirt with rolled-up sleeves, and dark pants. He has his hands clasped together in front of him. The woman, seated on the right, wears a plaid shirt and has her hair styled in braids. She is adorned with a necklace and earrings.

The background of the image features a wooden structure, possibly a house or barn, with vertical planks and a doorway behind the couple. The overall atmosphere of the photograph suggests a rural setting, possibly in the southern United States, during a time when segregation was still prevalent. The image may have been taken by a photographer documenting African American life during this period.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of an elderly couple sitting side by side in front of a wooden structure. The man is wearing a white shirt and a black hat, while the woman is wearing a white and black checkered shirt. Both are smiling and appear to be posing for the camera. The man's hands are resting on his lap, and the woman's hands are not visible in the image. The wooden structure behind them appears to be a door or a wall.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white photo of two elderly people sitting in front of a wooden wall. The man is wearing a hat and a white shirt with a belt. He is sitting on a wooden chair and is looking at something. The woman is wearing a checkered shirt and earrings. She is looking at something on the right side. She is also wearing a necklace. They are both smiling.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-30

Here is a description of the image:

The image is a sepia-toned photograph depicting an older Black couple seated in front of a weathered wooden structure, possibly a doorway. The man is positioned on the left side, wearing a dark hat, a white shirt with a torn neckline, and dark trousers. He has a mustache and is looking directly at the camera with a slight smile. His hands are resting in his lap. The woman is seated to the right, wearing a plaid shirt and a necklace. She is also looking slightly to the side with a soft expression. The wooden backdrop behind them appears to be part of the building's exterior. The overall atmosphere suggests a portrait taken in a simple, rural setting. The image has a vintage feel due to its monochrome tone and the subject's appearance.

Created by gemini-2.0-flash on 2025-05-30

Here's a description of the image:

This is a vintage black and white photograph featuring an older African-American couple seated in what appears to be a doorway or on a porch.

The man is wearing a wide-brimmed hat, a light-colored long-sleeved shirt with a button-down collar and with some tearing near the shoulder, and dark trousers held up by a belt. He has a mustache, and his hands are clasped in his lap. He is seated on a wooden chair.

The woman is wearing a patterned light-colored shirt, possibly plaid. She has earrings and a necklace. Her hair is styled back. She sits beside the man and to the right, with a more relaxed posture and a pleasant expression, looking slightly off to the side.

The background consists of roughly hewn wooden planks, indicating a rustic or rural setting. The lighting is subdued, and the image quality suggests it was taken some time ago. The overall feeling is one of simple dignity and resilience.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring two elderly individuals, a man and a woman, standing in front of a wooden structure, likely a house or a cabin. The man is seated on a chair, wearing a white shirt, dark pants, and a bowler hat. He has a mustache and is looking directly at the camera. The woman is standing beside him, wearing a light-colored dress with a pattern, and she also looks directly at the camera. Both individuals appear to be in a relaxed and composed state. The wooden structure behind them has vertical planks, giving it a rustic appearance. The photograph has a vintage feel, suggesting it might be from an earlier era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph of two individuals, a man and a woman, seated in front of a wooden wall. The man is wearing a wide-brimmed hat, a white shirt, and dark pants. He is seated on a wooden bench and appears to be looking slightly to the side. The woman is seated next to him, wearing a patterned blouse and a necklace. She is turned towards the man and seems to be engaged in conversation with him. The wooden wall behind them adds a rustic and simple backdrop to the scene. The overall tone of the image suggests a historical or documentary style, capturing a candid moment between the two individuals.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph features two individuals, a man and a woman, against a rustic wooden backdrop. The man, seated on the left, is wearing a white shirt, dark pants, a belt, and a bowler hat. He has a beard and mustache and is holding a pipe in his right hand. The woman, positioned on the right, is wearing a checkered blouse and a pearl necklace. She has short hair and is smiling. The setting appears to be outdoors, possibly in front of a wooden cabin or building. The overall mood of the image is nostalgic and evokes a sense of the past.