Human Generated Data

Title

Untitled (sharecropper family, near Little Rock, Arkansas)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3413

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (sharecropper family, near Little Rock, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3413

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Sun Hat 99.7
Reading 98.4
Face 96.6
Head 96.6
Sitting 94.9
Photography 91
Portrait 91
Footwear 90.3
Cap 63
Furniture 57.5
Couch 56.4
Baseball Cap 56.3
Outdoors 56.2
Shirt 56
Coat 55.6
Architecture 55.3
Building 55.3
Hospital 55.3
Pants 55.2
Indoors 55.1
Living Room 55.1
Room 55.1

Clarifai
created on 2018-05-10

people 100
group 99.8
adult 98.3
group together 98.3
man 98
several 97.8
four 97.7
two 97.5
three 97.2
administration 95.4
veil 95.1
five 93.9
actor 93.5
leader 93
wear 93
lid 91.8
woman 89.9
portrait 87.3
many 86.8
furniture 86.7

Imagga
created on 2023-10-07

musical instrument 43.1
wind instrument 34.9
concertina 32.7
free-reed instrument 26.4
accordion 23.2
man 20.1
people 19.5
keyboard instrument 18.6
device 17.7
statue 17.5
men 17.2
male 17.1
person 17
religion 16.1
monument 15.9
sculpture 14.6
old 14.6
kin 14.5
adult 14.4
art 13.8
portrait 13.6
washboard 12.7
barbershop 12.1
architecture 11.7
history 11.6
shop 11.4
religious 11.2
dress 10.8
traditional 10.8
couple 10.4
ancient 10.4
culture 10.2
black 10.2
city 10
chair 9.8
historical 9.4
face 9.2
historic 9.2
travel 9.1
tourism 9.1
mercantile establishment 9.1
world 9.1
look 8.8
mask 8.6
costume 8.6
business 8.5
fashion 8.3
worker 8.2
new 8.1
women 7.9
smile 7.8
prayer 7.7
stone 7.6
human 7.5
vintage 7.4
clothing 7.4
tradition 7.4
girls 7.3
decoration 7.2
building 7.1
romantic 7.1
family 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.7
man 98.8
outdoor 93.5
old 86.4
black 79.2
white 75.6
posing 74.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 4-12
Gender Male, 59.9%
Calm 65.9%
Sad 65.4%
Surprised 6.4%
Fear 6.3%
Confused 0.7%
Angry 0.5%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Female, 100%
Sad 100%
Calm 14.8%
Surprised 6.5%
Fear 6.3%
Disgusted 1%
Angry 0.9%
Confused 0.7%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 10-18
Gender Male, 59.9%
Fear 72.3%
Sad 31.4%
Surprised 12.1%
Calm 6.2%
Confused 5.6%
Disgusted 1.2%
Angry 1.1%
Happy 0.5%

AWS Rekognition

Age 1-7
Gender Male, 82.3%
Confused 46%
Calm 33%
Surprised 8.7%
Sad 8.3%
Fear 6.2%
Disgusted 2.8%
Angry 2.8%
Happy 0.5%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Baby
Shoe
Hat

Clarifai

Human face
Clothing
Man
Footwear
Human head
Human leg
Human nose
Human arm
Human hand
Human eye

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.3%

AWS Rekognition

Adult 99.3%

AWS Rekognition

Adult 99%

AWS Rekognition

Adult 91.5%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.3%

AWS Rekognition

Male 99.3%

AWS Rekognition

Male 99%

AWS Rekognition

Male 91.5%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 99.3%

AWS Rekognition

Man 99.3%

AWS Rekognition

Man 99%

AWS Rekognition

Man 91.5%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 91.5%

AWS Rekognition

Person 82.6%

AWS Rekognition

Baby 95.6%

AWS Rekognition

Shoe 90.3%

AWS Rekognition

Shoe 88.5%

AWS Rekognition

Shoe 87.8%

AWS Rekognition

Shoe 80.4%

AWS Rekognition

Shoe 71.1%

AWS Rekognition

Shoe 67.9%

AWS Rekognition

Hat 77.2%

Clarifai

Human face 96%

Clarifai

Human face 78%

Clarifai

Human face 67%

Clarifai

Human face 66.2%

Clarifai

Human face 60.5%

Clarifai

Human face 59.2%

Clarifai

Clothing 89.9%

Clarifai

Clothing 89.8%

Clarifai

Clothing 75.5%

Clarifai

Clothing 74.2%

Clarifai

Clothing 63%

Clarifai

Clothing 39.8%

Clarifai

Man 79.4%

Clarifai

Footwear 71.6%

Clarifai

Footwear 64.6%

Clarifai

Footwear 61.7%

Clarifai

Footwear 59.2%

Clarifai

Footwear 56.3%

Clarifai

Footwear 54.4%

Clarifai

Footwear 43.5%

Clarifai

Footwear 40.8%

Clarifai

Footwear 35.1%

Clarifai

Human head 59.7%

Clarifai

Human leg 39.8%

Clarifai

Human leg 35.6%

Clarifai

Human leg 35.5%

Clarifai

Human nose 38.6%

Clarifai

Human arm 37.9%

Clarifai

Human arm 35.9%

Clarifai

Human arm 35.1%

Clarifai

Human hand 35.1%

Clarifai

Human eye 33.4%

Categories

Imagga
created on 2023-10-07

people portraits 73.6%
paintings art 24.3%
streetview architecture 1%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people sitting on a porch

Created by general-english-image-caption-blip-2 on 2025-07-06

three men sitting on a bench with hats on

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts a group of individuals sitting on a wooden structure, possibly the porch of a building. The three central figures are seated, wearing various hats and clothing typical of an earlier time period, including striped pants, buttoned shirts, and a scarf. The wood-paneled exterior suggests a rustic or rural setting. To the far right, a woman is visible through a doorway, wearing a patterned dress, standing partially obscured behind the wooden structure, with a child peeking out toward the viewer. The overall scene evokes a casual, everyday moment in a bygone era.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts a group of individuals sitting and standing outside a building. The three individuals seated on a wooden step are dressed in casual work attire, commonly seen in rural settings. The person in the center wears light-colored pants and a matching shirt, with a scarf and a hat. The person on the left wears a shirt with rolled-up sleeves and slacks, while the person on the right dons striped pants and suspenders. The structure they are in front of appears to be constructed from wooden planks, indicating a rustic setting. Standing in the doorway to the right of the seated group is a woman in a patterned dress. Partially visible along the bottom edge of the image and on the left side are additional figures, suggesting a communal or social gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph depicting a group of people sitting on a wooden porch or structure. The individuals are wearing clothing typical of the time period, with hats, shirts, and pants. They appear to be in a rural or small-town setting, with a wooden structure in the background. The people in the image have a pensive or contemplative expression on their faces, suggesting a sense of reflection or thoughtfulness.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-12

The black and white photograph shows a group of five African American men and boys sitting on the steps of a wooden structure, likely a small house or cabin. The men are wearing light-colored shirts, pants, and hats typical of the early 20th century rural American South. One man appears to be smoking a cigarette or pipe. A young boy is sitting in front, looking directly at the camera. The wooden structure behind them has visible cracks and knots, suggesting it is weathered and aged. The photograph provides a glimpse into the lives and appearance of rural African Americans during this historical period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white historical photograph showing several people sitting on what appears to be a wooden porch or storefront. Three young men are seated on a bench, wearing casual work clothes including caps and hats typical of the early-to-mid 20th century. One wears striped pants, another is dressed in all white with a fedora-style hat. There are also children visible in the frame, including one in the doorway and another in the foreground. The wooden building behind them has a weathered, rustic appearance typical of rural American architecture from this era. The image captures a casual, everyday moment of rural life.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a group of people, primarily children and young adults, sitting on the porch of a wooden building. The individuals are dressed in casual attire, with some wearing hats and others barefoot. The atmosphere appears relaxed, with the subjects engaged in conversation or simply sitting together.

In the background, a woman can be seen standing in the doorway, while another child sits on the floor in front of the group. The overall setting suggests a rural or impoverished environment, possibly during the early 20th century. The photograph captures a moment of everyday life, highlighting the simplicity and community of the people depicted.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a group of people sitting on a porch, with a woman and child standing in the doorway behind them.

The group of people are all wearing casual clothing, such as hats, shirts, pants, and shoes. The man in the center is wearing a white hat, a white shirt, and white pants. The man to his left is wearing a light-colored hat, a light-colored shirt, and light-colored pants. The man to his right is wearing a dark-colored hat, a white shirt, and dark-colored pants with white stripes.

In the background, there is a woman standing in the doorway of the house, wearing a long dress with polka dots. She has her hand on her hip and is looking down at the group of people on the porch. A young child is standing next to her, wearing a white dress and holding onto the woman's leg.

The overall atmosphere of the image suggests that it was taken in a rural or small-town setting, possibly during the early 20th century. The clothing and hairstyles of the people in the image are consistent with the fashion of that time period. The image may have been taken by a photographer who was documenting everyday life in a small community.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The image is a black-and-white photograph of four men and two children sitting on a bench in front of a wooden house. The men are wearing hats and long-sleeved shirts, while the children are wearing dresses. The men are sitting closely together, with their hands resting on their laps. One of the men is holding a cigarette in his mouth. The children are standing behind the men, looking at something.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph of a group of people sitting on a wooden bench in front of a wooden house. Three adult men are sitting on the bench, while a young child is sitting on the floor in front of them. The man on the left is wearing a hat and a scarf around his neck, while the man in the middle is wearing a hat and a necklace. The man on the right is wearing a hat and has his hand on his chin. Behind them is a woman standing in the doorway of the house.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-28

Here's a description of the image:

This black and white photograph captures a group of African Americans gathered outside what appears to be a wooden structure, possibly a home. Three men are seated on a wooden bench, with a fourth individual visible partially. Their attire suggests an earlier period.

  • Center: A man wearing a wide-brimmed hat, white shirt, and light-colored pants sits prominently. He has his hands clasped in his lap.
  • Left: A man with a newsboy cap.
  • Right: A man with a newsboy cap is seated next to the man in a wide-brimmed hat, and he is holding his finger to his mouth.
  • Additional People: In the background, a woman is visible partially behind a doorway, wearing a dress with a polka-dot pattern, suggesting a family setting. Also, a child is visible looking at the camera.
  • Other details: All the men are wearing shoes.

The composition is a window into a bygone era, offering a glimpse into everyday life and the clothing styles of the time. The wooden structure and the simple setting add to the feeling of authenticity and the depiction of a historical moment.

Created by gemini-2.0-flash on 2025-04-28

This is a black and white photo featuring a group of African American people sitting and standing around a wooden structure. In the center of the image, three young men are seated on what appears to be a porch or a bench attached to a building with wooden siding. The man in the middle wears a light-colored hat, a scarf tied around his neck, and his hands are clasped in his lap. The two men on either side of him also wear caps. To the right, a child in a light-colored outfit stands in a doorway, and behind them is a woman wearing a polka dot dress.

In the foreground, there are glimpses of other individuals, including another young person whose expression suggests contemplation. The overall composition conveys a sense of community and portrays a moment of quiet observation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-23

The image is a black-and-white photograph depicting a group of people sitting and standing outside a wooden structure, likely a house or a shack. The setting appears to be rural or semi-rural.

In the foreground, there are three men sitting on a wooden bench or platform. The man in the center is wearing a white hat, white shirt, and light-colored pants. He is looking directly at the camera and appears to be holding something in his hands. To his left is another man wearing a light-colored cap, light shirt, and darker pants. He is also looking at the camera. The third man, on the right, is wearing a darker cap, a white shirt, and striped pants. He is holding a cigarette and looking away from the camera.

In the background, there are several other individuals, including a woman standing in the doorway of the wooden structure and a few children. The children are dressed in simple clothing, and one child in the foreground on the right side of the image is wearing a knitted cap and a light-colored shirt.

The overall atmosphere of the image suggests a moment of rest or gathering, possibly during a break from work or daily activities. The clothing and setting indicate a modest lifestyle, typical of rural communities in the past.

Qwen