Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

Date

August 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3339

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3339

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99.4
Female 99.4
Person 99.4
Woman 99.4
Adult 99.4
Person 99.4
Male 99.4
Man 99.4
Person 98.5
Person 98.3
Baby 98.3
Face 95.3
Head 95.3
Hat 92.7
Photography 88.5
Portrait 88.5
Footwear 84
Shoe 84
Hat 82.4
Shoe 73.5
Bonnet 56
Cowboy Hat 55.7

Clarifai
created on 2018-05-10

people 100
child 99.7
two 99.1
sit 98.2
three 98
lid 98
group 98
boy 96.8
adult 96.4
veil 96.1
woman 96
man 95.9
wear 95.4
four 95.4
recreation 94.9
group together 93.5
five 91.8
portrait 91.4
elderly 90.3
facial expression 89.8

Imagga
created on 2023-10-06

statue 34.3
sculpture 26.9
architecture 20.3
monument 19.6
man 19.5
child 18.8
stone 16.9
male 16.6
old 16
person 15.7
history 15.2
people 15.1
ancient 14.7
building 14.4
art 14.4
city 14.1
culture 13.7
landmark 13.5
religion 13.4
mother 12.7
travel 12.7
love 12.6
tourism 12.4
parent 12.3
portrait 11.6
marble 11.6
monk 11.4
face 11.4
religious 11.2
outdoors 10.6
world 10.6
detail 10.5
historical 10.4
historic 10.1
adult 9.9
antique 9.5
black 9
sepia 8.7
decoration 8.7
god 8.6
fountain 8.6
two 8.5
outdoor 8.4
famous 8.4
memorial 8.4
juvenile 8.3
sky 8.3
father 8.2
tourist 7.7
palace 7.7
dad 7.5
kin 7.4
lifestyle 7.2
smile 7.1
family 7.1
life 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.7
outdoor 91.9
old 83.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 16-22
Gender Male, 99.5%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Confused 1.2%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 49-57
Gender Male, 98.1%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 1-7
Gender Male, 95.4%
Calm 91.3%
Sad 6.4%
Surprised 6.3%
Fear 5.9%
Disgusted 0.3%
Angry 0.1%
Happy 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Baby
Hat
Shoe
Adult 99.4%
Adult 99.4%
Female 99.4%
Person 99.4%
Person 99.4%
Person 98.5%
Person 98.3%
Woman 99.4%
Male 99.4%
Man 99.4%
Baby 98.3%
Hat 92.7%
Hat 82.4%
Shoe 84%
Shoe 73.5%

Captions

Microsoft
created by unknown on 2018-05-10

a vintage photo of a person 94.4%
an old photo of a person 94.3%
old photo of a person 93.5%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and a woman sitting on steps -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts two men sitting on a set of stone steps, seemingly engaged in a thoughtful or relaxed posture. Both men are dressed in button-down shirts and hats, typical of rural or working-class attire. The building behind them appears to have a stone facade with a doorway. Standing in the background is a young girl in a patterned dress, accompanied by an adult whose lower legs and shoes are visible. The scene appears to evoke a moment of everyday life, possibly during the early to mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts an outdoor scene in front of a stone building. Two men are sitting on the steps. The man on the left is wearing a long-sleeved, light-colored shirt and a wide-brimmed straw hat, and has his arms resting on his knees. The man on the right is wearing a similar long-sleeved light shirt, striped pants, and a fedora-style hat, and appears to be resting his head on his hand. Behind them, a young child is standing on the steps holding hands with a woman, whose legs and floral-patterned dress are visible. The woman is also wearing socks with a distinctive striped pattern and sturdy shoes.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man and a boy sitting on steps, with a woman and child standing behind them.

The man sits on the right side of the image, wearing a light-colored shirt, suspenders, and a hat. He holds his hand to his face, possibly in contemplation or exhaustion. The boy sits on the left side of the image, wearing a light-colored shirt and a straw hat. He looks down, possibly lost in thought.

In the background, a woman stands on the steps, holding a child who is dressed in a patterned dress. The woman's dress is also patterned, and she wears shoes with socks. The steps are made of stone or concrete, and the wall behind them appears to be made of stone.

The overall atmosphere of the image suggests a sense of poverty or hardship, as the man and boy appear to be struggling. The woman and child in the background may be trying to offer support or comfort. The image was taken in the 1930s, during the Great Depression, which may have contributed to the somber mood.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This image is a black-and-white photograph of a family sitting on the steps of a stone building. The image features four individuals, with two men and a young girl in the foreground, and a woman standing behind them.

In the foreground, the man on the left wears a wide-brimmed hat and a collared shirt, while the man on the right sports a fedora and suspenders. The young girl stands behind them, wearing a dress and holding her hands up to her chest. Behind the group, a woman stands on the steps, dressed in a floral-patterned dress and shoes.

The background of the image consists of the stone building, which provides a rustic and natural setting for the family portrait. Overall, the image captures a moment of everyday life, showcasing the simplicity and elegance of a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The black-and-white photo shows a family sitting on the steps of a house. The father, wearing a hat, sits with his hand on his face, possibly looking sad or tired. The son, also wearing a hat, sits next to him, looking serious. Behind them, a woman stands, holding a child who appears to be looking at something in front of them. The house has a stone wall and a door, and the photo has a white border.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photo features three people, two of whom are sitting on the steps of what seems to be a house. The man on the right is wearing a hat and has his hand on his face. The man on the left is wearing a hat and has his hand on his thigh. Behind them are two kids standing on the steps. The kid on the right is holding something in her hand.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

Here's a description of the image:

Overall Impression: The image is a black and white photograph that appears to be a candid shot taken in an outdoor setting. The scene captures a poignant moment, likely from the Dust Bowl era, with a focus on the expressions and body language of the subjects.

People:

  • Two Young Men: On the left, a young man, likely a teenager, is seated and wearing a broad-brimmed straw hat and a button-down shirt. His expression is serious, with his head slightly bowed. Beside the young man is another man, presumably older (likely a grandfather), who is wearing a hat, suspenders, and what seems to be a long-sleeved work shirt. He appears to be lost in thought, with his hand resting on his cheek and elbow.
  • A Young Child: Behind the older man, near the doorway, a young child stands in a polka-dotted dress and looks off to the side.
  • Adult Woman: Standing behind the young child, an adult woman in a floral-print dress reaches out toward the child.

Setting:

  • Exterior: The scene is set outside, presumably in front of a building.
  • Building: A rough-hewn stone wall forms the backdrop to the left. The family is clustered on the steps or porch of a building.
  • Time Period: The clothing and overall style suggest that the photograph was taken during the Great Depression or Dust Bowl era.

Mood and Composition:

  • Serious: The overall mood of the photograph is somber. The expressions of the men suggest weariness and perhaps hardship.
  • Composition: The photographer uses a traditional composition with the two people framed by the walls. The framing draws attention to the relationship between the figures.

In Summary: The photograph is a poignant portrayal of family life during a difficult time. The image emphasizes the resilience of people and the simple dignity of everyday life.

Created by gemini-2.0-flash on 2025-05-31

This black and white photo shows an older man with a fedora hat and suspenders is sitting on steps with his hand to his face looking tired or concerned. To his left is a younger boy in a straw hat and button up shirt sitting against a stone wall. Behind the man are the legs of a woman in a floral dress and a young girl in a polka dot dress. They appear to be standing in a doorway.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a black-and-white photograph depicting a scene with four individuals. The setting appears to be outdoors, likely in front of a stone building.

  • On the left side of the image, there is a young boy wearing a light-colored, checkered shirt and a wide-brimmed hat. He is sitting on the steps, looking downward with a somewhat somber expression.
  • To the right of the boy, there is an older man sitting on the same steps. He is wearing a light-colored shirt, striped pants, and a fedora-style hat. He is holding his face with one hand, appearing deep in thought or possibly distressed.
  • In the background, standing in the doorway of the building, there is a woman dressed in a patterned dress and sandals. She is attending to a young child who is standing in front of her. The child is wearing a patterned dress and has short, light-colored hair. The woman seems to be adjusting the child's clothing or hair.

The overall mood of the image is contemplative and somewhat melancholic, capturing a moment of quiet reflection or concern among the individuals. The clothing and setting suggest a time period from the mid-20th century.