Human Generated Data

Title

Untitled (relief family, Lancaster, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.19

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief family, Lancaster, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.19

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Furniture 98.4
Face 95.6
Head 95.6
Photography 95.6
Portrait 95.6
Clothing 91.2
Footwear 91.2
Architecture 87.4
Building 87.4
House 87.4
Housing 87.4
Porch 87.4
Brick 85.7
Shorts 75.4
Rocking Chair 69.7
Dress 55

Clarifai
created on 2018-05-11

people 100
group 98.4
child 98.3
adult 98.3
woman 97.9
furniture 96.9
two 96.4
seat 93.4
three 93
sit 92.5
man 92.5
offspring 92.3
chair 91.6
group together 91.1
home 89.3
recreation 89.2
family 89.2
room 88.9
wear 88.1
facial expression 87.8

Imagga
created on 2023-10-05

chair 36.2
seat 25.3
wheelchair 24.8
man 22.8
male 19.3
washboard 18.3
barbershop 18
person 16.9
people 16.7
wheeled vehicle 16.4
shop 15.8
musical instrument 15.5
device 15.4
furniture 15.4
portrait 14.2
family 14.2
black 13.8
rocking chair 13
couple 12.2
kin 12.1
child 12
room 12
shopping cart 11.9
adult 11.9
old 11.8
happy 11.3
accordion 11.3
handcart 11.1
mercantile establishment 11.1
love 11
lifestyle 10.8
tricycle 9.9
fashion 9.8
outdoors 9.7
sitting 9.4
day 9.4
mother 9.2
silhouette 9.1
keyboard instrument 9
home 8.8
classroom 8.7
boy 8.7
vehicle 8.7
happiness 8.6
building 8.6
men 8.6
dark 8.3
window 8.2
park 8.2
wind instrument 8.1
business 7.9
architecture 7.8
retired 7.8
married 7.7
youth 7.7
bench 7.6
conveyance 7.6
leisure 7.5
furnishing 7.5
holding 7.4
care 7.4
place of business 7.4
dirty 7.2
history 7.2
women 7.1
interior 7.1
businessman 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

window 96.2
black 90.4
white 86.3
old 58.9
vintage 31.2
family 15.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 22-30
Gender Female, 71%
Sad 80.7%
Calm 59.9%
Surprised 6.4%
Fear 6.1%
Confused 1.1%
Angry 0.9%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Female, 73.7%
Calm 93%
Surprised 6.6%
Fear 5.9%
Angry 5.5%
Sad 2.3%
Disgusted 0.2%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Calm 83.6%
Fear 6.8%
Surprised 6.7%
Sad 5.9%
Angry 1.9%
Confused 1.6%
Disgusted 1.3%
Happy 1%

AWS Rekognition

Age 0-3
Gender Female, 83.9%
Surprised 99.7%
Fear 5.9%
Sad 2.1%
Calm 0%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Sad 55.8%
Calm 51.8%
Fear 10%
Surprised 8.2%
Confused 2.2%
Disgusted 2%
Angry 1.9%
Happy 1.7%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Shoe
Chair

Clarifai

Man
Footwear
Woman
Clothing
Human face
Human leg
Tree
Human hair
Human arm
House
Window

AWS Rekognition

Adult 98.9%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Female 98.9%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.6%

AWS Rekognition

Woman 98.9%

AWS Rekognition

Male 98.8%

AWS Rekognition

Man 98.8%

AWS Rekognition

Shoe 91.2%

AWS Rekognition

Shoe 63.7%

AWS Rekognition

Shoe 63.1%

AWS Rekognition

Chair 77.1%

Clarifai

Man 89.9%

Clarifai

Footwear 87.8%

Clarifai

Footwear 86.3%

Clarifai

Footwear 81.1%

Clarifai

Footwear 76.4%

Clarifai

Footwear 51.9%

Clarifai

Footwear 41.3%

Clarifai

Footwear 38.2%

Clarifai

Footwear 33.9%

Clarifai

Woman 83%

Clarifai

Woman 35.8%

Clarifai

Clothing 80.4%

Clarifai

Clothing 54.1%

Clarifai

Clothing 49.7%

Clarifai

Clothing 39.1%

Clarifai

Human face 73.9%

Clarifai

Human face 62.8%

Clarifai

Human face 62.3%

Clarifai

Human face 56.5%

Clarifai

Human face 56.4%

Clarifai

Human leg 53.6%

Clarifai

Human leg 33.7%

Clarifai

Tree 40.4%

Clarifai

Human hair 40.3%

Clarifai

Human hair 34.2%

Clarifai

Human arm 39.3%

Clarifai

Human arm 37%

Clarifai

House 39%

Clarifai

Window 36.3%

Categories

Imagga
created on 2023-10-05

paintings art 97.6%
pets animals 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a woman sitting on a rocking chair in a rocking chair

Created by general-english-image-caption-blip-2 on 2025-07-08

a black and white photo of a family sitting on a porch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image shows a scene of people sitting on a wooden porch in front of a brick building, likely from a historical time period. There are three adults and two children present. Two of the adults are seated in rocking chairs, while one stands in the middle, hands on hips, wearing a patterned dress. One child is sitting in a small chair, and another is being held by a seated adult. The porch has wooden railing and pillars, with visible carvings or markings on the brick wall behind them. The atmosphere evokes a rustic or small-town vibe.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a scene on a porch, possibly from the early to mid-20th century, featuring a group of people seated and standing. There are three adults and two children present. Two people are seated in wooden rocking chairs on the left and right of the porch. The individuals are wearing casual, everyday clothing typical for that era, with one person standing near the center with hands on their hips, wearing a patterned dress. The materials of the porch suggest a rustic setting, with visible wooden elements and a brick wall. The overall atmosphere is relaxed, and the scene conveys a sense of everyday life.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This is a black and white photograph that appears to be from the mid-20th century. It shows people sitting on a front porch of what seems to be a brick building. There are several rocking chairs on the porch, and the scene has a casual, domestic feel to it. One person is wearing a floral print dress with hands on hips, while others are seated in the rocking chairs. There are also small children visible in the image. The architecture suggests this might be a working-class or rural American home, with its simple brick construction and basic wooden porch furniture. The composition has a documentary-style quality typical of Depression-era photography.

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image appears to be a black and white photograph from an earlier time period. It shows a group of people sitting on the porch of a wooden building. There are two adults, a woman standing in the doorway and a man sitting in a rocking chair, as well as two young children, one sitting in the woman's lap and another sitting on the man's lap. The building has a brick exterior and the scene suggests a casual, domestic setting. The overall atmosphere conveys a sense of family and everyday life from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black and white photograph of a family sitting on a porch. The family consists of a man, a woman, and two babies. The man is sitting in a rocking chair on the left side of the porch, while the woman is standing behind him with her hands on her hips. The two babies are sitting in chairs in front of them.

The porch is made of wood and has a railing around it. The background of the image shows a brick wall with a window and a door. The overall atmosphere of the image suggests a warm and intimate moment between the family members.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image is a black-and-white photograph of two couples with their babies, sitting on the porch of a brick building.

The man on the left is sitting on a rocking chair, wearing a light-colored shirt and pants. The woman standing behind him is wearing a dress with a floral pattern and has her hands on her hips. The baby is sitting in a rocking chair in front of them.

On the right side of the image, a woman is sitting on a rocking chair, holding a baby in her lap. She is wearing a dress and has her legs crossed. The background of the image shows the brick wall of the building, with a window and a door visible. The overall atmosphere of the image suggests a relaxed and casual gathering of friends or family members.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

A black-and-white photograph shows a family sitting on the porch of a brick house. The family comprises a man, a woman, and two young children. The man is seated on a rocking chair on the left side, while the woman is standing with her hands on her hips, looking to the right. The two children are seated in chairs on the porch, with the younger one sitting in the woman's lap. The house has brick walls and glass windows, and there is a door in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a family sitting on a porch. The porch is made of brick and has a wooden railing. A woman is standing in the center of the porch, with her hands on her hips. She is wearing a dress with a belt. To her left, a man is sitting on a chair, and a child is sitting on a chair beside him. On the right side of the porch, a woman is sitting on a chair, holding a baby.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

Here's a description of the image:

Overall Impression: The image is a vintage black and white photograph that captures a scene of a family on a porch, likely taken in the mid-20th century. It has a nostalgic feel due to the grainy texture and the clothing styles.

Composition: The photograph is composed to capture the members of a family and their interaction with each other.

People and Activities:

  • Left Side: A man sits on a rocking chair, looking at the camera, possibly the husband/father of the children.
  • Center: A woman stands near the door of the house, with her hands on her hips. There is a toddler sitting in a rocking chair.
  • Right Side: A woman is seated in a rocking chair holding a small baby, probably the mother/wife.

Setting: The scene is set on the porch of a house. The porch is enclosed by a railing running horizontally through the frame. The architectural style suggests a rural or modest home from the period.

Created by gemini-2.0-flash on 2025-05-31

Here is a description of the image:

This is a vintage black and white photograph featuring a family on the porch of what appears to be a brick building. On the left side of the image, a man is seated in a rocking chair, looking off to the side with his hand near his face. Next to him, a woman is standing, with her hands on her hips, looking in the same direction as the man. A small child is sitting in another rocking chair between the man and the woman.

To the right of a visible support post, another woman is seated in a chair, holding a baby in her lap. The baby has a pacifier in its mouth. The women and the man are dressed in what appear to be casual clothes of the era.

The porch appears to be simple, with a wooden floor and a railing that divides the foreground. The brick building has windows and doors, and there are faint markings visible on the brick wall behind the woman holding the baby. The overall mood of the photograph is one of simple, quiet domesticity.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This black-and-white photograph captures a family scene on the porch of a house. The setting appears to be from an earlier era, likely the early to mid-20th century, judging by the clothing and overall ambiance.

Here are the details of the image:

  1. People in the Photo:

    • Man (left): Seated on a rocking chair, wearing work clothes including boots, pants, and a long-sleeved shirt. He appears to be resting, with his hands on his lap.
    • Woman (center): Standing with her hands on her hips, wearing a patterned dress and a belt. She has a serious expression on her face.
    • Child (center): A young child seated in a rocking chair next to the woman, wearing a light-colored outfit.
    • Woman with Child (right): Seated on a chair, holding a baby on her lap. She is wearing a dress and socks with shoes. The baby is dressed in a light-colored outfit.
  2. Setting:

    • The porch is made of wooden planks and has a railing.
    • The house is constructed with bricks, and there is a door and a window visible in the background.
    • There is some writing on the brick wall behind the woman holding the baby, but it is not entirely clear.
  3. Atmosphere:

    • The image conveys a sense of simplicity and possibly hardship, reflecting a time when life was more rustic and less modernized.
    • The expressions on the faces of the adults suggest a mix of weariness and resilience.

This photograph likely represents a snapshot of everyday life for a family during a period of economic struggle, such as the Great Depression. The simplicity of their clothing and surroundings, combined with their expressions, evokes a sense of endurance and family unity.

Qwen

No captions written