Human Generated Data

Title

Untitled (relief family, Lancaster, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.33

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief family, Lancaster, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.33

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Brick 100
Clothing 99.2
Shorts 99.2
Kissing 91.7
Romantic 91.7
Furniture 81.2
Outdoors 72.2
Chair 70
Handrail 57.9
Bench 57.7
People 57.6
Dress 56.4
Architecture 56.1
Building 56.1
Wall 56.1
Pants 55.7
Sitting 55.5

Clarifai
created on 2018-05-11

people 99.9
child 99.9
two 97.8
one 96.7
boy 96.1
portrait 95.7
adult 91.1
school 90.7
wear 90.1
education 89.8
facial expression 89.8
group 89.3
elementary school 88.7
son 88.7
baby 86.2
bench 85.4
step 81.8
monochrome 81.5
offspring 81.2
sit 80.2

Imagga
created on 2023-10-06

parent 34.5
mother 27
child 26.1
people 25.7
portrait 23.3
dad 22
man 21.5
father 21.3
bench 21.1
happy 20.1
adult 19.5
park bench 19.1
male 18.8
outdoors 17.9
swing 17.9
family 17.8
love 17.4
happiness 17.2
kin 17.1
person 16
lifestyle 15.9
park 14.8
couple 14.8
hair 14.3
plaything 14
pretty 14
mechanical device 13.7
girls 13.7
dress 13.6
smile 13.5
seat 13.3
outdoor 13
fashion 12.8
daughter 12.5
model 12.4
together 12.3
lady 12.2
face 12.1
sexy 12.1
sitting 12
world 11.7
fun 11.2
looking 11.2
old 11.2
outside 11.1
women 11.1
two 11
day 11
smiling 10.9
black 10.8
care 10.7
human 10.5
attractive 10.5
one 10.5
females 10.4
mechanism 10.2
sibling 10.1
blond 10
cheerful 9.8
married 9.6
youth 9.4
furniture 9.4
summer 9
romance 8.9
romantic 8.9
boy 8.7
cute 8.6
wife 8.5
son 8.5
togetherness 8.5
relationship 8.4
joy 8.4
body 8
home 8
bride 7.7
room 7.6
head 7.6
senior 7.5
vintage 7.4
building 7.4
water 7.3
sensuality 7.3
childhood 7.2
kid 7.1
little 7.1
look 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 95.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-43
Gender Female, 100%
Calm 38.6%
Happy 27.7%
Sad 11.8%
Disgusted 10.2%
Surprised 7%
Fear 6.9%
Angry 3.7%
Confused 3.3%

AWS Rekognition

Age 0-3
Gender Female, 100%
Surprised 98.3%
Calm 16.2%
Fear 7.1%
Sad 2.4%
Happy 0.7%
Disgusted 0.6%
Angry 0.3%
Confused 0.1%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Baby

Clarifai

Clothing
Human face
Human arm
Human nose
Furniture
Human leg

AWS Rekognition

Person 99.3%

AWS Rekognition

Baby 99.3%

Clarifai

Clothing 94%

Clarifai

Clothing 85.3%

Clarifai

Clothing 65.2%

Clarifai

Human face 86.8%

Clarifai

Human face 86%

Clarifai

Human arm 48.3%

Clarifai

Human arm 42.7%

Clarifai

Human nose 37.8%

Clarifai

Furniture 37.2%

Clarifai

Human leg 37%

Clarifai

Human leg 36.8%

Categories

Imagga
created on 2023-10-06

people portraits 61.1%
paintings art 31.8%
streetview architecture 2.2%
pets animals 2%

Captions

Microsoft
created by unknown on 2018-05-11

a person sitting on a bench 82.8%
a person sitting on a bench 73.8%
a person sitting on a bench 73.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a woman sitting on a bench with a baby

Created by general-english-image-caption-blip-2 on 2025-07-06

a woman and child sitting on a bench

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image shows a person seated on a wooden chair outdoors, holding a small child on their lap. The background includes a brick wall with faint chalk markings and a door. A weathered wooden post and horizontal railing are positioned in the foreground. The child is dressed in a light-colored outfit, and the setting appears to be a porch or exterior space.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image shows a person sitting on a chair outside in front of a brick wall, holding a small child on their lap. The person is wearing a dress and is seated on what appears to be a wooden porch. There is another empty chair partially visible on the left side of the image. A horizontal metal rod runs across the foreground, with a wooden post partially blocking the view. The background brick wall has some faded chalk markings on it, and an old wooden door is visible as well.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a woman holding a young child, possibly a baby, in her arms. They are seated on a bench or chair in what appears to be an old, dilapidated building with brick walls. The woman has a pensive expression on her face as she gazes at the child, who is sucking on a pacifier. The scene conveys a sense of intimacy and tenderness between the two figures, despite the stark and somewhat grim surroundings.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, possibly the 1930s or 1940s. The image shows a young woman sitting on what appears to be a porch or veranda, with a brick wall visible in the background. She's wearing a casual dress or skirt and is holding a small baby or toddler who is dressed in light-colored clothing and appears to have a pacifier. The setting seems modest, with a white post or column visible in the foreground and some wooden railings. The photograph has an intimate, candid quality that captures a quiet moment between the woman and child.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a woman sitting in a chair, holding a baby in her lap. The woman has dark hair and is wearing a light-colored dress. She is sitting in a wooden chair with a metal railing in front of her. The baby is wearing a light-colored onesie and has a pacifier in its mouth.

The background of the image is a brick wall with a window and a door. The overall atmosphere of the image suggests that it was taken in a home or domestic setting, possibly during the mid-20th century. The woman's casual attire and the baby's simple clothing suggest a relaxed and informal atmosphere.

The image may have been taken by a family member or a photographer who was documenting everyday life in the home. The photograph could be part of a larger collection of images that capture the daily routines and activities of the family.

Overall, the image provides a glimpse into the lives of the people in the photograph and offers a sense of nostalgia and historical context.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black and white photograph of a woman sitting on a chair with a baby in her arms. The woman has dark hair and is wearing a light-colored dress. She is holding the baby up against a railing, and the baby is wearing a light-colored outfit. The background of the image appears to be a brick wall with a window or door behind the woman and baby. The overall atmosphere of the image suggests a casual, everyday moment between the woman and the baby.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of a woman sitting on a chair and holding a baby. The woman is wearing a dress and has a serious expression on her face. The baby is wearing a dress and has a pacifier in its mouth. Behind them is a brick wall with some graffiti on it. The photo was taken from a low angle, and the chair and pole in front of the woman are visible.

Created by amazon.nova-pro-v1:0 on 2025-06-05

A black-and-white photo shows a woman sitting on a chair and holding a baby on her lap. The woman is wearing a dress, while the baby has a pacifier in his mouth. The woman is smiling and looking at the baby. Behind them, there is a brick wall with some graffiti. On the right side, there is a door. On the left side, there is a chair leaning on the wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-01

Here's a description of the image:

Overall Impression: The photograph is a black and white image of a woman sitting outside with a baby. It has a vintage, possibly documentary, feel.

Key Elements:

  • Woman: The woman is the central figure. She's seated in a rocking chair, wearing a light-colored shirt and a long skirt. She has dark hair and a kind expression, looking at the baby she is holding.
  • Baby: The baby is a small child with a pacifier in their mouth. The baby is facing the camera, their eyes wide, with a curious expression. The baby is dressed in a light-colored, simple outfit.
  • Setting: The setting appears to be an outdoor area, possibly a porch. A brick wall forms the background. A post, probably a support column, partially obscures the scene. The backdrop gives the impression of a simple or older home.
  • Composition: The composition places the woman and child in the center, with the brick wall as a backdrop. A metal bar runs horizontally near the woman, adding a line to the shot.

Overall Tone: The image evokes a sense of everyday life, perhaps with a hint of simplicity and warmth. The woman's expression and the baby's presence creates a feeling of tenderness. The black and white format adds to the vintage quality.

Created by gemini-2.0-flash on 2025-06-01

Here is a description of the image:

In a black and white photograph, a woman is seated in a rocking chair, holding a baby in her lap. The baby has a pacifier in its mouth and is looking directly at the camera with a somewhat serious expression. The woman is looking at the baby with a gentle smile.

The background features a brick wall with some writing on it, and a wooden door or wall section. A wooden pole is positioned in front of the woman, partially obscuring the view. The setting appears to be outdoors, possibly a porch or front stoop. The image has a vintage feel due to the black and white tone and the style of clothing.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a woman holding a baby. The woman is seated on a wooden chair, and she is looking upwards with a gentle expression. She is wearing a sleeveless top and a skirt, and her hair is tied back. The baby, who appears to be a toddler, is seated on her lap, wearing a light-colored outfit and holding a pacifier in its mouth.

The setting appears to be an indoor space with a brick wall in the background. There is a white pole in the foreground, and a metal railing can be seen behind the woman and baby. The environment looks somewhat rustic or industrial, with visible wear and tear on the surfaces. The overall mood of the image is calm and intimate, capturing a quiet moment between the woman and the child.

Qwen

No captions written

Text analysis

Amazon

DE