Human Generated Data

Title

Untitled (Jonathan Shahn, Jersey Homesteads, New Jersey)

Date

September 1941

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4269.1

Human Generated Data

Title

Untitled (Jonathan Shahn, Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

September 1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4269.1

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Floor 100
Flooring 100
Face 89.7
Head 89.7
Furniture 78.5
Body Part 76.3
Finger 76.3
Hand 76.3
Clothing 57.4
Footwear 57.4
Shoe 57.4
Indoors 57.3
Sitting 56.4
Photography 55.4
Portrait 55.4

Clarifai
created on 2018-05-10

people 99.4
monochrome 97.9
child 97.6
one 97.3
adult 96.3
woman 94.8
man 91.3
two 90.9
street 90.3
girl 90
indoors 89.5
boy 89.4
portrait 89
light 88.7
music 85.9
shadow 85.9
black and white 85.6
recreation 85.4
sit 84.5
loneliness 84.3

Imagga
created on 2023-10-06

people 25.1
man 22.2
working 19.4
business 18.8
office 18
device 17.4
computer 16.6
adult 15.8
male 15.6
technology 14.8
person 14.8
work 14.1
equipment 13.9
room 13.5
chair 13.3
laptop 13.1
men 12.9
sexy 12.8
black 12.1
sitting 12
model 11.7
modern 11.2
portrait 11
lifestyle 10.8
worker 10.8
job 10.6
indoors 10.5
table 10.2
light 10
machine 9.8
attractive 9.8
businessman 9.7
seat 9.7
musical instrument 9.5
hair 9.5
stringed instrument 9.4
dark 9.2
passenger 9.1
piano 9.1
studio 9.1
fashion 9
car 8.7
corporate 8.6
industry 8.5
grand piano 8.4
pretty 8.4
television 8.3
security 8.3
style 8.2
suit 8.1
metal 8
looking 8
interior 8
women 7.9
furniture 7.7
vehicle 7.7
break 7.6
elegance 7.6
relaxation 7.5
one 7.5
silhouette 7.4
inside 7.4
protection 7.3
success 7.2
body 7.2
smile 7.1
love 7.1
steel 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

indoor 97
sitting 94.9
floor 90.3
window 89.9

Color Analysis

Feature analysis

Amazon

Person
Chair

Clarifai

Human face
Footwear
Clothing
Human arm
Chair
Window
Human hair
Human leg
Human hand
Human nose

AWS Rekognition

Person 99.1%

AWS Rekognition

Chair 78.5%

Clarifai

Human face 82.7%

Clarifai

Footwear 79.4%

Clarifai

Footwear 57.8%

Clarifai

Clothing 72.5%

Clarifai

Human arm 58.7%

Clarifai

Chair 53.2%

Clarifai

Window 49.7%

Clarifai

Window 47.4%

Clarifai

Human hair 44.3%

Clarifai

Human leg 40.6%

Clarifai

Human hand 40.6%

Clarifai

Human nose 33%

Categories

Imagga
created on 2023-10-06

cars vehicles 68.7%
interior objects 25.3%
food drinks 4.3%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

a child playing in the dark in a room

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a child sitting on the ground in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This black-and-white image depicts a toddler crawling on a tiled floor. The child has curly hair and is wearing striped clothes, likely overalls with a shirt underneath. Their shadow is visible on the ground, suggesting a strong light source, such as sunlight, shining through a window on the right side of the frame. Nearby, a wooden chair with visible shadows and light patterns sits close to the window. The scene conveys a natural and intimate moment within a household or interior space, with soft contrasts of light and shadow adding depth to the composition.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a black and white photograph that captures a young child with curly hair crawling on the floor. The child is wearing a striped outfit, and the play of light and shadow creates a striking effect on the image. The child appears to be crawling toward the right side of the frame, with sunlight streaming in from windows on the right, casting shadows on the floor. Near the child is an object on the floor, possibly a toy. In the background, there is a chair positioned near a window, with its shadow also visible on the floor. The overall scene suggests an indoor setting, perhaps a sunroom or an enclosed porch, where the child is exploring or playing in a naturally lit space.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a young child, likely a boy, sitting on the floor in what appears to be a dimly lit room or building. The child is wearing a striped shirt and seems to be engaged in some activity on the floor. The background includes a chair or piece of furniture, and the overall scene has a somber, black-and-white tone, giving it a sense of melancholy or isolation.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing a person crouched down on what appears to be a tiled or patterned floor. The image has strong contrasts of light and shadow, with sunlight streaming in from windows visible in the background. There are some chairs or furniture pieces also visible in the background. The composition creates an interesting play of geometric shapes and shadows across the floor. The photo appears to be from a collection at Harvard University Art Museums, as indicated by the credit line at the bottom of the image.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a young child crawling on the floor in a room with a chair and window. The child is wearing a striped shirt and has curly hair. They are positioned in the right corner of the room, facing the camera, with their hands and knees on the floor.

The room has dark walls and a dark floor, with a wooden chair placed against the back wall. A large window is visible on the right side of the room, allowing natural light to enter. The overall atmosphere of the image suggests a quiet and intimate moment between the child and the photographer.

The image is a black-and-white photograph, which adds to its nostalgic and timeless feel. The use of shadows and light creates a sense of depth and dimensionality, drawing the viewer's attention to the child's movements and expressions.

Overall, the image captures a tender and vulnerable moment in the life of a young child, inviting the viewer to reflect on the beauty and simplicity of childhood.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a black and white photograph of a baby crawling on the floor in front of a window. The baby is wearing a striped shirt and has curly hair. The baby is crawling on a dark tile floor, with a white rug underneath them. In the background, there is a wooden chair with a broken seat, and a window with a view of the outside. The overall atmosphere of the image is one of simplicity and innocence, capturing a moment of childhood curiosity and exploration.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

In the black-and-white photograph, a child is crawling on the floor in a room. The child is wearing a striped shirt and pants. The room has a wooden chair and a window. The child is crawling on the floor, possibly playing with a toy. The room is dark, and the light is coming from the window. The image has a watermark in the bottom left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-10

In a black-and-white photo, a child is on his knees on the floor, pushing a toy wheel with his hands. He is wearing a striped shirt with a button on the chest and pants. He is probably inside a room with a chair on the left side and glass windows on the right side. The floor is tiled, and the sunlight is shining through the glass windows.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

The image is a black and white photograph showing a baby crawling on the floor. The baby is in the lower right corner of the frame, with their hands resting on two circular objects on the floor. The baby is wearing a striped shirt and has curly hair.

In the upper left corner, there is a wooden chair with a partially broken seat. Light streams in through a window behind the chair and another to the right of the baby. The floor is tiled, and the tiles are large and dark. The overall tone of the image is dramatic due to the high contrast between the light and dark areas.

Created by gemini-2.0-flash-lite on 2025-06-03

Here's a description of the image:

The image is a black and white photograph taken in a room, possibly indoors given the presence of a window. The scene is dominated by strong contrasts between light and shadow.

Main elements:

  • Child: A small child is the central subject. The child is crawling towards the viewer, seemingly interacting with the objects on the floor.
  • Chair: An old, wooden chair sits against the wall. It seems to be partially broken or worn.
  • Light and Shadow: The photograph is characterized by sharp shadows that are cast across the tiled floor.
  • Floor: The floor appears to be tiled, with visible lines dividing the tiles.
  • Windows: Windows are present in the background, which cast a shadow across the area.

Overall impression:

The photograph evokes a sense of quiet observation, perhaps capturing a moment of the child's early exploration of their environment. The strong shadows and contrasting lighting contribute to a dramatic and slightly mysterious atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a young child with curly hair, who appears to be a toddler. The child is sitting on a dark, possibly black, floor, facing a large window. The child is wearing a striped shirt and dark pants, and appears to be playing with or holding a small object, possibly a toy. The setting seems to be indoors, with natural light streaming in through the window, casting shadows and illuminating the child. The room has a simple, minimalistic design with wooden window frames and a bench or ledge under the window. The overall mood of the image is calm and introspective, capturing a quiet moment of exploration or play. The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

This is a black and white photograph of a young child sitting on a tiled floor, facing away from the camera. The child is wearing a striped shirt and appears to be engaged in some activity on the floor, possibly playing or examining something. The lighting in the image is dramatic, with strong shadows cast across the floor and walls, suggesting it might be taken in a well-lit room or under strong natural light. The background includes a window and the edge of a wooden chair. The photograph has a candid and intimate feel, capturing a quiet, everyday moment. The bottom of the image contains a copyright notice from Harvard University Art Museums.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This black-and-white photograph, with high contrast and sharp shadows, depicts a child in a contemplative pose. The child, dressed in a striped shirt and overalls, is sitting on the floor with their head bowed, hands resting on the ground, and feet flat on the floor. The setting appears to be indoors, with large windows allowing light to stream in, creating dramatic shadows. A wooden chair is visible in the background, adding to the scene's composition. The overall mood of the image is somber and introspective. The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums), as indicated by the caption at the bottom.

Text analysis

Amazon

Harvard
College
Art
and
University
of
(Harvard
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
President
P1970.4269.0001

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4269.0001
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4269.0001