Human Generated Data

Title

Untitled (children, Jersey Homesteads, New Jersey)

Date

c. 1940

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4382.4

Human Generated Data

Title

Untitled (children, Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4382.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Furniture 80.7
Head 75.2
Clothing 70.2
Footwear 70.2
Face 68.3
Coat 57.9
Sled 57.8
Bed 55.5

Clarifai
created on 2018-05-09

people 99.9
adult 98.9
one 98.2
indoors 95.5
man 95.1
woman 95
two 94.6
wear 91.6
furniture 90
child 89.7
window 84
portrait 83.9
recreation 81.1
room 80.5
concentration 79.5
side view 78.4
music 76.7
administration 75.1
monochrome 74.9
three 73.5

Imagga
created on 2023-10-06

chair 36.6
person 24.4
seat 23.6
man 23.5
barber chair 22.3
people 21.2
sword 18.3
male 17.7
patient 17.7
furniture 16.3
lifestyle 15.2
adult 14
weapon 13.7
face 13.5
portrait 12.9
black 12.8
room 12.3
hospital 12.1
alone 11.9
nurse 11.8
medical 11.5
worker 11.2
health 11.1
hair 11.1
office 10.6
case 10.5
indoors 10.5
work 10.5
window 10.4
wheelchair 10.4
business 10.3
back 10.1
sick person 9.8
working 9.7
businessman 9.7
one 9.7
home 9.6
illness 9.5
phone 9.2
dark 9.2
mask 8.9
looking 8.8
happy 8.8
happiness 8.6
men 8.6
model 8.5
smile 8.5
skin 8.5
doctor 8.5
old 8.4
inside 8.3
care 8.2
clinic 8
computer 8
sexy 8
building 8
body 8
surgery 7.8
sitting 7.7
youth 7.7
casual 7.6
uniform 7.6
studio 7.6
professional 7.5
human 7.5
furnishing 7.5
silhouette 7.4
surgeon 7.4
light 7.3
indoor 7.3
medicine 7

Google
created on 2018-05-09

Microsoft
created on 2018-05-09

window 94.6
person 85.2
white 73.9

Color Analysis

Feature analysis

Amazon

Boy
Child
Male
Person
Baby
Shoe

Clarifai

Footwear
Clothing
Human face
Window
Human hair
Human leg
Human arm

AWS Rekognition

Boy 99.2%

AWS Rekognition

Child 99.2%

AWS Rekognition

Male 99.2%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 97.1%

AWS Rekognition

Baby 97.6%

AWS Rekognition

Shoe 70.2%

AWS Rekognition

Shoe 67.1%

Clarifai

Footwear 84.3%

Clarifai

Footwear 78%

Clarifai

Footwear 58.6%

Clarifai

Footwear 57%

Clarifai

Footwear 40.2%

Clarifai

Footwear 38.1%

Clarifai

Footwear 36.1%

Clarifai

Clothing 77.7%

Clarifai

Clothing 76%

Clarifai

Clothing 56.3%

Clarifai

Clothing 41%

Clarifai

Human face 68.9%

Clarifai

Human face 43.4%

Clarifai

Human face 39.3%

Clarifai

Window 58%

Clarifai

Window 54.3%

Clarifai

Window 50%

Clarifai

Human hair 45.1%

Clarifai

Human hair 39.4%

Clarifai

Human leg 35.2%

Clarifai

Human arm 34.1%

Categories

Imagga
created on 2023-10-06

interior objects 69.9%
food drinks 28.1%
paintings art 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a child's rocking chair in a room

Created by general-english-image-caption-blip-2 on 2025-07-07

a woman is sitting on a chair with a child

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This image appears to be a photographic negative, making the colors and tones inverted. It depicts two children interacting indoors, seated on or near a rocking horse. The scene is well lit, likely from large windows or doors visible in the background. One child is positioned on top of the rocking horse, and the other is sitting beside it. The environment suggests a playroom or a domestic space, with the shadows and highlights reversed due to the negative effect.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a photographic negative depicting two young children playing on a rocking toy or seesaw indoors, near a set of windows. The negative has inverted colors, making normally light areas appear dark and vice versa. The child on the left is seated on the toy and appears to be facing towards the other child on the right, who is also interacting with the toy. Both children have light-colored hair due to the inversion of the negative. The room has large windows allowing outside light to enter, creating various patterns on the floor and walls due to the negative effect. Another person or child is partially visible on the right edge of the image. The overall scene captures a playful moment between the children.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two young children, a boy and a girl, playing on what appears to be a rocking chair or a similar piece of furniture. The children are situated in front of a large window, through which the outdoors can be seen. The image is in black and white, giving it a nostalgic and vintage feel. The children seem to be engaged in playful activity, with the boy sitting on the chair and the girl standing next to him. The overall scene conveys a sense of childhood innocence and exploration.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a historical collection at Harvard University. The image shows two young children on what appears to be a rocking horse or similar rocking toy near a window. The setting looks to be indoors, with large windows letting in natural light that creates interesting shadows in the room. The children are dressed in what appears to be mid-20th century clothing. The composition has a nostalgic quality, capturing a moment of childhood play. The lighting from the windows creates a dramatic contrast between light and shadow in the scene.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of two young boys engaging in play near a window. The boy on the left is seated on a rocking horse, while the boy on the right is standing beside him. Both boys have short hair and are dressed in casual attire.

In the background, a window with a white frame and a white wall can be seen. The floor appears to be made of dark-colored tile or wood. The overall atmosphere of the image suggests a playful and carefree moment between the two boys.

The image also includes a copyright notice at the bottom, which reads "© President and Fellows of Harvard College (Harvard University Art Museums)". Additionally, there is a numerical code "P1970.4382.0004" in the bottom-right corner.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts two young boys playing with a wooden toy. The boy on the left is riding the toy, while the boy on the right is sitting on the floor beside it. The toy appears to be a wooden rocking horse or seesaw, with a flat seat and a curved base that allows it to rock back and forth.

In the background, there are two windows with white frames, one of which is open. The walls of the room are painted a light color, and the floor is made of dark wood or tile. The overall atmosphere of the image suggests a playful and carefree scene, with the two boys enjoying themselves in a sunny room.

The image also includes a watermark in the bottom-left corner that reads "© President and Fellows of Harvard College (Harvard University Art Museums)" and a code "P1970.432.0004" in the bottom-right corner. This suggests that the image may be part of a collection or archive held by Harvard University.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image shows two young boys playing with a rocking horse in a room. The boys are wearing long-sleeved shirts and pants. The boy on the left is standing on the rocking horse and holding onto the handles, while the boy on the right is standing next to the rocking horse and holding onto the frame. The rocking horse is made of wood and has a curved seat. The room has a window with a view of the outside.

Created by amazon.nova-pro-v1:0 on 2025-06-05

In a black-and-white photo, two kids are playing on a seesaw. The boy on the right is standing, while the boy on the left is sitting on the seesaw. The boy on the left is wearing a jacket, while the boy on the right is wearing a jacket and pants. Behind them are two windows with white frames and a wall with a painting. The photo has a watermark in the bottom left corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-01

Here's a description of the image:

The image is a black and white photograph. It captures two young children playing indoors. The primary focus is on two children riding a rocking horse. The composition is framed by large windows that cast strong light across the scene.

  • Subject: Two young children are the main subjects. One child is perched on a rocking horse and looks out of the window. The other is on the same rocking horse and leaning down.
  • Setting: The photograph appears to be taken indoors, likely in a room with large windows. The floor has distinct geometric patterns, suggesting it's tiled. The light streams in from the windows, creating strong shadows and highlighting the figures of the children.
  • Composition: The image is well-composed, with the children and the rocking horse positioned centrally. The windows act as a backdrop and source of light, adding depth to the photograph. The use of light and shadow further emphasizes the subjects.
  • Style: The photograph has a vintage feel due to the black and white format.
  • Additional Details: A third person is partially visible in the background near the window.

Created by gemini-2.0-flash on 2025-06-01

Here is a description of the image:

This black and white image features two young children in what appears to be an indoor setting, likely a room with tiled flooring. One child is seated on a toy airplane-shaped rocking horse, facing away from the viewer, with their attention directed towards a nearby window. The other child is positioned near the window on the right, appearing to be playing with something on the floor.

Light streams in through the windows, casting shadows on the floor and creating a play of light and dark that shapes the scene. The windows themselves offer a glimpse of what could be an outdoor setting, but the details are not clear.

The composition is simple and focuses on the children and their interaction with their environment. The overall mood of the image is nostalgic, evoking a sense of childhood innocence and play.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a group of children playing with a rocking horse toy in an indoor setting. The scene appears to be set in a room with large windows, allowing natural light to flood in. The children are dressed in light-colored clothing, and their attention is focused on the rocking horse. The rocking horse itself is a wooden structure with a simple design, featuring a seat and handles for the children to hold onto as they rock back and forth. The room has a minimalistic decor, with plain walls and a wooden floor. The overall atmosphere of the image conveys a sense of playful innocence and nostalgia. The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

No captions written

Text analysis

Amazon

Harvard
College
Art
and
University
of
(Harvard
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
President
P1970.4382.0004

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4382.0004
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4382.0004