Human Generated Data

Title

Untitled (Susanna Shahn and other children, Jersey Homesteads, New Jersey)

Date

c. 1940

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4382.1

Human Generated Data

Title

Untitled (Susanna Shahn and other children, Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4382.1

Machine Generated Data

Tags

Amazon
created on 2023-10-07

People 98.1
Grass 97.5
Plant 97.5
Dining Table 95.1
Furniture 95.1
Table 95.1
Face 94.9
Head 94.9
Photography 94.9
Portrait 94.9
Outdoors 93.7
Backyard 91.7
Nature 91.7
Yard 91.7
Clothing 91.3
Footwear 91.3
Architecture 62.8
Building 62.8
Classroom 62.8
Indoors 62.8
Room 62.8
School 62.8
Reading 57.8
Sitting 56.5
Bench 56.3
Electronics 56.1
Screen 56.1
Computer Hardware 56
Hardware 56
Lawn 55.9
Computer 55.5
Laptop 55.5
Pc 55.5
Monitor 55.3
Fun 55.1
Leisure Activities 55.1
Picnic 55.1
Play Area 55

Clarifai
created on 2018-05-09

child 99.9
people 99.9
boy 98.2
group 97.9
education 96.7
family 95.6
sibling 94.1
son 93.4
school 90.8
offspring 90.3
group together 89
recreation 88.9
sit 87.9
furniture 87.4
war 85.8
several 84.7
room 81.8
teacher 81.7
baby 81.1
many 81.1

Imagga
created on 2023-10-07

kin 72.2
man 31.6
child 31.4
male 27.8
people 24.5
family 23.1
happy 21.3
couple 20
person 19.3
musical instrument 18.8
sibling 18.8
adult 18
love 17.3
sitting 16.3
together 15.8
home 14.3
kid 14.2
boy 13.9
lifestyle 13.7
attractive 12.6
smile 12.1
percussion instrument 11.9
father 11.5
black 11.4
outdoors 11.2
youth 11.1
grass 11.1
portrait 11
smiling 10.8
old 10.4
mother 10.4
happiness 10.2
teacher 10.1
park 9.9
childhood 9.8
cheerful 9.7
lady 9.7
women 9.5
men 9.4
bench 9.3
teen 9.2
room 9.1
pretty 9.1
holding 9.1
fun 9
handsome 8.9
education 8.6
married 8.6
two 8.5
leisure 8.3
silhouette 8.3
teenager 8.2
playing 8.2
son 8
to 8
school 7.8
outside 7.7
chair 7.6
enjoying 7.6
sit 7.6
field 7.5
brass 7.5
classroom 7.5
senior 7.5
wind instrument 7.4
grandma 7.3
student 7.2
romantic 7.1
day 7.1

Microsoft
created on 2018-05-09

grass 97.5

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 42-50
Gender Female, 98.3%
Happy 58.5%
Calm 30.7%
Fear 7.8%
Surprised 7.3%
Sad 2.7%
Disgusted 1.2%
Confused 0.9%
Angry 0.6%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Child
Female
Girl
Adult
Woman
Shoe
Chair

Clarifai

Clothing
Boy
Human face
Footwear
Tree
Plant
Chair
Window
Human head
Table
Human hair

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 96%

AWS Rekognition

Person 91.4%

AWS Rekognition

Person 90.8%

AWS Rekognition

Person 79.2%

AWS Rekognition

Child 96.8%

AWS Rekognition

Female 96.8%

AWS Rekognition

Female 91.4%

AWS Rekognition

Girl 96.8%

AWS Rekognition

Adult 91.4%

AWS Rekognition

Woman 91.4%

AWS Rekognition

Shoe 91.3%

AWS Rekognition

Shoe 73%

AWS Rekognition

Chair 85.1%

Clarifai

Clothing 91.2%

Clarifai

Clothing 88%

Clarifai

Clothing 81.9%

Clarifai

Clothing 76.4%

Clarifai

Clothing 70.2%

Clarifai

Clothing 57.9%

Clarifai

Clothing 51.9%

Clarifai

Clothing 48.8%

Clarifai

Clothing 38.2%

Clarifai

Boy 84.5%

Clarifai

Human face 75.8%

Clarifai

Human face 46.4%

Clarifai

Human face 45.6%

Clarifai

Human face 43.2%

Clarifai

Human face 41%

Clarifai

Human face 35.6%

Clarifai

Footwear 71.1%

Clarifai

Footwear 70.9%

Clarifai

Footwear 43.6%

Clarifai

Footwear 38.9%

Clarifai

Tree 69.7%

Clarifai

Plant 62.9%

Clarifai

Chair 54%

Clarifai

Window 47.3%

Clarifai

Window 36.6%

Clarifai

Human head 43.7%

Clarifai

Human head 42.8%

Clarifai

Human head 36.7%

Clarifai

Human head 33.5%

Clarifai

Table 36.1%

Clarifai

Human hair 33.9%

Categories

Imagga
created on 2023-10-07

people portraits 99.8%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This is a negative image depicting a group of young children seated outdoors in a grassy area. The children are gathered around a central table, engaged in what appears to be a social or playful activity. Chairs are arranged in a semi-circle around the table. In the background, there is a window with curtains and a nearby door, suggesting the setting is adjacent to a building, possibly a school or a residential home. The children are dressed in casual attire, and the scene captures an everyday moment of interaction.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is an inverted black-and-white photograph depicting a group of young children gathered outside. They are seated in a circle of small chairs around a table or play area on a grassy surface. The children appear to be engaged in some communal activity or game. In the background, there is a building with rectangular windows and an entry door on the right. The surrounding environment includes some vegetation along the wall of the building. The overall atmosphere suggests a playful or social gathering, typical of a preschool or childcare setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of young children playing and interacting in what appears to be an indoor or sheltered outdoor space. The children are seated on the ground or on small furniture pieces, engaged in various activities. The scene has a dark, moody atmosphere, with shadows and contrast creating a dramatic, almost haunting quality to the black and white photograph. The overall impression is one of a group of children at play, captured in a thoughtful, artistic manner.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a historical collection at Harvard University. The image shows several young children sitting outdoors on small chairs and what appear to be boxes arranged in a casual grouping on grass or a lawn area. The lighting creates strong shadows and highlights, suggesting it might be during midday. There's a building visible in the background with windows. The style of the photograph and the children's clothing suggests this was taken sometime in the mid-20th century. The scene has an informal, candid quality to it, as if capturing a moment during playtime or an outdoor activity.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of children dressed as adults, gathered around a table in a yard.

  • The children are all wearing white wigs and old-fashioned clothing, including dresses, aprons, and suits.
    • They appear to be between the ages of 4 and 6 years old.
    • Some of the children are sitting at the table, while others are standing around it.
    • The table is covered with a white cloth and has several objects on it, including what appears to be a teapot, cups, and plates.
    • The children are all looking down at the table, as if they are engaged in some kind of activity or game.
    • In the background, there is a house with a porch and windows.
    • The yard is grassy and well-manicured, with a few trees and bushes scattered about.
    • The overall atmosphere of the image is one of playfulness and imagination, as the children seem to be enjoying themselves and using their imaginations to create a pretend scenario.

The image captures a moment of childhood innocence and creativity, as the children use their imaginations to create a pretend scenario.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of children gathered around a table and chairs in a grassy area, with a building visible in the background. The scene appears to be a playful and informal setting, possibly a daycare or playground.

Key Elements:

  • Children: There are approximately 8-10 children in the image, all of whom appear to be young, likely between the ages of 2-5 years old. They are dressed in casual clothing, such as t-shirts, pants, and dresses.
  • Table and Chairs: A small table is positioned in the center of the image, surrounded by several chairs. The table appears to be made of wood and has a simple design. The chairs are also made of wood and have a similar design to the table.
  • Grassy Area: The children are standing or sitting on a grassy area, which appears to be well-maintained and free of debris. The grass is a light green color and has a soft, textured appearance.
  • Building: In the background of the image, a building is visible. The building appears to be a single-story structure with a flat roof and a large window on the front. The building is made of brick or stone and has a simple, functional design.

Overall Impression:

The image conveys a sense of playfulness and informality, suggesting that the children are engaged in a fun and interactive activity. The presence of the table and chairs suggests that the children may be participating in a craft or educational activity, while the grassy area provides a safe and comfortable space for them to play and explore. The building in the background adds a sense of context and setting, suggesting that the image may have been taken at a daycare or preschool.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of children sitting on chairs around a table in a grassy area. The children are dressed in white outfits and appear to be engaged in an activity. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" and a copyright symbol, indicating that it is a copyrighted image from the Harvard University Art Museums.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white image shows a group of children sitting on chairs in an outdoor area, probably a backyard. They are gathered around a desk. Some of them are looking at the desk, while others are looking at something on the right side. Behind them, there is a house with glass windows and a door. The house is surrounded by grass, and there is a plant on the left side.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

This black and white image, provided by the President and Fellows of Harvard College (Harvard University Art Museums), presents a group of children in an outdoor setting. The image has a high-contrast, negative appearance, with light areas appearing dark and vice versa.

The children are gathered around a small table, with some seated in chairs. The specific details of their activities at the table are difficult to discern due to the image's inversion, but they appear to be engaged in some kind of game or activity.

A building is in the background, with windows visible. To the left of the children, there's a bush or tree, adding to the outdoor ambiance. The ground is covered with grass.

Created by gemini-2.0-flash-lite on 2025-05-28

Here is a description of the image:

The image is a black and white, negative photograph depicting a group of children playing outdoors. They are arranged on a grassy lawn, with a dark building or structure as the backdrop.

  • The children: The children are the primary focus. They appear to be young, with light-colored hair. They are in various poses: some are standing, others are seated on small chairs around a table. They seem to be engaged in an activity, possibly playing a game or having a tea party.
  • Setting: The scene is set in what looks like a backyard or a similar outdoor space. The grass is visible, and there's a hint of foliage on the left side of the frame. The background features a dark, almost black structure, possibly a building, with visible windows.
  • Light and Shadow: The image's negative nature creates a reverse effect, with areas that would normally be light appearing dark, and vice versa. This creates a strong contrast between the children and the dark background.
  • Overall Impression: The photograph evokes a sense of childhood innocence and play. The negative effect gives the image a unique, slightly eerie or surreal aesthetic.

In summary, it is a well-composed photograph showcasing a candid moment of children at play in an outdoor setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black and white photograph depicting a group of children seated outdoors in a classroom-like setting. The children are arranged in a semi-circle facing a teacher who appears to be standing at the front of the group. The children are sitting on small chairs, and some of them have books or papers in their hands, suggesting that they are engaged in a lesson or activity. The setting is outdoors, with grass visible on the ground and a building with large windows in the background. The children are dressed in various outfits, including dresses and sweaters, and some are wearing hats. The overall scene gives the impression of an outdoor classroom or a school activity taking place in a natural setting. The photograph is credited to the President and Fellows of Harvard College, Harvard University Art Museums.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a group of children sitting around a small table outdoors, seemingly engaged in a game or activity. The setting appears to be a backyard or garden, with grass visible underfoot and a house in the background. The children are wearing various types of clothing, and some are seated while others stand. The image has an artistic, candid quality, capturing a moment of childhood play. The photograph is credited to the President and Fellows of Harvard College, part of the Harvard University Art Museums.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black and white image depicts a group of children seated outdoors around a small table, engaging in what appears to be a social gathering. The setting seems to be a backyard or garden, with the children sitting on chairs and some standing nearby. The lighting is dramatic, with a strong light source illuminating the scene, creating deep shadows and high contrast. The background includes a window and a door, suggesting the scene is taking place near a house. The children are dressed in various outfits, and their expressions and body language suggest they are interacting with each other. The image has a vintage or nostalgic feel, possibly due to the black and white format and the style of clothing. The bottom of the image contains a caption crediting the "President and Fellows of Harvard College (Harvard University Art Museums)" and an identifier "P1970.4382.0001."

Text analysis

Amazon

College
Art
and
University
(Harvard
of
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
Harvard
President
P1970.4382.0001

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4382.0001
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4382.0001