Human Generated Data

Title

Untitled (Ezra Shahn, 333 West Eleventh Street, New York City)

Date

Fall 1934-Spring 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4056

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Ezra Shahn, 333 West Eleventh Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Fall 1934-Spring 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4056

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 100
Cap 99.5
Architecture 99
Building 99
House 99
Housing 99
Staircase 99
Face 95
Head 95
Brick 92.1
Bathing 82.6
Furniture 81.7
Handrail 66.3
Photography 57.5
Portrait 57.5
Pillar 57.3
Bonnet 55.7
Coat 55.2

Clarifai
created on 2018-05-10

people 99
one 96.5
monochrome 96.3
adult 96.2
veil 93.3
administration 91.1
man 91
woman 89.9
wear 89.3
black and white 88.4
old 85
child 83.7
art 83.7
vehicle 82.6
retro 81.1
furniture 79.7
sepia 79.1
travel 78.9
leader 78.9
vintage 78.7

Imagga
created on 2023-10-06

newspaper 44.7
product 33.7
money 30.6
cash 29.3
currency 27.8
creation 27.1
dollar 26
bank 24.2
banking 23
finance 22
paper 21.4
bill 20.9
business 20.7
financial 20.5
dollars 20.3
architecture 20.1
wealth 19.8
franklin 18.7
savings 18.6
memorial 18.6
sculpture 17.5
ancient 16.4
bills 15.5
hundred 15.5
structure 15.2
one 14.9
rich 14.9
us 14.5
loan 14.4
building 13.7
negative 13.6
pay 13.4
exchange 13.4
stone 13
column 12.9
banknotes 12.7
travel 12.7
old 12.5
history 12.5
marble 11.8
art 11.8
economy 11.1
investment 11
landmark 10.8
film 10.7
concepts 10.7
gravestone 10.6
debt 10.6
drawing 10.6
payment 10.6
profit 10.5
success 10.5
sketch 10.4
monument 10.3
close 10.3
commerce 10.3
historic 10.1
vintage 9.9
statue 9.9
economic 9.7
finances 9.6
capital 9.5
closeup 9.4
culture 9.4
famous 9.3
face 9.2
brass 9.1
religion 9
funds 8.8
antique 8.7
grunge 8.5
number 8.4
city 8.3
photographic paper 8.3
symbol 8.1
market 8
states 7.7
price 7.7
notes 7.7
tourism 7.4
note 7.4
design 7.3
carving 7.1
puzzle 7
man 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 92.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Female, 89.2%
Calm 87.9%
Surprised 6.8%
Fear 6%
Confused 4.9%
Sad 3.5%
Disgusted 0.8%
Angry 0.8%
Happy 0.6%

Feature analysis

Amazon

Baby
Person

Clarifai

Human face
Clothing
Human nose
Human mouth
Human hair

AWS Rekognition

Baby 98.2%

Categories

Imagga
created on 2023-10-06

paintings art 77.1%
food drinks 19.7%
pets animals 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a dog sitting on a chair in a room

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a baby in a crib

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image is a negative photograph that appears to depict an outdoor setting. There is a decorative metal railing with ornate patterns, likely part of a fence or gate. A cylindrical, intricately designed piece of metalwork is situated prominently, possibly a lamp post or ornamental pillar. In the foreground, there is a child wearing a hood, seated or leaning on an object that could be a sled or cushion. The background shows stairs and part of a building structure, including brickwork.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image appears to be a negative photograph, which inverts the typical black and white tones. It depicts a young child dressed warmly, likely in a hooded garment, seated outdoors. Behind the child is a decorative cast iron railing or fence with ornate designs, including floral motifs and scrolls. There are steps or a platform structure in the background. Near the child, a stringed musical instrument, possibly a cello or similar, is visible, partially covered and resting on the ground. The overall atmosphere suggests a historical or vintage context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a black and white photograph of an ornate, decorative column or pedestal. The column appears to be made of stone or plaster and is intricately carved with floral and geometric patterns. In the foreground, there is a blurred figure, likely a person, partially obscured by the column. The background suggests an indoor setting, with what appears to be a window or other architectural feature visible behind the column.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a black and white historical photograph showing an ornate architectural detail or decorative element. In the foreground is what appears to be a reclining figure or statue, and behind it is an elaborately carved white structure with Gothic-style ornamentation featuring arches, scrollwork, and decorative patterns. The image has a somewhat grainy or aged quality typical of older photography. The credit line indicates this is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black and white photograph of a child in a hooded jacket, with a decorative metal object in the background. The child is sitting on a table or bench, with their right arm raised and their left arm resting on the table. The child's face is blurred, but they appear to be looking down at something on the table.

In the background, there is a decorative metal object that appears to be a lamp or a candle holder. It has an intricate design with leaves and flowers, and it is placed on a table or shelf. The object is made of metal and has a white or cream-colored finish.

The overall atmosphere of the image is one of simplicity and elegance. The use of black and white photography creates a sense of timelessness and classicism, while the decorative metal object adds a touch of sophistication and refinement. The child's presence in the image adds a sense of warmth and humanity, and their blurred face creates a sense of mystery and intrigue.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a young child sitting on a bench, with a decorative metal railing and a large, ornate metal object behind them. The child is wearing a hooded jacket and appears to be looking down at something in their hands.

  • Child:
    • Age: Unknown
    • Gender: Male
    • Clothing: Hooded jacket
    • Posture: Sitting on a bench
    • Facial expression: Looking down at something in their hands
  • Bench:
    • Location: Behind the child
    • Material: Wood or metal
    • Design: Simple, rectangular shape
  • Decorative Metal Railing:
    • Location: Behind the child
    • Material: Metal
    • Design: Ornate, with intricate patterns and designs
  • Large, Ornate Metal Object:
    • Location: Behind the child
    • Material: Metal
    • Design: Large, ornate, with intricate patterns and designs
  • Background:
    • Location: Behind the child
    • Material: Brick wall
    • Design: Simple, with a few windows

The image appears to be a photograph of a young child sitting on a bench, with a decorative metal railing and a large, ornate metal object behind them. The child is wearing a hooded jacket and appears to be looking down at something in their hands. The background of the image is a brick wall with a few windows.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of a baby sitting on a chair. The baby is wearing a hat and has its eyes closed. Behind the baby is a decorative metal railing with intricate designs. The railing is attached to a staircase with a brick wall on the left side. The staircase leads to a platform with a metal structure, possibly a fountain, in the center. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" in the bottom left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a child sitting in a stroller. The child is wearing a hat and appears to be looking down, possibly at something in front of them. The stroller is positioned on a concrete surface, possibly a sidewalk or a patio. Behind the child, there is a decorative metal railing with intricate designs. The railing is attached to a brick wall, which could be part of a building or a fence. The image has a vintage feel to it, possibly taken in the early 20th century.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

Here's a description of the image:

Overall Impression: This is a black and white negative image of a child and a decorative, ornate object, possibly a stove or heater, outdoors.

Key Elements:

  • Child: A small child is in the foreground, wearing a hooded outfit. The child's face is visible, and they seem to be looking to the side. The style of dress suggests it might be a portrait from the early to mid 20th century.
  • Ornate Object: Dominating the center is a decorative object with a cylindrical shape. It has elaborate latticework, scrollwork, and other decorative elements, suggesting a cast-iron stove or heater.
  • Background and Setting: The background includes architectural details like a textured wall, possibly brick, and a railing. Dark steps are visible on the right side. These details suggest an exterior setting.
  • Tone and Contrast: Due to it being a negative image, the tones are reversed (what would normally be white is black, and vice versa), which gives the scene an interesting effect.
  • Framing: The image is a well-composed studio shot, with the child centrally framed in front of the ornate object. The image has a dark border.

Overall, the photograph appears to be a formal portrait of a child, possibly posed near a decorative outdoor object.

Created by gemini-2.0-flash on 2025-05-09

The image, presented in a black and white negative format, features a small child in a hooded garment, positioned to the left of center in the foreground. The child's face is partially visible, directed towards the right.

Behind the child and slightly to the right is an ornate, decorative piece, possibly cast iron or a similar material. The design includes floral and scrolled elements, suggesting it may be part of a larger architectural feature or perhaps a standalone decorative object.

To the left of the child and the decorative piece is a section of what appears to be a fence or railing, also with ornamental details. In the background, there's a suggestion of a building facade with brickwork visible in the upper left quadrant.

On the right side of the frame, there are steps leading upwards, creating a sense of depth to the scene. The overall composition places the child in relation to both the architectural elements and the steps, suggesting a setting in or near a building's entrance or garden area.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This image appears to be a black-and-white photograph of a child sitting in a baby carriage or stroller. The stroller has intricate, decorative ironwork with ornate patterns, including floral and geometric designs. The child is wearing a hat and a coat, suggesting that the weather might be cold. The background includes a brick wall and part of a wooden structure, possibly a bench or a step. The photograph has a somewhat vintage or historical feel, which is supported by the credit to the President and Fellows of Harvard College (Harvard University Art Museums). The overall scene captures a moment from the past, highlighting both the child and the detailed craftsmanship of the stroller.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph showing a scene with a decorative, ornate structure, possibly a fountain or architectural element, in the background. In the foreground, there is a person sitting on what appears to be the roof of a vintage car, with their back to the camera. The car has a classic design, and the setting seems to be outdoors with a building's facade visible in the background. The overall composition suggests a historical or vintage context. The image is labeled with the credit "President and Fellows of Harvard College (Harvard University Art Museums)" and has a reference number "P1970.4056.0000" at the bottom right.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This image is a black-and-white photograph featuring an intricate, ornate ironwork design as the main focus. The ironwork includes detailed patterns and decorative elements, with a central column-like structure that has additional embellishments. In the foreground, there is a blurred figure of a person, possibly a child, who appears to be lying down or reclining. The background shows a brick wall and some steps, suggesting an outdoor setting, possibly a patio or a porch. The image has a vintage or historical feel due to its monochromatic color scheme and the style of the ironwork. The bottom of the image includes a caption crediting the President and Fellows of Harvard College (Harvard University Art Museums) and a catalog number.

Text analysis

Amazon

Harvard
College
and
Museums)
University
Art
President and Fellows of Harvard College (Harvard University Art Museums)
(Harvard
of
Fellows
President
P1970.4056.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4056.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4056.0000