Human Generated Data

Title

Untitled (Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4462.6

Human Generated Data

Title

Untitled (Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4462.6

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Brick 99.9
Art 99
Painting 99
Architecture 95.9
Outdoors 88.9
Nature 79.4
Wedding 72.7
Wall 68.1
Machine 57.2
Spoke 57.2
Chart 56.9
Diagram 56.9
Plan 56.9
Plot 56.9
Mural 56.3
Play Area 56.2
Countryside 56.1
House 55.6
Housing 55.6
Porch 55.6
Handrail 55.6
Rural 55.4
Indoors 55.3
Restaurant 55.3
Kiosk 55.1

Clarifai
created on 2018-05-09

vehicle 97.9
people 97.3
no person 97.2
transportation system 92.9
print 90.5
old 90.2
furniture 89.8
one 89
retro 88.9
vintage 88.8
illustration 88.3
art 88.1
group 87.5
war 85.2
watercraft 84.3
adult 82
antique 81.2
two 80.4
monochrome 80
indoors 79.9

Imagga
created on 2023-10-06

architecture 42.6
structure 36.8
building 28.9
history 27.7
facade 25.5
column 25.2
stone 24.4
sculpture 24.1
ancient 23.3
landmark 22.6
travel 21.1
culture 20.5
art 20.3
monument 19.6
famous 19.5
statue 19.5
historic 19.3
city 19.1
memorial 18.6
palace 17
tourism 15.7
old 15.3
fountain 15.2
balcony 15
water 14.7
temple 14.1
house 13.4
marble 12.9
wall 12.9
exterior 12
arch 11.7
traditional 11.6
historical 11.3
religion 10.8
urban 10.5
antique 10.4
texture 9.7
architectural 9.6
sky 9.6
support 9.4
window 9.4
vintage 9.1
tourist 8.4
street 8.3
style 8.2
museum 7.9
artistic 7.8
entrance 7.7
god 7.7
capital 7.6
details 7.5
landscape 7.4
symbol 7.4
church 7.4
grave 7.3
ornate 7.3
bank 7.3
design 7.3
paper 7.1
dome 7

Google
created on 2018-05-09

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-16
Gender Male, 98.8%
Happy 62.5%
Surprised 12.5%
Disgusted 7.3%
Calm 7%
Fear 6.8%
Confused 4.9%
Sad 4%
Angry 2.5%

Feature analysis

Amazon

Building
Person
Adult
Bride
Female
Woman

Clarifai

Clothing
Tree
House
Window
Human face
Plant

AWS Rekognition

Building 95.9%

AWS Rekognition

Person 85.8%

AWS Rekognition

Person 72.7%

AWS Rekognition

Adult 72.7%

AWS Rekognition

Bride 72.7%

AWS Rekognition

Female 72.7%

AWS Rekognition

Woman 72.7%

Clarifai

Clothing 71.4%

Clarifai

Clothing 40.8%

Clarifai

Tree 59.7%

Clarifai

Tree 45.5%

Clarifai

Tree 38.3%

Clarifai

House 56.3%

Clarifai

Window 44%

Clarifai

Human face 39.8%

Clarifai

Human face 33.6%

Clarifai

Plant 37.6%

Categories

Imagga
created on 2023-10-06

paintings art 100%

Captions

Microsoft
created by unknown on 2018-05-09

an old photo of a building 62.3%
a store inside of a building 62.2%
a store in a brick building 54.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a black and white photo of a house with a cat on the roof

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of a man on a ladder

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-23

The response was filtered due to the prompt triggering Azure OpenAI's content management policy. The content filter results follow.

hate: safe
self-harm: safe
sexual: safe
violence: high

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph of an interior space, likely an old building or structure. The image shows a complex arrangement of wooden beams, supports, and architectural elements. There is a decorative carved or sculpted element visible on the front of what appears to be a built-in structure or piece of furniture. The overall scene has a somewhat industrial or utilitarian feel, with the exposed wooden framework and the various objects and materials visible on the shelves or surfaces. The image has a moody, atmospheric quality, with the high-contrast black and white tones creating a sense of depth and texture.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This black and white image appears to be of an architectural or decorative element, likely from a historical building. The main focus is on a decorative panel or frieze that features carved or painted floral motifs. The panel has three flower-like designs spaced across it, with each flower having leaf-like patterns surrounding it. The panel appears to be mounted or installed in what looks like a construction or renovation setting, as evidenced by the wooden beams and structural elements visible in the upper portion of the image. The image has a credit line indicating it's from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man lying on his back on a scaffolding platform, with a brick wall and a building in the background. The man is wearing a light-colored shirt and dark shorts, and he has his arms at his sides. He appears to be resting or sleeping.

The scaffolding platform is made of wooden beams and has a metal grate on top. There are several objects on the platform, including a large roll of rope or cable, a small table or bench, and a few other items that are not clearly visible.

In the background, there is a brick wall with a decorative design on it. The wall is made up of red bricks and has a few windows and doors. Behind the wall, there is a building with a sloping roof and a chimney.

Overall, the image suggests that the man is working on a construction or renovation project, and he has taken a break to rest on the scaffolding platform. The image may have been taken in the 1970s, based on the copyright information provided.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of a man lying on a scaffolding platform, with a brick wall featuring decorative elements in the foreground. The man is wearing a light-colored shirt and dark shorts, and appears to be resting or working on the scaffolding.

In the background, there are several buildings visible, including what appears to be a church or other religious structure with a pointed roof. The overall atmosphere of the image suggests that it was taken during a construction or renovation project, possibly in the 1970s given the copyright information at the bottom of the image.

The image has a copyright notice at the bottom that reads "© President and Fellows of Harvard College (Harvard University Art Museums)" and a date of "P1970.4462.0006". This suggests that the image is part of a collection held by the Harvard University Art Museums, and may have been taken as part of a documentation project or exhibition.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

A black-and-white photo shows a building under construction. The image features a person lying on a wooden platform, which appears to be a roof. The person is lying on their back with their legs up, and they seem to be resting or taking a break. The wooden platform is supported by wooden beams, and there are some objects on it, such as a basket or a bag. Behind the person, there is a building under construction with a roof and a wall.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white image features a person lying on a wooden structure. The person is lying on his back with his head and legs hanging off the edge. The person is wearing a white shirt and shorts. The wooden structure is made of wood and metal. The structure is supported by wooden poles. The structure is probably under construction. The structure is surrounded by a brick wall with a design.

Google Gemini

Created by gemini-2.0-flash on 2025-06-01

Here is a description of the image:

The black and white inverted image features two people relaxing on a surface with ornamental carvings, framed by scaffolding.

In the foreground, a brick-like surface is adorned with three decorative carvings. These carvings appear to be stylized floral patterns with a central blossom flanked by leafy extensions, providing a contrasting texture against the brick-like background.

Above this surface, two people are lying down in what seems to be a relaxed posture. Their bodies are positioned horizontally across the frame, and they appear to be close to each other.

The scene is enclosed by a bamboo scaffolding structure. The bamboo is used to create a framework of poles and crossbars that form a protective or supportive structure around the figures.

In the background, a building with a brick facade and distinctive architectural details is visible. The building's design includes evenly spaced windows and a gabled roof, suggesting it could be a residential or public structure. The overall image has an intriguing combination of constructed elements, decorative artistry, and human presence.

Created by gemini-2.0-flash-lite on 2025-06-01

Here's a description of the image:

This is a black and white, inverted image. The central focus of the image is on a person lying down on a structure. They are seemingly looking toward the viewer, with their arms up. A second person is visible, as their head and arm are in frame. The structure they are lying on appears to be made of a patterned material. Above the person, a scaffolding-like structure constructed of bamboo is visible. Behind the bamboo structure are buildings with rooftops. On the front of the structure the person is laying on is a decorative floral design.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

This black and white photograph depicts a detailed miniature architectural model, likely representing a historic or significant building. The model is intricately crafted with attention to structural details such as beams, supports, and interior layout. The lower section of the model features decorative elements, including floral and possibly heraldic designs, suggesting a historical or cultural significance.

The photograph is labeled with the credit "© President and Fellows of Harvard College (Harvard University Art Museums)" and a reference number "P1970.462.0006," indicating that it is part of a collection housed at the Harvard University Art Museums. The detailed craftsmanship and the inclusion of specific decorative motifs suggest that this model may be used for educational or preservation purposes, providing a scaled representation of a larger structure.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image appears to be a black-and-white photograph depicting a nighttime scene. It shows a person lying on a wooden platform or structure that resembles a float or stage. The individual is dressed in a light-colored shirt and dark pants and is lying on their back, with their arms and legs extended. The platform has a decorative brick-like front with intricate patterns, and there are wooden beams and supports visible above the person. The background shows a building with windows and a brick facade, and the sky appears dark, indicating that the photo was taken at night. The overall atmosphere seems to be part of a performance or event, possibly outdoors given the lighting and setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white image depicts a display or setup that seems to be part of an open-air or outdoor event, possibly an art or cultural exhibition. Here's a detailed description:

  1. Main Structure:

    • The central focus is a raised platform or display case made of wood. The platform has intricate carvings on its sides, featuring floral and leaf-like patterns.
    • On top of the platform, there is a reclining figure. The figure appears to be life-sized and is dressed in a white outfit. The pose is relaxed, with one arm extended and the other resting near the head.
  2. Surroundings:

    • The platform is surrounded by scaffolding or a framework made of wooden poles and beams. This suggests that the display might be part of a temporary setup, possibly for an event or exhibition.
    • In the background, there is a building with visible windows and a brick facade. This building appears to be part of the setting but not directly related to the display.
  3. Lighting and Atmosphere:

    • The image is well-lit, highlighting the details of the platform and the reclining figure. The lighting creates a dramatic effect, emphasizing the textures and patterns on the platform.
    • The overall atmosphere suggests a nighttime setting, given the darkness in the sky and the focused lighting on the display.
  4. Additional Details:

    • There are some objects around the platform, possibly decorative or part of the display, but their exact nature is not clear from the image.
    • The image has a watermark or caption at the bottom, indicating it is from the President and Fellows of Harvard College (Harvard University Art Museums).

The image captures a moment of artistic or cultural significance, with a focus on the detailed craftsmanship of the platform and the serene pose of the reclining figure.

Text analysis

Amazon

College
Art
and
Fellows
(Harvard
Museums)
of
University
Harvard
© President and Fellows of Harvard College (Harvard University Art Museums)
President
©
P1970.4462.0006

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4462.0006
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4462.0006