Human Generated Data

Title

Untitled (view from below of nine children posing by fence of second floor outdoor patio)

Date

1961

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9825

Human Generated Data

Title

Untitled (view from below of nine children posing by fence of second floor outdoor patio)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9825

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.1
Ice 89.2
Nature 89.2
Outdoors 89.2
Tree 89
Plant 89
Statue 60.9
Art 60.9
Sculpture 60.9
Snow 60.2
Theme Park 59.4
Amusement Park 59.4
Frost 59
Crowd 58.9

Clarifai
created on 2023-10-27

winter 95.8
Christmas 95.5
building 95.4
theater 95
snow 94.6
group 94.5
people 94.2
tree 93
architecture 91.5
infrared 90.7
landscape 90.4
street 88.5
art 87.9
sky 87.7
castle 87.7
no person 86.8
city 86.6
celebration 86.6
queen 84.5
movie 84

Imagga
created on 2022-01-28

structure 74
fountain 68.1
building 65.6
cinema 51.8
architecture 45.4
theater 41.6
city 31.6
landmark 28.9
history 28.6
balcony 23.8
facade 23.7
church 22.2
famous 21.4
sculpture 19.1
tourism 19
statue 18.5
old 18.1
travel 17.6
religion 17
ancient 16.4
capital 16.1
monument 15.9
town 15.8
historic 15.6
historical 14.1
house 13.8
cathedral 13.6
art 12.4
column 12.2
park 12.1
national 11.8
marble 11.6
snow 11.2
symbol 10.8
tower 10.7
urban 10.5
destination 10.3
culture 10.3
sky 10.2
tourist 10
stone 9.5
place 9.3
arch 8.7
dome 8.7
architectural 8.7
faith 8.6
wall 8.6
buildings 8.5
palace 8.5
window 8.4
exterior 8.3
night 8
catholic 7.8
tract 7.7
god 7.7
cross 7.5
religious 7.5
detail 7.2

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 89.3
black and white 79
old 53.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Male, 97.3%
Sad 90.7%
Happy 7.6%
Calm 0.6%
Angry 0.3%
Fear 0.2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 33-41
Gender Male, 98.7%
Calm 70.7%
Surprised 7.3%
Happy 5.5%
Sad 4.9%
Fear 3.6%
Disgusted 3.2%
Confused 2.8%
Angry 2%

AWS Rekognition

Age 27-37
Gender Female, 63.9%
Calm 29.8%
Sad 26.9%
Happy 23.7%
Surprised 10.4%
Confused 4%
Disgusted 1.8%
Fear 1.7%
Angry 1.6%

Feature analysis

Amazon

Person

Clarifai

Tree
Window
Clothing
Person
Human face
Building

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 79.6%

AWS Rekognition

Person 71.2%

AWS Rekognition

Person 44.1%

Clarifai

Tree 85.2%

Clarifai

Tree 81.8%

Clarifai

Tree 61.7%

Clarifai

Tree 35.7%

Clarifai

Window 50.9%

Clarifai

Clothing 47.6%

Clarifai

Clothing 41.8%

Clarifai

Clothing 41%

Clarifai

Clothing 38%

Clarifai

Clothing 37.8%

Clarifai

Person 46.7%

Clarifai

Person 44.4%

Clarifai

Person 43.6%

Clarifai

Person 39.7%

Clarifai

Person 33%

Clarifai

Human face 44.7%

Clarifai

Human face 43.3%

Clarifai

Human face 43.2%

Clarifai

Human face 40.1%

Clarifai

Human face 39.4%

Clarifai

Human face 36.7%

Clarifai

Human face 36.7%

Clarifai

Building 42.4%

Categories

Imagga
created on 2022-01-28

paintings art 96%
streetview architecture 3.8%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

the statue of monarch in the grounds.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing on a balcony balcony

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This is a black-and-white negative image of a group of individuals standing on a decorative wrought-iron balcony. The balcony features ornate swirls and patterns, and it is attached to a building with arched architectural details visible below. The setting includes tall, textured foliage on both sides of the image, which frames the scene. Above the balcony, part of a rounded structure is visible, with what appears to be a decorative urn or sculpture at the top. The overall composition suggests a classic or historical setting.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image appears to be a photographic negative showing a group of children standing on an ornate balcony. They are wearing striped clothing and are leaning over the railing, which features intricate wrought iron designs. The background includes trees on either side, adding to the setting's scenic view. The photograph displays inverted colors typical of a negative, with dark skies and light trees. The architectural details and the children's postures hint at a cheerful gathering or event.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a group of people, likely children, standing on a balcony or platform with an ornate, decorative railing. The people are wearing striped clothing, suggesting they may be part of some kind of performance or event. The background appears to be a snowy, forested area, creating a striking contrast with the dark, shadowy figures on the balcony. The overall scene has a somewhat mysterious and theatrical quality to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph showing a group of people standing on what appears to be a decorative balcony or terrace. The balcony features ornate wrought iron scrollwork in its railing design. Several individuals are lined up along the railing, and they appear to be wearing similar striped shirts. The architecture suggests this might be part of a historic building or estate. The image has an interesting ethereal quality, possibly due to infrared photography technique, as the foliage in the background appears very bright and luminous against a dark sky. The composition creates an interesting contrast between the architectural details, the figures, and the glowing vegetation on either side.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people standing on a balcony, with trees visible in the foreground and background.

  • The photograph is taken from below, looking up at the balcony.
    • The balcony is made of metal and has an ornate design.
    • There are seven people standing on the balcony, all wearing casual clothing.
      • They appear to be adults, but their faces are not clearly visible due to the low angle of the camera.
      • They are all facing towards the camera, but their expressions are neutral or slightly smiling.
    • The balcony is surrounded by trees, which are also visible in the background.
      • The trees are tall and have leaves, but they are not clearly defined due to the low contrast of the image.
      • The sky above the trees is dark, suggesting that the photo was taken during the day.
  • The overall atmosphere of the image is one of relaxation and leisure.
    • The people on the balcony appear to be enjoying themselves, but they are not doing anything particularly exciting or dramatic.
    • The trees and sky in the background add to the peaceful and serene atmosphere of the image.

In summary, the image is a black-and-white photograph of a group of people standing on a balcony, surrounded by trees and a dark sky. The people appear to be relaxing and enjoying themselves, and the overall atmosphere of the image is one of peace and serenity.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of people standing on a balcony, surrounded by trees. The balcony features an ornate railing with a decorative design, and the individuals are dressed in casual attire, including striped shirts and pants. The background of the image is dark, suggesting that it may have been taken at night or in a shaded area.

In the bottom-left corner of the image, there is a watermark that reads "KODAK SAFETY FILM," indicating that the photograph was likely taken using Kodak film. The overall atmosphere of the image appears to be relaxed and informal, with the group of people seemingly enjoying each other's company on the balcony.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring a group of people standing on a balcony. The photograph has a vintage look, with a white border around the edges and a slightly blurred effect, giving it an old-fashioned appearance. The people in the photo are standing on a balcony with a decorative railing, and they appear to be posing for a group photo. Some of them are smiling, while others are looking straight ahead. The balcony is surrounded by trees, and the sky is dark, suggesting that the photo was taken at night.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black and white photograph of a group of people standing on a balcony. The balcony is adorned with a decorative metal railing featuring intricate designs. The people are standing close together, possibly posing for a photograph. The balcony is elevated above the ground, with trees visible on either side. The trees are tall and have a dense canopy. The photograph has a vintage filter applied to it, giving it a nostalgic feel.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

The image is a black-and-white photographic negative showing a group of children on a balcony. The balcony is adorned with intricate wrought iron railings and is part of a grand building, possibly a mansion or estate, which is only partially visible. The architectural style appears classical, with detailed moldings and a large arched window or doorway below the balcony.

There are seven children visible, standing on the balcony, leaning on the railing. They appear to be wearing similar outfits, possibly striped tops and light-colored pants or shorts, suggesting they might be part of a team or group, or perhaps siblings. Their expressions and poses suggest they are looking at something below or off to the side, possibly an event or someone they know.

The building is framed by what appear to be large, bushy trees or shrubs on either side, adding a sense of depth and framing to the composition. The negative quality of the image reverses the tones, making what would be light areas appear dark and vice versa. This creates a somewhat surreal and high-contrast effect. The image is cut-off on the upper right side.

In the upper right of the photo is a marker stating "KODAK -- SAFETY".

Created by gemini-2.0-flash-lite on 2025-05-08

Here's a description of the image:

Overall Impression:

The image is a black and white, negative image. It appears to be an old photograph. The composition is dominated by a group of people on a balcony.

Main Elements:

  • People: A group of approximately eight individuals are standing on a decorative balcony. They appear to be wearing similar outfits. The people wear striped shirts and light-colored pants. They look like they're posing or casually leaning against the railing.
  • Balcony: The balcony is ornate, with a curved shape and decorative scrollwork. It has a classic design.
  • Building: The balcony is attached to a building, the facade of which can be seen below. It features an arched opening, possibly a door or window.
  • Surroundings: Dense foliage, probably trees, frames the sides of the image. The sky is dark and contrasts with the lighter elements.

Composition and Tone:

The composition is symmetrical, with the people centered on the balcony. The negative effect results in inverse colors and light/shadow. The photograph appears to be historical due to the attire of the people and the architectural style.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a black-and-white photograph featuring a group of people standing on a balcony. The balcony has ornate iron railings with intricate designs. The people are dressed in similar outfits, predominantly in striped shirts, which suggests they might be part of a group or event. The background shows trees with light-colored foliage, which stands out due to the infrared effect of the photograph. The building appears to be of a classical architectural style, with arched windows and decorative elements. The overall mood of the image is somewhat nostalgic and timeless, enhanced by the monochromatic and infrared qualities.

Qwen

No captions written