Human Generated Data

Title

Untitled (photograph on wall of group standing around yard and balcony of house with man petting a dog in foreground)

Date

1900-1930

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9060

Human Generated Data

Title

Untitled (photograph on wall of group standing around yard and balcony of house with man petting a dog in foreground)

People

Artist: Martin Schweig, American 20th century

Date

1900-1930

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9060

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.5
Art 96
Painting 95.5

Clarifai
created on 2023-10-26

painting 99.4
people 99.4
picture frame 98.9
print 98
one 98
art 97.7
no person 95
adult 94.4
group 90.9
wear 90.4
illustration 90.2
two 88.5
retro 87.8
man 86.1
antique 85.8
album 83.8
furniture 82.8
home 82.2
blank 82
margin 80

Imagga
created on 2022-01-23

window screen 79.1
screen 72.5
grunge 66.5
old 60.7
vintage 59.6
antique 55.5
texture 52.2
frame 51.2
protective covering 49.2
aged 48
retro 45.9
border 44.4
covering 42.4
dirty 39.8
grungy 38.9
blackboard 38.7
ancient 33.8
paper 33.8
damaged 33.4
material 33.1
empty 32.7
wall 32.5
rusty 31.5
textured 29.8
pattern 29.4
design 29.3
blank 28.3
rough 28.3
art 26.7
structure 25.7
backdrop 23.9
book jacket 23.4
weathered 21.9
rust 21.2
parchment 21.1
space 21
wallpaper 20.7
text 20.1
film 20
graphic 19.7
jacket 19.2
brown 19.2
paint 19
messy 18.4
edge 18.3
spot 18.2
old fashioned 17.1
black 16.9
stains 16.6
decoration 16.3
worn 16.2
crumpled 15.6
decay 15.5
decorative 15.1
surface 15
scratch 14.7
stain 14.4
aging 14.4
dirt 14.3
page 13.9
grain 13.9
wrapping 13.8
photographic 13.7
frames 13.7
grime 13.7
mottled 13.7
negative 13.6
obsolete 13.4
sheet 13.2
scratches 12.8
fracture 12.7
faded 12.7
movie 12.6
crack 12.6
your 12.6
wood 12.5
stained 12.5
color 12.3
backgrounds 12.2
historic 11.9
noisy 11.8
broad 11.8
noise 11.7
slide 11.7
ragged 11.7
album 11.7
burnt 11.7
canvas 11.4
stone 11.2
cover 11.1
camera 11.1
photograph 10.9
highly 10.8
memorial 10.8
element 10.8
tracery 10.7
succulent 10.7
collage 10.6
detailed 10.6
digital 10.5
detail 10.5
photography 10.5
designed 9.9
layered 9.8
mess 9.8
burned 9.8
crease 9.8
strip 9.7
layer 9.7
mask 9.6
textures 9.5
dark 9.2
framework 9
overlay 8.9
computer 8.8
scratched 8.8
torn 8.7
great 8.6
poster 8.5
board 8.4
book 8.4
brass 8.3
style 8.2
metal 8.1
building 7.9
nobody 7.8
concrete 7.7
floral 7.7
age 7.6
iron 7.5
close 7.4
entertainment 7.4
letter 7.3
gray 7.2
window 7.1
interior 7.1
architecture 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

old 95.9
white 92.4
gallery 92.2
room 90.4
indoor 85.7
text 84.4
tree 84.2
scene 82
picture frame 72.7
black 71.3
drawing 70.5
vintage 36.9
painting 19.6

Color Analysis

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 95.4%

AWS Rekognition

Person 91.4%

AWS Rekognition

Person 79.7%

AWS Rekognition

Person 78.3%

AWS Rekognition

Person 76.2%

AWS Rekognition

Person 65.9%

AWS Rekognition

Person 65.8%

AWS Rekognition

Person 60.8%

Categories

Imagga
created on 2022-01-23

streetview architecture 61%
paintings art 36.2%
interior objects 2.2%

Captions

Microsoft
created by unknown on 2022-01-23

a vintage photo of a painting 80.8%
a vintage photo of a person 80.7%
a vintage photo of a person in a room 80.6%

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a black and white photo of a house with a staircase

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This image shows an inverted negative photograph. The main elements consist of people gathered outdoors near a staircase, building, and trees. The building has rectangular architecture, and the stairs are flanked by banisters. Several individuals are visible, wearing period-style clothing and appearing to be arranged or posing for the photograph. The trees and vegetation surrounding the scene dominate the setting, adding texture and context.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image appears to be a black and white photographic negative, showing a group of people positioned around a set of outdoor stairs leading to a building, likely a porch. The scene is surrounded by trees and foliage. The people in the image are in various poses, with some standing on the stairs and others on the ground. Due to the nature of negatives, bright areas appear dark and vice versa, which makes detailed visual identification challenging. Overall, the setting gives the impression of an outdoor gathering at a residential location.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image appears to be a black and white photograph depicting a crowded outdoor scene. In the foreground, there are several people gathered on a set of stairs or a raised platform. Behind them, there is a building or structure with a distinctive architectural style. The background is filled with trees and foliage, creating a lush, natural setting. The overall scene conveys a sense of activity and liveliness, with the people seemingly engaged in some kind of event or gathering.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This appears to be a historical black and white photograph showing a building exterior with stairs leading up to it. There are several people gathered on and around the stairs, though their details are not clear in this image. The scene is framed by what appears to be trees or foliage that creates bright, light-colored areas in contrast to the darker background. The photograph itself appears to be mounted or framed, as evidenced by the visible borders around the image. The quality and style of the photograph suggests it was taken many years ago, possibly in the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of people gathered around a staircase in front of a building, surrounded by trees and bushes.

  • The photograph is framed in a dark border with a lighter-colored border around it.
    • The photograph itself shows a group of people standing on the steps and in front of a building.
      • There are approximately 10 people in the photograph, all wearing clothing from the early 20th century.
      • The people are standing on the steps and in front of the building, with some of them facing the camera and others looking away.
      • The building appears to be a large, two-story structure with a balcony on the second floor.
      • The trees and bushes surrounding the building are lush and green, with some of them partially obscuring the view of the building.
    • The background of the photograph is a dark gray color, which helps to highlight the details of the scene.
      • The overall atmosphere of the photograph is one of elegance and sophistication, with the formal clothing and the grand building creating a sense of refinement.
      • The photograph may have been taken at a special event or occasion, such as a wedding or a formal gathering.
      • The photograph could also be a portrait of a family or a group of friends, taken in front of their home or a favorite location.

The photograph is a beautiful example of early 20th-century photography, with its formal composition and elegant atmosphere. It provides a glimpse into the past, showcasing the fashion and architecture of the time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black and white photograph of a house with people on the porch and in the yard. The photograph is framed in a white border, which is then framed in a black border. The photograph itself appears to be a negative, as the colors are reversed.

In the foreground, there is a large tree with white leaves, and several people are standing around it. One person is standing on the stairs leading up to the porch, while others are sitting or standing on the porch. The house has a large porch with a railing, and there are several windows visible.

The background of the image is dark, but it appears to be a night sky. There are some trees and bushes visible in the distance, but they are not clearly defined.

Overall, the image appears to be a vintage photograph of a house and its occupants, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring a group of people gathered in front of a building. The building has a porch with stairs leading up to it, and there are several individuals standing on the porch, possibly observing the group below. The group of people in front of the building appears to be engaged in some activity, with some individuals standing and others sitting. There are also trees and plants in the foreground, adding to the overall scene. The photograph has a vintage look, with a slightly grainy texture and a monochromatic color scheme.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black and white photograph of a group of people gathered in front of a building. The photograph has a vintage look, possibly from the early 20th century. The people are dressed in formal attire, suggesting a special occasion or event. The building in the background has a classic architectural style, with columns and a balcony. The photograph captures a moment in time, providing a glimpse into the past.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

This appears to be an old photograph or negative, likely taken outdoors. Here's what can be observed:

  • Composition: The image captures a scene with a house/building in the background and a group of people in the foreground.
  • People: There are several figures present. Some are standing on a porch or balcony, while others are gathered near the ground level.
  • Setting: The presence of trees suggests an outdoor environment, perhaps a yard or garden. There appears to be a lawn.
  • Technique: The image has a "negative" look, with light and dark areas reversed. This implies it is either a negative film or a digital photograph processed to look like a negative.
  • Age: Given the style and appearance, it seems to be an older photograph.
  • Framing: The image is presented within a frame and matting.

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white photograph featuring a group of people outside a building. The photo seems to have been taken from some distance.

In the foreground, there is a grassy area. Beyond this, a group of people can be seen. Some are seated, and others are standing. To the side, a staircase leads up to a balcony or porch, where a few more figures are visible. The scene is framed by trees, which add a sense of depth to the composition. The overall impression is of a gathering, possibly a family or social event, taking place on the grounds of the building.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a black-and-white photograph depicting a group of people gathered outside a house. The house is a two-story structure with a staircase leading up to the entrance. The house is surrounded by lush vegetation, including trees and shrubs, which are in full bloom, suggesting that the photo might have been taken during spring or summer.

Several individuals are visible in the photograph. Some are seated on the steps leading up to the house, while others are standing nearby. The people appear to be dressed in early to mid-20th-century attire, which includes dresses, suits, and hats. The scene suggests a social gathering or a family event.

The photograph is framed with a decorative border, adding to its vintage appearance. The image has a somewhat grainy quality, typical of older photographs, and there are some markings and numbers visible at the top of the frame, possibly indicating archival information or processing details.

Qwen

Text analysis

Amazon

G