Human Generated Data

Title

Untitled (medium format images of boy hanging off swingset outdoors)

Date

1962

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10059

Human Generated Data

Title

Untitled (medium format images of boy hanging off swingset outdoors)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10059

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.8
Painting 95.9
Art 95.9
Advertisement 59.8

Clarifai
created on 2023-10-27

child 99.7
people 99.5
one 98.7
monochrome 96.4
portrait 93.5
two 92.7
baby 92
son 91.5
family 90
girl 89.8
adult 87.2
woman 86.8
fun 86.2
fear 86.2
boy 85.9
climb 85.1
war 83.6
pretty 82.8
man 82.2
despair 82.1

Imagga
created on 2022-01-28

guillotine 53.4
instrument of execution 43
device 34.6
instrument 31.8
track 23.4
architecture 19
old 18.1
building 17.5
black 17.1
city 15.8
tie 15.3
transportation 14.3
structure 14
brace 13.9
urban 12.2
window 12.2
wall 11.4
light 10.7
steel 10.6
travel 10.5
bridge 10.5
construction 10.3
transport 10
dark 10
railway 9.8
support 9.8
strengthener 9.7
train 9.6
iron 9.6
dirty 9
dress 9
person 8.9
railroad 8.8
rail 8.8
man 8.7
street 8.3
vintage 8.3
history 8
metal 8
art 7.8
silhouette 7.4
industrial 7.3
people 7.2
frame 7.2

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 98.5
black and white 93.7
outdoor 92.2
bridge 82.1
clothing 80.9
monochrome 80
person 58.8
dress 58.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 98.3%
Happy 0.4%
Sad 0.4%
Disgusted 0.2%
Fear 0.2%
Surprised 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Calm 99.2%
Confused 0.2%
Surprised 0.2%
Sad 0.1%
Fear 0.1%
Happy 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 95.8%
Happy 2.8%
Surprised 0.6%
Sad 0.4%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-6
Gender Female, 81.5%
Calm 83.2%
Confused 6.1%
Angry 5.4%
Happy 1.5%
Disgusted 1.1%
Surprised 1%
Fear 0.9%
Sad 0.9%

Feature analysis

Amazon

Person
Poster

Clarifai

Clothing
Human face
Tree
Human arm
Picture frame
Human nose
Human mouth
Human eye

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.1%

AWS Rekognition

Poster 59.8%

Clarifai

Clothing 93.1%

Clarifai

Clothing 90.1%

Clarifai

Clothing 83.4%

Clarifai

Human face 92.1%

Clarifai

Human face 82.7%

Clarifai

Tree 60.2%

Clarifai

Tree 52%

Clarifai

Human arm 51.6%

Clarifai

Human arm 43.3%

Clarifai

Human arm 38%

Clarifai

Human arm 34.8%

Clarifai

Picture frame 46.2%

Clarifai

Human nose 42.6%

Clarifai

Human mouth 37.3%

Clarifai

Human eye 33.7%

Categories

Imagga
created on 2022-01-28

streetview architecture 97.5%
paintings art 2.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

photograph of a young man standing in a tree.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man in a black shirt is holding a dog

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This is a photographic negative featuring two frames of a scene with children playing on a structure made of poles. The inverted colors indicate it is a film negative. In the top frame, a child is smiling and hanging onto the top of the structure with both hands, while trees form the background. In the bottom frame, the same child is hanging similarly, but there appears to be another child in the background, standing next to them. Both frames show an outdoor setting with the silhouettes of trees and other background details visible.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image consists of two similar photographs that appear to be negatives placed one above the other. They depict children playing on a playground structure, possibly a swingset. In each photograph, a child is hanging onto the top part of the structure, using both hands to hold onto a bar in a triangular frame. The background shows trees and foliage, which are inverted in color due to the negative format, giving them a bright and detailed appearance against a dark background. In the lower photograph, there is another child visible on the right side, also interacting with the playground equipment. Both children appear to be smiling or enjoying themselves. The edges of the film negative contain some markings and numbers, which are typical of film strips.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows two black and white photographs of a person hanging from a wooden structure or swing in an outdoor, natural setting. The person appears to be a young child or adolescent, and they are smiling and suspended in the air, with their arms outstretched. The background consists of trees and foliage, creating a serene and playful atmosphere.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

These appear to be inverted or negative black and white photographs showing someone sitting or standing in front of what looks like a structure with vertical beams or poles. The images have a grainy, high-contrast quality typical of photographic negatives, where light and dark values are reversed. The background shows some organic, tree-like patterns or foliage. The composition is similar in both photos, though they appear to be taken from slightly different angles or at different moments.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a black-and-white photograph of two children playing on a swing set. The top photo shows a boy with short hair, wearing a dark shirt and light-colored pants, holding onto the swing set's metal frame with both hands as he swings. The bottom photo depicts the same boy, now accompanied by another child, likely a girl, who is also holding onto the swing set. Both children are smiling and appear to be enjoying themselves. The background of the photos features trees and bushes, suggesting that the swing set is located in a park or backyard. The overall atmosphere of the image is one of carefree joy and childhood innocence.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image appears to be a black and white photograph of two children playing on a jungle gym, captured in a vertical orientation.

The top half of the image features a child hanging from a bar, with their arms raised above their head. They are dressed in a dark-colored shirt and light-colored pants. The background is filled with trees and foliage, creating a natural setting.

The bottom half of the image shows another child standing on the ground, looking up at the first child. They are wearing a dark-colored shirt and light-colored pants, similar to the first child. The background remains the same, with trees and foliage visible.

The image has a white border around it, with some text visible on the left side that reads "MATTA 2-2-1" and "EASTMAN KODAK COMPANY." On the right side, the text "G10" is visible, along with some other illegible text. The overall atmosphere of the image suggests a playful and carefree moment between the two children.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

The image is a composite of two black-and-white photographs. The upper photograph shows a young boy hanging from a tree swing, gripping the horizontal bar with both hands. His feet are dangling, and he appears to be looking up, possibly at the camera. The boy is wearing a short-sleeved shirt. The background is a dense forest with tall trees and dark foliage, suggesting it is either dusk or dawn due to the low light conditions.

The lower photograph shows a similar scene, but with a different boy. This boy is also hanging from a tree swing, holding onto the bar with both hands. His feet are also dangling, and he seems to be looking down. He is wearing a sleeveless shirt and shorts. In the background, there is another individual, possibly an adult, standing on the ground and looking up at the boy. The forest setting is similar, with tall trees and dark foliage.

Both photographs have a grainy texture, typical of older film photography. There are labels on the left side of each photograph, indicating that they are part of a series or collection. The upper photograph is labeled "11" and the lower one is labeled "G-10," suggesting they are part of a larger set of images.

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image shows two black-and-white photographs of children hanging from a swing set. The first image depicts a young boy hanging upside down from the swing, while the second image shows a young girl hanging from the swing. Both children appear to be smiling and enjoying themselves. The swing set is made of metal and has a curved structure with a horizontal bar at the top. The background of the image is blurry, with trees and other vegetation visible.

Google Gemini

Created by gemini-2.0-flash on 2025-04-28

This black-and-white image features two frames from a film strip, each capturing scenes of children playing on what appears to be a set of parallel bars or a similar structure.

In the top frame, a young boy is hanging from the bars, his arms extended above him. He is looking directly at the camera with a slight smile, his expression seemingly cheerful and confident.

The background is filled with the dense foliage of trees, with branches and leaves creating a busy, almost abstract pattern.

The lower frame depicts a similar scene, with two children on the bars. The child on the left is hanging, with their body partially visible, while the child on the right is standing nearby.

The same background of trees is present, providing a natural backdrop to the playground setting.

The composition of both frames is similar, with the children positioned in the center and the bars forming a geometric frame around them. The black-and-white palette adds a timeless quality to the images, while the film strip format suggests a moment captured from a larger series of memories.

Created by gemini-2.0-flash-lite on 2025-04-28

Here's a description of the image:

This is a black and white, inverted photograph showing two frames, possibly taken from a film negative.

Top Frame:

  • Features a young boy hanging from a playground structure (possibly monkey bars).
  • The boy's face is visible and he appears to be smiling.
  • The structure is made of wooden beams and the background appears to be trees and foliage.

Bottom Frame:

  • Also shows a playground scene.
  • Two children are hanging from the playground bars.
  • The trees and foliage of the background give context.

Overall:

  • The photograph has a vintage, somewhat grainy quality due to the film process.
  • The inversion creates an unusual look, where the areas that would normally be white are black and vice versa.
  • The image evokes a sense of childhood, outdoor play, and perhaps nostalgia.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-23

The image is a black-and-white photograph featuring two separate shots of a person climbing a ladder. The person is smiling and appears to be enjoying the activity.

  1. Top Image:

    • The individual is positioned midway up the ladder.
    • They are wearing a dark-colored shirt and light-colored pants.
    • The background shows a natural setting with trees and foliage.
  2. Bottom Image:

    • The person is slightly higher up the ladder compared to the top image.
    • The same attire is worn, with a dark-colored shirt and light-colored pants.
    • The background is similar, showing trees and foliage.
    • There is another person partially visible at the bottom of the ladder, wearing jeans and a light-colored shirt.

Both images capture a moment of outdoor activity, likely in a park or wooded area, emphasizing the joy and physical engagement of climbing.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-17

The image is a black and white photograph that appears to be a scan of a vintage negative, as indicated by the "Miji Vitales Park" stamp on the left side and the "G 10" in the bottom right corner, which are typical markings for a photograph's negative. The photographs are arranged in a grid format, with one image at the top and one at the bottom.

Top Image:

  • The top image shows a person standing in front of a structure that resembles a metal tripod or scaffolding, possibly used for photography or construction.
  • The person is smiling and looking directly at the camera.
  • The background appears to be outdoors, with a natural setting that includes trees and possibly a dense forest or wooded area.

Bottom Image:

  • The bottom image shows two people. Both are standing in front of the same metal structure, and it appears that they are interacting with the equipment.
  • The person on the left is smiling and looking up, possibly at the camera or something above them.
  • The person on the right is also smiling and appears to be wearing a cap.
  • The background is similar to the first image, with trees and a natural setting.

The overall tone of the image is nostalgic and suggests a historical context, possibly related to photography, outdoor activities, or a park or natural reserve.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-17

The image is a composite of two black-and-white photographs, stacked vertically.

In the top photograph, a young boy is hanging from what appears to be a structure made of wooden poles. He is smiling and seems to be enjoying himself. The background is filled with a dense pattern of branches and leaves, creating a complex, almost abstract texture.

In the bottom photograph, two men are also hanging from a similar structure made of wooden poles. They are both smiling and appear to be having fun. The man on the left is wearing a dark shirt and light-colored pants, while the man on the right is wearing a lighter shirt and dark pants. The background is similar to the top photograph, with a dense pattern of branches and leaves.

Text analysis

Amazon

HEILIGE
MAD
MIT
DEM
DIE
ONNA
Ernst
GDALENA
U.
MA
in
Das
Original
DIE MAD ONNA MIT DEM JESUKINDE.
PERUCINU
DIE HEILIGE MA GDALENA U. KATHARINA.
Gallerie
Harrach
S.FEC.MDVIII
der
sich
Grafen
KATHARINA.
Frauz
PETRUS PERUCINU S.FEC.MDVIII
JESUKINDE.
Das Original Gemälde befondet sich in der Gallerie Sr Erlaucht des Herra Grafen Frauz Ernst Harrach
befondet
Sr
PETRUS
Gemälde
Erlaucht des Herra

Google

G 10 11 MJI MJII YT 33 A2 KAGOA MJIRYT3R A2 XAGON
G
10
11
MJI
MJII
YT
33
A2
KAGOA
MJIRYT3R
XAGON