Human Generated Data

Title

Untitled (young girl in a costume standing in a box)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7501

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young girl in a costume standing in a box)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7501

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 97.9
Apparel 97.9
Human 93.7
Art 84.4
Advertisement 76.3
Poster 74.5
Face 74
Collage 73.7
Drawing 71.4
Portrait 67.6
Photography 67.6
Photo 67.6
Female 65.3
Sleeve 56.6
Overcoat 56.6
Coat 56.6

Clarifai
created on 2023-10-25

people 99.7
child 97.8
wear 95.2
woman 93.3
one 93.1
education 91.4
monochrome 91.2
uniform 90.8
adult 90.7
man 89.8
portrait 87.3
boy 87
outfit 86
veil 85.8
sports equipment 84.5
recreation 83.6
two 81.9
military 81.3
elementary school 80.3
retro 80

Imagga
created on 2022-01-08

crutch 56.5
staff 44.9
stick 34.2
statue 20.8
old 17.4
art 16.3
religion 16.1
man 14.8
person 14.6
sculpture 14.4
black 13.8
male 12.8
cleaner 12.2
adult 11.8
dress 11.7
interior 11.5
fashion 11.3
people 11.1
culture 11.1
vintage 10.7
style 10.4
ancient 10.4
portrait 10.3
religious 10.3
lady 9.7
decoration 9.6
faith 9.6
clothing 9.4
architecture 9.4
clothes 9.4
building 9
scene 8.6
wall 8.5
face 8.5
historical 8.5
monument 8.4
pretty 8.4
famous 8.4
hand 8.3
traditional 8.3
dirty 8.1
history 8
antique 7.8
marble 7.7
holy 7.7
god 7.6
human 7.5
church 7.4
danger 7.3
industrial 7.3
travel 7

Microsoft
created on 2022-01-08

text 97.9
cartoon 93.9
drawing 93.5
clothing 80.8
person 79.2
sketch 72
black and white 63.9
man 52.3
old 40.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 72.8%
Happy 74.4%
Calm 12.3%
Sad 4.2%
Surprised 4%
Disgusted 2.1%
Confused 1.6%
Angry 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Human face
Picture frame
Footwear
Poster
Human arm
Window

AWS Rekognition

Person 93.7%

Clarifai

Human face 75.8%

Clarifai

Picture frame 69.5%

Clarifai

Footwear 55.2%

Clarifai

Footwear 44.1%

Clarifai

Poster 41.3%

Clarifai

Human arm 37%

Clarifai

Window 36.2%

Clarifai

Window 33.3%

Categories

Imagga
created on 2022-01-08

paintings art 69.5%
streetview architecture 25.8%
interior objects 2.7%
people portraits 1.3%

Captions

Microsoft
created by unknown on 2022-01-08

an old photo of a person 75.4%
an old photo of a person 75.3%
a person standing in front of a door 75.2%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a woman in a white dress stands in front of a window with a large mirror in her hand.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a woman in a striped dress and hat, standing in front of a picture of

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a person standing behind a rectangular cutout or frame, dressed in striped clothing resembling an outfit or costume. The background shows an outdoor setting with mounds of dirt, electrical wires, and a faint silhouette of a building with windows in the distance. The photo appears to be in black and white with a negative effect applied.

Created by gpt-4o-2024-08-06 on 2025-06-13

The black and white image appears to be a photographic negative. It shows a person standing with their body framed by a rectangular cutout, with the appearance of wearing a costume with vertical stripes and a cape or scarf. Visible are the feet which seem to be clad in high-top shoes. Behind the framed figure, there is a backdrop of sand, and strings of circular lights can be seen. In the background, there is a faint image of a house or building with visible windows, which adds depth to the composition. The words "Dunny Play" and some numbers appear on the top edge, likely part of the original label or notes on the negative.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a figure standing inside a framed structure in a rural, hilly landscape. The figure appears to be wearing a costume or outfit with a large, elaborate headdress. The figure is positioned in the center of the frame, with the landscape visible in the background. The image has a black and white, vintage aesthetic.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white photograph shows a smiling young woman wearing a striped dress and bonnet, standing in a doorway with a desert landscape visible behind her. The doorway appears to be part of a temporary or makeshift structure, with fabric or tarp walls. Small lights or ornaments are strung across the top of the doorway. The woman has a cheerful expression as she looks directly at the camera. The desert setting suggests this may have been taken in a remote or rural location, possibly at an event or gathering based on her festive attire.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be a negative image (with light and dark values reversed). It shows a figure wearing what appears to be a white dress or gown with a bonnet or head covering. The figure is standing in a doorway or frame, and they are wearing what look like white shoes or boots. The background shows what appears to be a hillside or mountainous terrain. The image has an unusual, almost ghostly quality due to the negative effect, creating a striking contrast between the white clothing and the darker surroundings.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a person in a costume, standing in front of a backdrop. The person is wearing a long, white dress with a large bow at the neck and a matching bonnet. They are also wearing white shoes and gloves.

The background of the image appears to be a desert or sandy area, with a large pile of dirt or sand behind the person. There is a string of lights or lanterns hanging across the top of the image, and a building or structure can be seen in the distance.

The overall atmosphere of the image suggests that it may have been taken at a costume party or event, possibly in the early 20th century. The style of the costume and the backdrop suggest a vintage or retro aesthetic.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a person in a protective suit, standing in front of a rocky landscape. The person is wearing a long, white protective suit with vertical stripes, a hood, and a mask that covers their face. They are also wearing white shoes and gloves. The suit appears to be made of a shiny material, possibly plastic or vinyl.

In the background, there is a rocky landscape with a few buildings visible in the distance. The sky is overcast, and the overall atmosphere of the image suggests that it was taken in a harsh or inhospitable environment.

The image has a vintage feel to it, with a faded quality that suggests it may have been taken many years ago. There are also some handwritten notes and markings on the image, which appear to be from the photographer or someone who has handled the image at some point. These notes include the words "VOLCANIC ERUPTION" and "HAWAII," which suggest that the image may have been taken during a volcanic eruption in Hawaii.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a young girl standing in front of a mirror. She is wearing a bonnet and a dress with white stripes. The photograph appears to be taken in a studio setting, with a backdrop of a desert landscape. The girl is smiling and appears to be posing for the camera. The photograph has a vintage look, with a slightly grainy texture and a faded color palette. The image is titled "Volt Child," which suggests that it may be part of a series or collection of photographs with a specific theme or concept.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo features a person wearing a costume. The person is standing in front of a glass window with a white border. The person is wearing a hat, a long dress, and shoes. The person is wearing a costume that resembles a clown. The person is smiling. The person's shadow is cast on the glass window. The glass window has a reflection of a building.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here is a description of the image:

The image is a black and white negative, showing a person dressed in a costume and standing in what appears to be an enclosed space.

The person in the image is wearing a long, striped dress with a bonnet. The dress features vertical stripes of light and dark tones. The bonnet has a light, decorative pattern around the edges. The person is wearing a bow.

The person is standing in a frame. Outside the frame is a background of a mound. There is also a building in the background that is not clear.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a black and white photo negative featuring a person dressed in historical clothing, inside of what appears to be a glass box.

The person is wearing a bonnet and a long, vertically striped gown with puffy sleeves. The gown is gathered at the neck and tied with a large bow. They appear to be wearing boots as well.

The person is placed inside a glass box, and the background is out of focus. The person is slightly off center.

To the right of the glass box is a large, dark mound of dirt or possibly a dune. There are small, round objects placed on a line running across the mound. Beyond this the house can be seen.

The upper and left edges of the image show the negative border and writing.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a person standing in a doorway or window frame, dressed in what appears to be traditional winter clothing. The attire includes a fur-lined hood, a long coat with a pattern of vertical stripes, and boots. The individual is also wearing gloves and has a scarf tied around their neck. The background shows a snowy landscape, suggesting a cold environment. The photograph is in black and white, which adds to the vintage feel of the image. The person's face is partially obscured by the hood, but they appear to be smiling. The overall scene conveys a sense of warmth and protection against the cold weather.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black and white photograph featuring a person standing inside a rectangular, floor-standing frame. The frame appears to be made of glass or a reflective material, as the person's image is visible on both sides of the frame. The individual is wearing a long, flowing dress with a decorative headpiece, and their hands are placed near their waist. The background shows a rugged, outdoor landscape with a building partially visible in the upper portion of the image. The scene has a vintage or retro feel, suggesting that the photograph may have been taken a long time ago. A label in the bottom right corner of the image reads "VOLY STELLE." Additionally, there is some handwritten text in the upper left corner of the photograph, which includes the number "13" and possibly the words "Mind" and "Gaps," although the handwriting is somewhat unclear.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This is a black-and-white photograph or artistic print featuring a surreal and manipulated composition. The image shows a person seemingly emerging from a rectangular frame placed on the ground, as if the frame were a portal. The person is wearing a white outfit with black stripes and a white hat. The backdrop appears to be an outdoor setting with a dirt hill and some wire with attached objects, possibly clothespins, suggesting a laundry line. The overall effect is dreamlike and otherworldly, blending reality with artistic manipulation.

Text analysis

Amazon

your