Human Generated Data

Title

Untitled (young girl sitting with pumpkin-headed scarecrow)

Date

1938

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11658

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young girl sitting with pumpkin-headed scarecrow)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11658

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.4
Human 99.4
Person 95.8
Clothing 95.6
Apparel 95.6
Chair 92.7
Furniture 92.7
Sitting 89
Interior Design 87.1
Indoors 87.1
Home Decor 84.1
Female 81.9
Cafe 73.7
Restaurant 73.7
Monitor 73
Electronics 73
Display 73
Screen 73
Woman 66.6
Table 64.5
Girl 59.8
Couch 57.8
Shorts 55.8
Room 55

Clarifai
created on 2023-10-25

people 99.8
group together 99
group 97.6
monochrome 96.7
child 96.7
furniture 95.6
two 95
adult 94.8
three 93.6
man 92.7
recreation 92
four 90.9
several 90.2
many 88.4
chair 88.1
wear 87.7
nostalgia 85.4
boy 84.9
music 83.1
sit 82.7

Imagga
created on 2022-01-15

chair 30.8
person 23.5
device 22.2
people 20.6
barber chair 20.3
musical instrument 19.9
seat 19.4
man 18.2
washboard 18
portrait 17.5
fashion 17.3
adult 16.3
furniture 15.8
sitting 15.4
black 14.4
sexy 13.6
youth 13.6
accordion 13
pretty 12.6
attractive 12.6
room 12.5
model 12.4
indoors 12.3
lifestyle 12.3
wind instrument 11.9
business 11.5
male 10.6
interior 10.6
keyboard instrument 10.5
body 10.4
instrument 10.4
electric chair 10
leisure 10
face 9.9
shop 9.9
one 9.7
style 9.6
hair 9.5
men 9.4
elegant 9.4
cute 9.3
casual 9.3
city 9.1
holding 9.1
dress 9
human 9
musician 9
lady 8.9
blond 8.9
clothing 8.8
20s 8.2
sport 8.2
music 8.2
singer 8.1
happy 8.1
instrument of execution 8
posing 8
women 7.9
urban 7.9
equipment 7.8
luxury 7.7
elegance 7.6
head 7.6
legs 7.5
relaxation 7.5
automaton 7.5
entertainment 7.4
cheerful 7.3
hat 7.3
exercise 7.3
stylish 7.2
suit 7.2
looking 7.2
celebration 7.2
bright 7.1
smile 7.1
performer 7.1
working 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 93.5
clothing 92.1
black and white 90
person 89.8
furniture 87.7
toddler 82.1
footwear 66.8
chair 66.1
table 65.1
baby 60.8
child 51.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Female, 99.5%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Surprised 0%
Disgusted 0%
Fear 0%
Confused 0%
Angry 0%

Feature analysis

Amazon

Person
Person 99.4%
Person 95.8%

Categories

Captions

Microsoft
created by unknown on 2022-01-15

an old photo of a man 88.7%
a man sitting on a table 71%
old photo of a man 70.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a woman in a dress and hat sitting in a chair -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This is a black-and-white photographic negative of a peculiar domestic scene. It features an adult figure seated on a chair wearing a checkered coat and donning a mask that resembles a cartoonish or animal-like face. Next to them is a young child sitting on a rocking horse, facing the masked figure. The room appears to be a well-furnished living space with a bookshelf, framed artwork on the walls, a table with books and a vase, a hearth toolset near the fireplace, and patterned curtains. The atmosphere created by the negative processing makes the scene eerie and unusual, emphasizing the mask and contrasts in the room.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a photographic negative showing a domestic scene with a person and a child. The person is sitting in a chair and appears to be wearing a clown mask or costume, complete with a party hat. Next to them, a young child is seated on a rocking horse, facing the masked person. The setting is a room with a bookshelf filled with books and a table adorned with a bouquet of flowers. There are also other pieces of furniture and decorations visible, such as curtains and framed pictures on the wall. The negative effect creates a ghostly and eerie atmosphere by inverting the colors, resulting in light areas that appear dark and vice versa.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a room with various objects and furnishings. In the center of the frame, there is a large, costumed figure with a pumpkin-like head and a checkered pattern on its body. This figure appears to be some kind of Halloween or costume character. In the foreground, there is a young child sitting in a chair, seemingly interacting with or observing the costumed figure. The room contains other decorative elements, such as shelves, framed artwork, and a vase of flowers, creating an eclectic and somewhat whimsical atmosphere.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a vintage black and white photograph showing a storefront window display. The display features several ornate chairs or furniture pieces with decorative legs, likely in an antique or furniture store setting. The items appear to be arranged in a thoughtful manner behind the glass window. The photograph has a number "8582" visible at the bottom, suggesting it may be from an archival or catalog collection. The image has that characteristic early photography look with its grainy quality and contrast typical of early to mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of a child sitting on a chair in front of a fireplace, with a large puppet or doll standing next to her. The child has short blonde hair and is wearing a dress and shoes. She is looking up at the puppet or doll, which is wearing a plaid shirt, pants, and a hat. The puppet or doll has a carved pumpkin head with a face painted on it.

The room is decorated for Halloween, with a jack-o'-lantern on the table and a witch's hat on the fireplace mantle. There are also books and other items on the table and mantle. The walls of the room are dark-colored, and there are curtains on the windows. The floor is made of wood, and there is a rug in front of the fireplace.

The overall atmosphere of the image is one of wonder and excitement, as the child looks up at the puppet or doll with a sense of awe. The Halloween decorations add to the festive atmosphere, and the image suggests a fun and playful scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image depicts a black-and-white photograph of a child sitting in a chair, facing a large, anthropomorphic pumpkin figure. The pumpkin figure is adorned with a face and wears a hat, coat, and shoes, giving it a human-like appearance. It sits on a chair, positioned in front of a fireplace.

In the background, there are various objects visible, including a table with books, a plant, and a fireplace with a mantle. The room appears to be decorated for Halloween, with the pumpkin figure being the central focus of the scene. The overall atmosphere of the image is one of nostalgia and playfulness, capturing a moment in time from the past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

A black-and-white photo shows a little girl sitting on a rocking chair while a pumpkin-headed mannequin is sitting next to her. The mannequin is wearing a checkered dress and a cone-shaped hat, and it is holding a book. The little girl is wearing a dress and shoes and is looking at the mannequin. Behind them is a cabinet with books and a flower vase. There are two picture frames on the wall, and there is a door with a curtain.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white image shows a child and a person dressed in a costume. The person in the costume is sitting on a chair, while the child is sitting on a rocking chair. The child is looking at the person in the costume. There is a potted plant on the table, along with some books. The image has a watermark with the number "8582" on the bottom left and right.

Google Gemini

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

The image is a black and white negative, portraying a scene indoors. In the center, there is a life-size jack-o'-lantern scarecrow seated on a wooden chair. It's dressed in a checkered jacket and pants, with glove-like hands resting on its lap. The jack-o'-lantern head is topped with a pointed hat.

Facing the scarecrow is a young girl with short hair, sitting on a rocking chair. She appears to be holding something in her hands, seemingly interacting with the scarecrow.

The background features a cabinet filled with books, framed pictures on the wall, and draped curtains. A fireplace with tools beside it and a small table with books on top are visible on the left. The floor has a patterned rug.

Overall, the scene has a vintage feel, likely a captured moment of a Halloween-themed interaction.

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Scene:

The image is a black and white negative of what appears to be a staged scene. It looks to be an interior setting, possibly a living room or a similar space.

Main Subjects:

  • Scarecrow-like Figure: The central figure is a person dressed as a scarecrow. The head is a pumpkin with carved facial features. The figure wears a plaid jacket and a hat. It is sitting in a chair.
  • Child: A young girl is sitting in a rocking chair opposite the scarecrow. The child is looking towards the scarecrow, seemingly engaged in a conversation or interaction.

Background and Environment:

  • Furniture: The room has a small table with books. A bookcase filled with books can be seen behind the figures. A fireplace tool set is on the left side of the image.
  • Decor: Two framed pictures are visible on the wall. There are curtains visible on the right side of the image.
  • Setting: The scene suggests a playful or staged scenario, likely for a holiday such as Halloween.

General Impression:

The scene has a playful and somewhat whimsical feel, likely related to a Halloween theme. The negative effect gives the image a surreal, almost ghostly quality.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This black-and-white photograph depicts a scene that appears to be from Halloween. In the foreground, there are two figures. One is an adult dressed in a costume resembling a witch, complete with a pointed hat and a checkered dress. The adult is seated on a chair, and their face is obscured by a mask that looks like a pumpkin with exaggerated features.

Next to the adult is a young child, also dressed in a costume. The child is wearing a dark outfit and a mask that covers their entire face. The child appears to be standing and leaning slightly towards the adult.

The background of the image shows a room with vintage furnishings, including a fireplace with tools, a small table with books, a potted plant, and a cabinet with framed pictures on top. The room has a cozy, old-fashioned feel, with patterned flooring and draped curtains. The overall atmosphere suggests a festive, Halloween-themed setting.

Text analysis

Amazon

8582

Google

8582 8582
8582