Human Generated Data

Title

Untitled (girl with jack-o-lantern man, Pennsylvania)

Date

1938, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.249

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (girl with jack-o-lantern man, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.249

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.4
Clothing 96.9
Apparel 96.9
Toy 66.8
Footwear 60.5
Chair 58.5
Furniture 58.5

Clarifai
created on 2023-10-25

people 100
child 99.9
son 98.6
portrait 98.4
boy 98.1
room 97.1
chair 97
two 96.3
nostalgia 95.6
baby 95.2
monochrome 94
school 93.6
nostalgic 93.2
lid 92.9
one 92.3
education 91.7
furniture 91.6
group 90.6
art 90.5
three 90.3

Imagga
created on 2022-01-08

musical instrument 32.7
adult 29.1
person 28.6
people 26.2
accordion 23.2
shop 23.1
home 23.1
happy 21.9
salon 21
fashion 20.4
keyboard instrument 18.9
smiling 18.8
cheerful 18.7
interior 17.7
portrait 17.5
women 17.4
happiness 17.2
wind instrument 16.7
indoors 16.7
family 16
child 16
cute 15.8
smile 15.7
clothing 15.2
one 14.9
blond 14.9
mother 14.7
lady 14.6
sexy 14.5
man 14.1
attractive 14
youth 13.6
casual 13.6
style 13.4
black 13.3
holding 13.2
room 13.1
lifestyle 13
dress 12.6
kid 12.4
barbershop 12.4
chair 12.2
clothes 12.2
looking 12
indoor 11.9
joy 11.7
kitchen 11.6
urban 11.4
hair 11.1
shopping 11
model 10.9
male 10.7
human 10.5
boy 10.4
device 10.3
mercantile establishment 10.2
parent 10.1
house 10
girls 10
face 9.9
posing 9.8
fun 9.7
brunette 9.6
standing 9.6
store 9.4
inside 9.2
pretty 9.1
little 8.8
outfit 8.7
sitting 8.6
barber chair 8.5
sale 8.3
stylish 8.1
childhood 8.1
bag 8
shopper 7.9
together 7.9
son 7.8
mall 7.8
two 7.6
retail 7.6
elegance 7.6
teenager 7.3
domestic 7.3
life 7.2
modern 7

Google
created on 2022-01-08

Table 88.5
Hat 86.4
Picture frame 84
Chair 81.3
Sun hat 77.7
Vintage clothing 75.5
Monochrome 69.4
Room 69.3
Monochrome photography 67.4
Art 67.1
Classic 64.8
Stock photography 63.6
Sitting 62.2
Retro style 57.6
Visual arts 53.3
Toddler 52.9
House 52.4
Child 52
Curtain 51.9
Rectangle 51.6

Microsoft
created on 2022-01-08

wall 97.3
text 97.1
indoor 91.8
furniture 81
clothing 79.4
person 68.1
piano 67.7
old 65
child 57.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 99.7%
Happy 99.8%
Fear 0%
Surprised 0%
Calm 0%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe

Clarifai

Footwear
Girl
Human face
Clothing
Dress
Picture frame
Human hair
Furniture
Human leg
Chair

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 94.4%

AWS Rekognition

Shoe 60.5%

Clarifai

Footwear 89.7%

Clarifai

Footwear 86%

Clarifai

Footwear 68.7%

Clarifai

Footwear 48.2%

Clarifai

Footwear 35.8%

Clarifai

Footwear 34.1%

Clarifai

Footwear 33.2%

Clarifai

Girl 67.8%

Clarifai

Human face 61.8%

Clarifai

Human face 57.1%

Clarifai

Clothing 58.9%

Clarifai

Dress 54.1%

Clarifai

Picture frame 52.1%

Clarifai

Picture frame 52.1%

Clarifai

Human hair 45.8%

Clarifai

Furniture 44.7%

Clarifai

Human leg 35.3%

Clarifai

Chair 34.8%

Categories

Imagga
created on 2022-01-08

paintings art 93.3%
people portraits 4.7%
interior objects 1.1%

Captions

Microsoft
created by unknown on 2022-01-08

a vintage photo of a person 90.8%
a vintage photo of a person in a room 90.7%
an old photo of a person 89%

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

person in the living room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a man in a witch costume sitting on a chair

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image shows a room with vintage furnishings and decor. A figure dressed in a checkered overcoat and gloves, wearing a jack-o'-lantern head topped with a witch's hat, is seated on a chair. The background includes bookshelves, framed artwork, curtains, and a side table with decorative items, such as a vase with flowers. The scene evokes a playful or whimsical atmosphere, possibly related to Halloween.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a vintage black-and-white scene in a room with a warm, domestic atmosphere. A figure is seated in a chair wearing a checkered coat, gloves, and a large, pointed hat. The figure's head is a carved pumpkin, giving it a whimsical and Halloween-themed appearance. The pumpkin has a carved smile and eyes, and it wears the witch's hat. Next to the seated figure is a small child, dressed in a patterned dress, sitting on a small chair or a rocking chair and appearing to be interacting with the figure. The setting includes furniture such as a shelf with books, a few framed pictures on the wall, and decorative drapery, contributing to the cozy interior. There is also a small side table with books and a large vase with flowers near the chair. The room appears to be a living room or a study, creating an intriguing contrast between the everyday domestic setting and the whimsical, Halloween-themed character.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a young child, likely a girl, sitting in a chair and interacting with a large, costumed figure that appears to be a pumpkin-headed character wearing a hat and checkered clothing. The scene is set in what seems to be a home interior, with bookshelves, framed artwork, and other furnishings visible in the background. The image has a vintage, black and white aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a vintage black and white photograph that appears to be from around the 1950s or earlier. It shows a Halloween scene with a child in a dress looking at what appears to be a homemade witch decoration or display. The witch is wearing a black hat and checkered dress. The setting is inside a home, with a small table or stand visible, some books on shelves, and decorative items or figurines on display. The interior has the typical styling of a mid-century American home, with simple wall treatments and traditional furniture. The photograph has that classic grainy quality characteristic of period photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a young girl sitting on a chair, facing a large pumpkin head with a witch's hat and coat. The girl is wearing a dress and has short hair. She is holding a small object in her hands.

The background of the image shows a room with a fireplace, a table, and a bookshelf. There are also some pictures on the wall. The overall atmosphere of the image suggests that it was taken during Halloween or another festive occasion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a black and white photograph of a young child sitting in a rocking chair, looking up at a large pumpkin-headed figure. The child is wearing a dress and has short hair. The pumpkin-headed figure is wearing a long coat and a pointed hat, and is sitting in a chair next to the child. The background of the image appears to be a living room, with a fireplace, bookshelves, and a table with a vase of flowers on it. The overall atmosphere of the image suggests that it may be a Halloween-themed photograph, given the presence of the pumpkin-headed figure and the autumnal decorations in the background.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo shows a child sitting on a chair, looking up at the person in front of her. The person is wearing a hat, a coat, and leather shoes. The child is wearing a dress and leather shoes. Behind the person is a shelf with books on it. There is a vase with flowers on the left side. The photo has a white border.

Created by amazon.nova-lite-v1:0 on 2025-06-02

A black-and-white photo shows a young girl sitting on a chair next to a person wearing a Halloween costume. The person is wearing a pumpkin head, a black hat, a coat, gloves, and shoes. The girl is wearing a dress and socks. Behind them, there is a shelf with books and other items, and a vase with flowers. On the left, there is a fireplace with a broom and a dustpan.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-06

Here's a description of the image:

This black and white photograph captures a charming and slightly eerie Halloween scene. The central focus is a scarecrow-like figure seated in a chair. This "scarecrow" has a carved pumpkin for a head, complete with a pointed black witch's hat. It's dressed in a checkered coat and appears to be wearing gloves, giving it a humanoid appearance.

Sitting beside the scarecrow is a young girl, presumably a child. She is dressed in a patterned dress and seated on a rocking chair, looking up at the pumpkin-headed figure with a look of fascination or perhaps amusement.

The scene is set in a domestic interior, likely a living room. Behind the scarecrow, a bookcase is visible. Other details like curtains, a small side table, and decorative artwork on the wall enhance the classic, vintage aesthetic of the image. The overall mood is lighthearted and suggests a playful Halloween celebration from a bygone era.

Created by gemini-2.0-flash on 2025-05-06

Here's a description of the image:

This black and white photograph shows a young girl interacting with a life-size Halloween decoration. The decoration is a figure with a carved pumpkin for a head, topped with a witch's hat. The pumpkin has a simple, slightly sinister face carved into it. The figure is dressed in a large, houndstooth patterned coat, gloves, and shoes. It sits in a wooden chair next to a bookshelf or cabinet filled with books and what appears to be a vintage radio.

The young girl, with short hair, is sitting in a small rocking chair facing the pumpkin figure. She is wearing a patterned dress and looks up at the figure with a slight smile.

The scene is set in what appears to be a living room. There's a doorway on the left, flanked by a stand holding fire tools. A decorative table and curtains add to the room's traditional feel. Above the bookshelf, there are two framed pictures on the wall. The lighting in the photo is soft, creating a cozy and slightly nostalgic atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph depicting an indoor scene with a Halloween theme. In the foreground, there is a child sitting on a small chair, facing and seemingly interacting with a life-sized scarecrow figure. The scarecrow is dressed in a checkered outfit, complete with a hat, and has a pumpkin for a head, giving it a festive Halloween appearance.

The room appears to be a living area with a stone fireplace in the background. Above the fireplace, there is a mantel adorned with a few decorative items, including a vase with flowers. To the left of the fireplace, there is a small table with what looks like a set of books or a stack of items. The walls are decorated with a few framed pictures.

The overall ambiance of the image suggests a cozy, domestic setting with a touch of whimsy and holiday spirit, capturing a moment of curiosity or playfulness between the child and the scarecrow figure.

Qwen

No captions written