Human Generated Data

Title

Untitled (New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2999

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2999

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 98.8
Human 98.8
Apparel 98.7
Clothing 98.7
Female 86.9
Dress 74.8
Woman 74.2
Footwear 70.1
Shoe 70.1
Home Decor 69.7
Face 64.6
Girl 61.4
Blonde 61.4
Child 61.4
Teen 61.4
Kid 61.4
Senior Citizen 56

Clarifai
created on 2018-03-23

people 100
one 99.9
adult 99.1
portrait 98.8
wear 98.1
child 95.7
two 92.7
woman 91.5
elderly 89.5
man 89.3
administration 87.9
veil 87.2
actor 85.1
facial expression 83.9
music 83.5
sit 79.6
outfit 75.3
home 74.9
street 72.1
writer 71.8

Imagga
created on 2018-03-23

grandma 47.8
portrait 27.2
senior 25.3
person 24.7
adult 24.2
old 23.7
people 23.4
mother 22.8
rustic 18.5
happy 17.5
retired 17.4
man 16.8
mature 16.7
hair 16.6
lifestyle 16.6
elderly 16.3
parent 16.2
male 14.9
retirement 14.4
home 14.4
lady 13.8
face 13.5
couple 13.1
statue 12.9
fashion 12.8
smile 12.1
looking 12
attractive 11.9
model 11.7
older 11.6
human 11.2
sexy 11.2
one 11.2
holding 10.7
style 10.4
love 10.3
child 10.2
happiness 10.2
pretty 9.8
black 9.8
elegant 9.4
blond 9.4
sculpture 9.1
world 8.9
body 8.8
ancient 8.6
daughter 8.4
elegance 8.4
camera 8.3
alone 8.2
outdoors 8.2
pensioner 8.2
sensuality 8.2
aged 8.1
dress 8.1
posing 8
smiling 8
grandmother 7.8
hands 7.8
culture 7.7
head 7.6
fun 7.5
vintage 7.4
gray 7.2
romantic 7.1
women 7.1
art 7.1
together 7

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

outdoor 98.3
person 90.2
old 74.8
curb 7.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 57-77
Gender Male, 88.1%
Sad 8.7%
Surprised 5.7%
Confused 9%
Happy 2.1%
Calm 20.8%
Disgusted 40.5%
Angry 13.1%

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Person 98.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-11

a photograph of a woman sitting on a step up to a door -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows an elderly figure sitting on the steps of a building. The person is wearing a patterned dress with a floral design and simple, closed-toe shoes. The figure has a hunched posture, resting their hands on their lap. The surrounding environment includes the edge of a doorway and part of a cylindrical architectural column, indicating the setting is likely an urban building entrance. The photo appears to be monochromatic, giving it a vintage feel.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows an elderly woman sitting on a step, possibly the threshold of a building. She is wearing a patterned dress with small white flowers and has light-colored hair. Her hands are clasped together in front of her, resting on her lap. She is wearing dark, sensible shoes, and the environment suggests a setting outside a residence, with a visible part of a doorframe and a column next to the steps. The image has a sepia tone, typical of older photographs.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image shows a woman sitting on a stoop or steps, looking off to the side. She is wearing a patterned dress or coat and appears to be in a contemplative or pensive pose. The background appears to be an older building or structure, creating a vintage, moody atmosphere for the scene. Overall, the image conveys a sense of solitude and introspection.

Created by claude-3-opus-20240229 on 2024-12-31

The black and white image shows an elderly woman sitting on the steps of a building, looking down contemplatively. She is wearing a patterned dress or robe and appears to have her hands clasped in her lap. The surroundings suggest an older architectural style, with the woman posed next to what looks like a large metal or stone container or structure. The lighting creates shadows that add to the pensive, somber mood of the portrait-style photograph capturing a quiet, reflective moment.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This is a vintage black and white photograph showing someone sitting on what appears to be a doorstep or stoop. They are wearing a polka dot dress and simple shoes, with their hands clasped in their lap. The image has the casual, candid quality of a street photograph from perhaps the 1930s or 1940s. The setting appears urban, with part of a building's exterior wall or column visible on the right side of the frame. The photograph has the slightly grainy, soft quality characteristic of period photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black and white photograph of an elderly woman sitting on a step in front of a doorway. The woman is wearing a long dress with a floral pattern, and her hair is styled in a short, curly bob. She has her hands clasped together in her lap and appears to be looking down. The background of the image shows a dark doorway and a wall with a column on the right side. The overall atmosphere of the image suggests that the woman is sitting alone, possibly waiting for someone or lost in thought.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of an elderly woman sitting on the steps of a building. The woman has short, curly hair and is wearing a dress with a white background and black polka dots, along with dark shoes. She is seated on the bottom step, with her legs crossed and her hands clasped together in front of her. The background of the image features a dark doorway behind the woman, with a column to her right. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of an elderly woman sitting on the steps of a building. She is wearing a polka-dot dress and has her hands clasped together in her lap. She is looking off to the side, perhaps lost in thought. The building behind her has a wooden door and a stone pillar on the right side. The image appears to be taken in the past, possibly in the 1920s or 1930s, based on the style of the woman's clothing and the architecture of the building.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of a woman sitting on a step. She is wearing a dress with a floral pattern. She is sitting on a step with her hands clasped together and her head slightly tilted to the side. The woman's expression appears to be one of contemplation or sadness. The background of the image is a building with a door and a window.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

This is a vintage black and white photograph of a woman sitting on the steps of a building. She is seated on the top step, facing slightly to the left, with her legs extending down to the second step. Her hands are clasped together in her lap. She has short, wavy hair. She is wearing a knee-length dress with a light-colored polka dot pattern. Her shoes are simple and dark.

Behind her, there is a dark doorway, suggesting she is sitting in front of a building's entrance. To the right, a section of the building's facade is visible, including a column. The overall impression is one of simplicity and stillness. The aged quality of the photo contributes to its vintage and somewhat somber feel.

Created by gemini-2.0-flash-lite on 2025-06-05

Here's a description of the image:

The image is a sepia-toned photograph of an older woman sitting on the steps of a building. She is wearing a patterned dress with small white polka dots against a darker background. Her hands are clasped together in front of her. Her hair is short, curly, and light-colored. She appears to be looking off to the side with a somewhat somber expression.

The setting appears to be a doorway or entrance. The background includes a dark doorway to her left and a portion of a rounded pillar or building facade to her right. The steps she is sitting on are made of stone or concrete, and the image has a vintage, slightly grainy quality. The lighting suggests the photo was taken outdoors.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph of an elderly woman sitting on the steps of a building. She appears to be wearing a patterned dress, possibly floral, with long sleeves and a high neckline. Her hair is short and curly. She is seated with her hands clasped together on her lap, and she is wearing dark shoes. The background includes part of a doorway and a cylindrical structure, which might be a column or a post. The photograph has a vintage feel, possibly indicating it was taken several decades ago. The woman's expression and posture suggest a moment of quiet contemplation or rest.