Human Generated Data

Title

Untitled (Greenwich Village, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3654

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Greenwich Village, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3654

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Brick 99.9
Face 99.5
Head 99.5
Photography 99.5
Portrait 99.5
Sitting 98.2
Clothing 97.7
Pants 97.7
Reading 94
Door 92.2
Electronics 70.9
Phone 70.9
Indoors 66.7
Restaurant 66.7
Alcohol 60.7
Beverage 60.7
Accessories 57.5
Glasses 57.5
Blouse 57
City 57
Window 56.8
Urban 56.4
Cream 56.2
Dessert 56.2
Food 56.2
Ice Cream 56.2
Mobile Phone 56.2
Bag 56.2
Handbag 56.2
Home Decor 55.9
Linen 55.9
Beer 55.8
Bottle 55.8
Liquor 55.8
Body Part 55.7
Finger 55.7
Hand 55.7
Shirt 55.5
Computer 55.4
Wine 55.2
Diner 55.1
Text 55.1

Clarifai
created on 2018-05-10

people 99.8
adult 97.5
street 96.2
man 96.1
woman 95.5
monochrome 94.7
one 94.3
two 94.2
portrait 91.5
group 91.5
wear 90.3
child 90.1
administration 86.2
leader 84.9
room 84.1
window 83.6
indoors 83.4
music 81.8
sit 80
facial expression 79.8

Imagga
created on 2023-10-05

kin 47.9
world 31
groom 29.1
man 24.9
people 21.8
male 18.6
person 18.2
bride 16.3
adult 15.7
portrait 14.9
silhouette 14.1
couple 13.9
wedding 13.8
love 13.4
black 13.3
dress 12.6
happiness 11.8
statue 11.4
bouquet 11.3
sax 10.7
men 10.3
culture 10.3
mother 10.2
outdoor 9.9
art 9.8
human 9.7
business 9.7
businessman 9.7
building 9.6
bow tie 9.4
architecture 9.4
youth 9.4
old 9.1
romance 8.9
family 8.9
happy 8.8
sepia 8.7
wind instrument 8.7
historical 8.5
attractive 8.4
fashion 8.3
vintage 8.3
park 8.2
romantic 8
body 8
ancient 7.8
bridal 7.8
married 7.7
sculpture 7.6
two 7.6
head 7.6
traditional 7.5
monument 7.5
future 7.4
life 7.4
dirty 7.2
celebration 7.2
smile 7.1
women 7.1
posing 7.1
summer 7.1
room 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

window 88.8

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 26-36
Gender Male, 98.1%
Calm 97.8%
Surprised 6.3%
Fear 6.2%
Sad 2.3%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 78.1%
Calm 95.5%
Surprised 7.4%
Fear 5.9%
Sad 2.7%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man

Clarifai

Clothing
Human face
House
Window
Human hair
Human leg
Human arm

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Man 99.4%

Clarifai

Clothing 95.7%

Clarifai

Clothing 90.2%

Clarifai

Human face 77.4%

Clarifai

Human face 75.6%

Clarifai

House 50.7%

Clarifai

Window 40.6%

Clarifai

Human hair 38.7%

Clarifai

Human leg 36.3%

Clarifai

Human arm 34.2%

Categories

Imagga
created on 2023-10-05

paintings art 95.5%
streetview architecture 3.4%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man and woman sitting on a bench

Created by general-english-image-caption-blip-2 on 2025-07-06

a man and a woman sitting on a bench

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image is presented in a negative format, showing two individuals sitting on the steps outside a building. One person is wearing a patterned outfit with a light tone, while the other is dressed in a darker shirt and light-colored pants. The background features a brick wall, a door with panels, and signage visible on the left and right sides, including advertisements and notices. The overall scene gives an urban, vintage atmosphere with sharp contrasts typical of negative photography.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a negative photograph depicting two people seated on a doorstep. The setting appears to be in an urban environment, as suggested by the brick wall that surrounds the doorway. On the left side of the image, there is a store display window with various products and a sign reading "Radio Repairs." The person on the left is wearing a patterned dress and the one on the right is wearing light-colored trousers and a dark shirt. The background includes posters or signage with text partially visible.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows two people sitting on a bench outside a building. The building appears to be made of brick and has a wooden door. The people are dressed in clothing from an earlier era, with the person on the left wearing a patterned dress and the person on the right wearing a dark jacket. The image has a sepia tone, giving it an old-fashioned, vintage feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a vintage black and white photograph, likely from the mid-20th century. Two people are sitting together on what looks like a porch or storefront step. One person is wearing a patterned dress while the other is in darker, simpler clothing. The setting has a brick wall background with some signage visible, though not clearly legible in the image. The photograph has a nostalgic, candid quality to it, capturing what seems to be a casual moment of conversation or relaxation. The lighting creates interesting shadows and gives the image a warm, sepia-like tone despite being black and white.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts two men sitting on a step in front of a door, with the man on the left wearing a patterned shirt and the man on the right wearing a dark-colored shirt. The background features a brick wall with a door and a window to the left, as well as a sign to the right that reads "TURKISH MUSIC" in white letters on a black background. The overall atmosphere suggests a casual, relaxed setting, possibly in a residential or commercial area. The image appears to be a photograph taken in a natural light setting, with no visible signs of editing or manipulation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a man and woman sitting on the steps of a building, with the man positioned on the right side and the woman on the left. The man is dressed in a black shirt and khaki pants, while the woman wears a patterned dress. Both individuals are engaged in using their cell phones.

In the background, a door is visible behind them, accompanied by a window to the left that features a sign with illegible text. The overall atmosphere of the image suggests that the couple is taking a break or waiting for something, as they sit comfortably on the steps and focus on their phones.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of two people sitting on the steps of a building. The man on the right is wearing a dark shirt and pants, and he is holding a cigarette in his hand. The woman on the left is wearing a dress and is looking at something in front of her. Behind them is a door with a sign that reads "TU MU JAC." The building has a brick wall and a window with a sign that reads "REPAIRING."

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white image depicts two people sitting on the steps of a building. The woman is sitting on the left, while the man is sitting on the right. They are both looking at something in front of them. The woman is wearing a dress, while the man is wearing a polo shirt, pants, and shoes. Behind them is a brick wall with a wooden door. On the right, there is a poster.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here's a description of the image:

The image is a black and white or sepia-toned photograph, seemingly taken with an older camera. It shows two people sitting on the steps in front of a building. The photograph has a vintage feel, possibly due to the film quality or processing techniques.

One person is a woman wearing a patterned dress. She is seated on the left side of the frame. The other is a man wearing a darker shirt and lighter pants. He is seated on the right side of the frame. Both are looking down or towards their hands.

Behind them is a door flanked by brick walls. To the left, there's a window with what appears to be display advertisements or signs. To the right of the door, there's a poster with text. The scene is generally quite still, capturing a quiet moment.

Created by gemini-2.0-flash-lite on 2025-05-08

Certainly! Here's a description of the image:

Overall Impression:

The image has a vintage, somewhat gritty feel, likely due to the black and white conversion. The contrast is high, and the details have a soft focus. It appears to be a candid snapshot or possibly a posed portrait.

Subject and Setting:

Two people are the central focus, seated on what appears to be a stoop or steps in front of a building. The building has a prominent wooden door, a brick wall section, and potentially some signage to the left. The scene seems to be illuminated by soft natural light or possibly an artificial light source.

People:

  • Person 1 (Left): Appears to be a woman. She is wearing a dress with a geometric pattern.
  • Person 2 (Right): Appears to be a man wearing a dark shirt and light-colored pants. He has short hair and is holding something in his hands.

Other Details:

  • The door has a simple paneled design.
  • There's a sign or some form of advertisement/text to the right of the door.
  • To the left, there's a window or a storefront with signs. Based on the crops, it may be a "Radio Repairing" shop.

Overall Mood:

The image evokes a sense of quiet observation, with the subjects seemingly relaxed, perhaps in a moment of respite. The vintage style gives it a timeless feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The sepia-toned image depicts two people sitting on a ledge or step outside a building. The building appears to be constructed of brick, and the scene has a vintage or retro feel, likely from the mid-20th century.

The person on the left is wearing a light-colored, patterned dress and has short, light-colored hair. They are looking downward, possibly at something in their hands or lap. The person on the right is dressed in a dark shirt and light-colored pants, and they are smiling, looking towards the camera.

In the background, there is a window with some posters or signs visible, one of which appears to have the word "SPECIAL" at the top. There is also a sign that says "Radio Repairs" and another sign with the number "4" and the words "TUNE UP" and "MUSIC." The overall atmosphere of the image suggests a casual, relaxed moment captured in time.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a sepia-toned photograph of two individuals sitting on the ledge of a doorway. Both individuals are wearing masks that appear to be made of paper or a similar material and have a textured, almost three-dimensional look. The individual on the left is wearing a patterned dress, while the individual on the right is dressed in a dark shirt and light-colored pants. The setting appears to be an urban environment, with a brick wall and a wooden door in the background. There is a sign on the left side of the frame, although the text on it is not fully legible. The overall mood of the image is somewhat eerie due to the masks and the sepia tone.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This sepia-toned photograph captures two individuals sitting on a step in front of a wooden door with a brick wall on either side. The person on the left is dressed in a patterned shirt and appears to be holding something in their hands, while the person on the right is dressed in a darker shirt and pants, also holding an object. The image has a vintage aesthetic, with signs in the background indicating "Radio Repairing" and "Tun穆Jac." The overall mood of the photograph is somewhat mysterious and intriguing, possibly due to the sepia tone and the somewhat obscured faces of the individuals.

Text analysis

Amazon

Radio
MU
TU
Repairing
JAC
4
SPECIAL
FREE
GR
UL
SPECIAL Program
V
AL
CURRENT
SICN
seen
Program
ALWINGS

Google

TU MU JAC
TU
MU
JAC