Human Generated Data

Title

Untitled (Fifteenth Street or Bethune Street, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2890

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fifteenth Street or Bethune Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2890

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Brick 100
Clothing 100
Shirt 100
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Accessories 97.8
Formal Wear 97.8
Tie 97.8
Architecture 93.3
Building 93.3
Wall 93.3
Pants 69.5
Housing 63.3
Door 57.3
Standing 55.9
Blouse 55.7
Handrail 55.3
House 55.2
Dress Shirt 55.1

Clarifai
created on 2018-05-10

people 99.9
adult 98.8
one 98.4
man 96.1
portrait 94.7
wear 93.4
leader 89
wall 87.6
elderly 86.8
administration 86.6
two 86.2
woman 81.6
room 79.1
music 77.9
facial expression 77.5
retro 77.1
actor 77
furniture 75.8
street 75.1
home 74.9

Imagga
created on 2023-10-06

newspaper 39.1
man 29.6
product 29.3
person 25.3
male 24.9
creation 23.8
people 21.8
adult 17.6
office 17.1
old 16.7
businessman 15.9
business 15.8
professional 13.8
portrait 13.6
senior 13.1
room 12.3
corporate 12
black 12
casual 11.9
aged 11.8
worker 11.7
memorial 11.4
home 10.4
men 10.3
happiness 10.2
family 9.8
elderly 9.6
lifestyle 9.4
statue 9.3
alone 9.1
structure 9.1
building 9
outdoors 9
lady 8.9
handsome 8.9
couple 8.7
day 8.6
serious 8.6
brass 8.4
vintage 8.3
student 8.1
happy 8.1
looking 8
working 8
women 7.9
work 7.8
education 7.8
sitting 7.7
world 7.7
mother 7.6
executive 7.6
businesspeople 7.6
school 7.5
human 7.5
one 7.5
future 7.4
mature 7.4
symbol 7.4
teacher 7.4
camera 7.4
success 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

building 99.7
brick 98.2
outdoor 95.2
man 92.6
standing 82.4

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 35-43
Gender Male, 98.4%
Sad 79%
Calm 51.4%
Surprised 6.9%
Confused 6.8%
Fear 6.4%
Happy 1.5%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Calm 76.1%
Sad 9.8%
Surprised 7%
Fear 6.6%
Confused 3.9%
Angry 3.6%
Disgusted 1.1%
Happy 1%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man

Clarifai

Man
Clothing
Human face
House
Human arm

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.1%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Man 99.4%

Clarifai

Man 95.5%

Clarifai

Clothing 81.7%

Clarifai

Human face 58.8%

Clarifai

Human face 50.7%

Clarifai

House 49.6%

Clarifai

Human arm 43.4%

Categories

Imagga
created on 2023-10-06

people portraits 47.6%
streetview architecture 34.7%
text visuals 8.1%
paintings art 6.9%
events parties 1.5%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a man standing in front of a brick building

Created by general-english-image-caption-blip-2 on 2025-07-06

an old black and white photo of a man standing in front of a brick building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows a man standing in a doorway, dressed in casual clothing including a light-colored shirt tucked into dark pants. His posture suggests his hands are resting on his hips. The building features a brick wall on one side and a railing in front of the entrance. Another individual wearing a patterned dress is partially visible behind him in the doorway. The setting appears to be a residential or urban area, given the architectural details and ironwork near the entrance.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a man standing in a doorway of a brick building. He is wearing a light-colored short-sleeve shirt and dark pants, which have a high waist and are secured with a belt. His arms are positioned at his sides, with his hands resting on his hips. There is a partially visible person, possibly a woman, standing behind him who is wearing a patterned dress. To the left and right of the doorway, there are wrought-iron railings and intricately laid brickwork. The overall scene suggests a setting in an urban or residential area, with architectural features typical of mid-20th century constructions.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows an older man standing in a doorway. He appears to be middle-aged or older, with a stocky build and a serious expression on his face. He is wearing a white shirt and dark pants, and is standing in a brick doorway with a wooden frame. The background suggests an outdoor setting, possibly a building or structure. The image is in black and white, giving it a vintage or historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, possibly the early-to-mid 20th century. The image shows a person standing in a doorway of a brick building. They are wearing a light-colored shirt with rolled-up sleeves and dark pants. Their posture is casual, with one hand on their hip. The building has a classic brick facade and what appears to be an iron railing visible at the bottom of the frame. The composition and style of the photograph has a documentary or candid quality typical of that time period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of a man standing in the doorway of a brick building. The man is wearing a white shirt with rolled-up sleeves and dark pants, and he has his hands on his hips. He appears to be looking to the right side of the image.

Behind the man, there is a woman partially visible in the doorway. She is wearing a checkered dress and appears to be looking at the man.

To the left of the doorway, there is a section of brick wall with a small metal fence or railing in front of it. To the right of the doorway, there is another section of brick wall with a larger metal fence or railing in front of it.

The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s. The style of the clothing and the architecture of the building are consistent with this time period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of a man standing in the doorway of a brick building, with a woman partially visible behind him. The man is wearing a white, short-sleeved button-down shirt and dark pants, with his left hand resting on his hip and a cigarette in his right hand. He has short hair and appears to be looking to his right.

Behind him, a woman is partially visible, wearing a checkered dress and standing with her hands at her sides. The background of the image features a brick wall and a metal railing, suggesting that the scene is set in an urban or industrial area. The overall atmosphere of the image is one of quiet contemplation, with the man and woman appearing lost in thought as they stand in the doorway.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

The image is in black and white. It features a man standing outside a building, possibly a house, with his hands on his hips. He is wearing a white shirt and pants. Behind him, there is a woman standing in the doorway of the building. She is wearing a dress and has her hair tied back. The building has a brick wall and a wooden door. There is a railing on the left side of the image.

Created by amazon.nova-lite-v1:0 on 2025-05-30

The black-and-white photo shows a man standing outside a house, possibly posing for a photo. He is standing in front of a brick wall, with his hands on his waist and a serious expression on his face. Behind him is a woman standing in the doorway, with her hands on her hips. The doorway is partially open, and the sunlight is shining on the man and the woman.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-05

Here is a description of the image:

This is a vintage black and white photograph of a man standing in a doorway. He appears to be the primary subject. The man is stout, with short, neatly combed hair. He is wearing a light-colored, long-sleeved shirt, partially unbuttoned and a dark apron or a similar garment. The man stands with his hands on his hips, and seems to be looking slightly off to the side, with a somber expression on his face.

Behind the man, partially obscured within the doorway, is a woman. She is wearing a light-colored dress with a pattern and is standing partially behind the man.

The doorway is set into a brick building. The brickwork is a prominent feature of the composition, with the brickwork on both sides of the doorway. A wrought iron railing is visible on the right, adding a touch of decorative detail. There's a guttering pipe to the left of the door. The overall composition of the image suggests a moment captured in time, possibly taken in a residential setting.

Created by gemini-2.0-flash on 2025-06-05

Here is a description of the image:

The black and white photo shows a man standing in a doorway, looking off to the side. He has short hair and is wearing a light-colored shirt and dark apron. He has his hands on his hips. Behind him and slightly to his right is a woman in a dress. The building has a brick facade. A small fence is visible near the bottom of the frame. The doorframe is dark.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring two individuals standing in a doorway of a brick building. The person in the foreground is an older man with short, light-colored hair. He is wearing a light-colored, short-sleeved shirt and dark pants, and he has one hand on his hip while the other hand rests on the doorframe. He appears to be looking slightly off to the side with a neutral expression.

Behind him, partially obscured by the doorway, is a younger individual. This person is wearing a patterned shirt or dress and is standing slightly to the right of the older man. The doorway is framed by brick walls, and there is a wrought-iron railing visible to the right of the doorway. The overall setting suggests a residential or urban environment. The photograph appears to be candid, capturing a casual moment between the two individuals.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image is a black-and-white photograph showing a man standing on the porch of a brick building. He is wearing a short-sleeved shirt and dark pants. The man has a contemplative or relaxed posture, with his hands resting on his hips. The porch has a metal railing, and there is another person partially visible behind the man, partially obscured by the building's structure. The brickwork of the building is clearly visible, and the overall tone of the photograph suggests an older style or vintage quality.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This black-and-white photograph features a man standing in a doorway of a brick building. He is wearing a light-colored, short-sleeved button-up shirt and dark pants. His left arm is resting on a black metal railing, and his right arm is bent at the elbow. The man appears to be looking slightly to his left. The brick wall and the doorway frame the man, and there is another person partially visible behind him, but their features are not clear. The overall composition suggests a casual, candid moment captured in an urban setting.