Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2872

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2872

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Bench 99.5
Furniture 99.5
People 99.3
Clothing 80.4
Footwear 80.4
Accessories 79.7
Formal Wear 79.7
Suit 73.3
Face 68.7
Head 68.7
Smoke 63.6
Architecture 61.8
Building 61.8
Wall 61.8
Dugout 55.8
Sport 55.8
Sitting 55.4
Baseball 55.3
Baseball Glove 55.3
Glove 55.3
Hat 55.1

Clarifai
created on 2018-05-10

people 100
group together 99.4
group 98.9
adult 98.9
many 98.7
man 95.8
vehicle 94.3
leader 93.6
administration 93.4
watercraft 91.7
military 90.5
transportation system 90.3
two 90.2
wear 89.1
three 88.3
several 87.1
war 87
child 86.9
uniform 83.6
woman 83.5

Imagga
created on 2023-10-07

bench 30.3
man 23.5
people 18.4
male 17.2
handcart 16.8
wheeled vehicle 16
barrow 16
person 15.6
black 15
couple 14.8
park bench 14.6
outdoor 14.5
park 14
lifestyle 13.7
outdoors 13.7
seat 13.4
percussion instrument 13
adult 12.7
tree 12.3
musical instrument 11.7
snow 11.6
sitting 11.2
landscape 11.2
building 10.6
old 10.4
room 10.4
men 10.3
water 10
working 9.7
women 9.5
work 9.5
vehicle 9.3
alone 9.1
chair 9.1
holding 9.1
together 8.8
classroom 8.7
grunge 8.5
winter 8.5
portrait 8.4
sky 8.3
teenager 8.2
happy 8.1
child 8.1
business 7.9
love 7.9
day 7.8
standing 7.8
school 7.8
color 7.8
cold 7.7
friends 7.5
friendship 7.5
style 7.4
furniture 7.4
light 7.3
teen 7.3
danger 7.3
group 7.3
dirty 7.2
copy space 7.2
home 7.2
marimba 7.2
rural 7
season 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 92.4
old 60.9

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 83%
Happy 7.5%
Surprised 6.7%
Fear 6%
Sad 4.1%
Angry 1.5%
Disgusted 1.1%
Confused 1%

AWS Rekognition

Age 43-51
Gender Male, 99.2%
Calm 87.1%
Sad 8%
Surprised 6.4%
Fear 5.9%
Happy 1.8%
Confused 0.4%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 61-71
Gender Male, 99.9%
Calm 98.7%
Surprised 6.3%
Fear 6%
Sad 2.4%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 44
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Chair
Shoe
Tie
Coat

Clarifai

Man
Footwear
Human face
Human arm
Human leg

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 99%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 99%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 99%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99%

AWS Rekognition

Chair 81.7%

AWS Rekognition

Shoe 80.4%

AWS Rekognition

Shoe 79%

AWS Rekognition

Shoe 79%

AWS Rekognition

Shoe 70.9%

AWS Rekognition

Shoe 58.2%

AWS Rekognition

Tie 79.7%

AWS Rekognition

Tie 65.9%

AWS Rekognition

Coat 79.3%

Clarifai

Man 95.3%

Clarifai

Man 92.2%

Clarifai

Man 87.6%

Clarifai

Footwear 78%

Clarifai

Footwear 73.5%

Clarifai

Footwear 73.2%

Clarifai

Footwear 66.2%

Clarifai

Footwear 55.7%

Clarifai

Footwear 40.4%

Clarifai

Footwear 38.2%

Clarifai

Human face 41.9%

Clarifai

Human arm 35.6%

Clarifai

Human arm 34.9%

Clarifai

Human leg 35.1%

Categories

Imagga
created on 2023-10-07

paintings art 90.3%
streetview architecture 6.1%
text visuals 1.6%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a group of men sitting on a bench in a row

Created by general-english-image-caption-blip-2 on 2025-07-06

three men sitting on a bench in front of a wall

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This black-and-white image depicts three men sitting or standing near a worn wall in an outdoor setting. The man on the far left is standing, dressed in a suit and hat. In the center, a man is sitting in a chair and appears relaxed, with his arms crossed. On the right, another seated man holds an object and wears a shirt and tie. A scattered newspaper lies on the floor near the chairs, and an additional folding stool is seen on the right side of the frame. The backdrop includes a textured wall and hints of a distant landscape or building. The scene conveys a casual or contemplative moment in a vintage era.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts three men positioned against a textured wall. The man on the left is standing with his hands in his pockets, dressed in a suit, tie, and hat. The middle man is seated on a chair, wearing a hat and a sweater, with his arms folded. The man on the right is also seated and wearing a shirt and tie with his sleeves rolled up. There is an empty chair between the second and third men and a crumpled newspaper rests on the third chair. To the right of the third man, a folding stool and a basket-like object are visible. The ground appears to be a concrete surface. The overall setting suggests a relaxed, perhaps informal, outdoor environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows three men sitting on a bench in an outdoor setting. The men appear to be older, with two of them wearing suits and hats, and the third man wearing a more casual outfit. They seem to be engaged in conversation or relaxing. The background suggests a rural or small-town setting, with hills or mountains visible in the distance.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white vintage photograph showing three elderly men sitting and standing along what appears to be a wall or barrier. One man is standing on the left wearing a suit and hat, while two others are seated on what looks like a bench. The man in the middle is wearing casual attire with a hat, and the man on the right is in lighter colored clothing with a tie. There appears to be some chairs or furniture between them. The wall behind them shows signs of age or weathering. The photo has the grainy, slightly faded quality typical of early to mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts three men sitting on chairs in front of a wall, with one man standing to the left. The man on the left is wearing a suit and tie, while the two men in the middle are dressed in casual attire. The man on the right is sitting on a chair with his legs crossed, and the man in the middle is sitting on a chair with his arms crossed. The man on the left is standing with his hands in his pockets.

The background of the image features a wall with a rough texture, and the overall atmosphere suggests a daytime setting. The image appears to be a vintage photograph, likely taken in the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of four men standing and sitting against a wall. The man on the left is dressed in a suit, tie, and fedora, with his hands in his pockets. Next to him, two men sit on chairs, one wearing a hat and the other without one. On the far right, an elderly man sits on a chair, wearing a white shirt and tie. A small table with papers on it separates the two groups of men. The background features a worn, dark-colored wall with a lighter-colored sky above it. The overall atmosphere suggests a daytime setting, possibly during a break or gathering.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of three men sitting on a bench in front of a wall. The man on the left is standing, wearing a suit and tie, and appears to be talking to the two men sitting on the bench. The man in the middle has his arms crossed and is looking at the man on the right, who is holding a newspaper and appears to be reading it. The wall behind them has some graffiti on it.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white photograph of three men, possibly taken in the 1940s. Two of them are seated on chairs, while the other is standing. They are all wearing hats and ties, and they are all looking in the same direction. One of the seated men is holding a newspaper, while the other is holding his hands together. Behind them is a wall with some markings.

Google Gemini

Created by gemini-2.0-flash on 2025-05-26

Here is a description of the image:

This black and white photograph shows three men sitting in chairs or standing next to a heavily textured wall. The wall appears to have a rough surface, with mottled patterns suggesting peeling paint or weathering. A high wall is present in the background.

On the left, a man wearing a fedora, suit, and tie stands with his hands at his sides. To his right, another man, also wearing a hat, sits with his arms crossed, looking to his right. A third man is seated further to the right. He is wearing a shirt and tie and appears to be reading something in his hands.

Between the second and third men, there is an empty chair with what appears to be a newspaper or other papers on the seat. Adjacent to the third man, there is an X-shaped object and a baby stroller.

The men are all looking away from the camera. The overall tone of the photograph is reminiscent of documentary-style photography from the mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-26

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely from an earlier era. It depicts three men in a somewhat somber or reflective scene. The setting seems to be outdoors, possibly a paved area in front of a weathered wall.

Key Elements:

  • The Men:
    • There are three men in the frame.
    • The man on the left is standing, dressed in a suit, tie, and a hat.
    • The second man is sitting, wearing a hat and a sweater or jacket, with his arms crossed.
    • The third man is sitting, appears to be older and has a hat, holding a book or newspaper.
  • The Background:
    • A dark, textured wall forms the background, showing signs of age and wear. There may be a few structures or objects atop the wall.
  • Other Details:
    • A few chairs are placed between the men.
    • There's a folding X-shaped stand.
    • Items of papers on a chair.

Atmosphere:

The image evokes a sense of quiet, perhaps solitude or introspection. The men's posture and the simple environment contribute to this mood.

Let me know if you would like a more detailed analysis!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring three men positioned in front of a wall. The setting appears to be outdoors, given the visible sky and distant landscape.

  1. Man on the Left:

    • Standing upright.
    • Wearing a suit with a tie and a hat.
    • Has his hands in his pockets.
    • Appears to be looking directly at the camera.
  2. Man in the Middle:

    • Seated on a chair.
    • Wearing a hat and a sleeveless shirt.
    • Has his arms crossed over his chest.
    • Looking downward or to the side, not directly at the camera.
  3. Man on the Right:

    • Seated on a chair.
    • Wearing a white shirt with a dark tie and dark pants.
    • Holding a pipe in his mouth.
    • Looking downward, possibly at something in his lap or on the ground.

Between the two seated men, there is a small table with some papers or documents on it. The wall behind them is textured and appears aged, with visible marks and wear. The ground is flat and appears to be made of concrete or a similar material. The overall mood of the image is somewhat formal, given the attire and posture of the men. The photograph has a vintage feel, suggesting it could be from the early to mid-20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image is a black-and-white photograph depicting three older men in an outdoor setting. The men are positioned against a weathered wall with a textured surface.

  • The man on the left is standing and wearing a dark suit with a tie and a hat. He appears to be observing the scene, with his hands in his pockets.
  • The man in the middle is seated on a chair with one arm crossed over his chest, holding a pipe. He is dressed in a lighter-colored shirt and dark pants, and he has a hat on. His posture suggests he is relaxed.
  • The man on the right is also seated on a chair, wearing a white shirt and dark pants, and he is holding a newspaper. His posture is upright, and he appears to be engaged with the newspaper.

In the background, there is a second chair and a folded chair leaning against the wall. A small table is present in the scene, and a cart with a wheel is partially visible on the far right side of the image. The overall atmosphere of the photo seems calm and reflective.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This is a black-and-white photograph depicting three older men in a casual outdoor setting. The men are positioned against a textured wall, with one standing on the left, one sitting in the middle, and another sitting on the right. The man standing is wearing a suit and hat, while the two seated men are dressed more casually, both wearing hats and ties. There is an empty wooden chair between the two seated men, and a small table with a newspaper or piece of paper is placed in front of them. To the right, there is a folding stool and a bicycle. The scene appears to be from an earlier time period, possibly the mid-20th century, given the clothing styles and the overall atmosphere of the photograph. The image has a somewhat aged and grainy quality, suggesting it might be an old photograph.