Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2852

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2852

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Formal Wear 100
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Suit 96.9
Face 96.3
Head 96.3
Photography 95.9
Portrait 95.9
Accessories 93.9
Glasses 93.9
Hat 93.6
Person 88.9
Person 87.1
Bench 84.8
Furniture 84.8
Tie 71.1
Overcoat 69.3
Sitting 65.4
Person 62.2
Shirt 57.6
Text 57.2
Reading 57.2
Jacket 57.1
Blazer 56.5
Tuxedo 55.4
Sun Hat 55.2

Clarifai
created on 2018-05-10

people 99.9
administration 98.5
adult 98.4
man 96.6
one 96.1
leader 95.1
group 93.5
group together 93.1
many 88.3
chair 88.2
two 87.8
portrait 87.6
woman 82.3
sit 82.3
wear 82
home 82
vehicle 80
outfit 79.4
veil 79.1
war 78.3

Imagga
created on 2023-10-06

man 53.2
business 44.4
businessman 44.2
male 40.4
office 40.4
suit 37.9
professional 34.6
corporate 34.4
people 32.4
executive 31.6
work 29
person 27
happy 26.3
adult 26.1
manager 25.2
handsome 25
men 23.2
businesspeople 22.8
portrait 22
team 21.5
confident 20.9
businesswoman 20.9
meeting 20.7
teamwork 20.4
wagon 19.5
job 19.5
successful 19.2
smiling 18.8
group 18.5
smile 18.5
building 18.2
success 17.7
laptop 17.3
computer 16.8
communication 16.8
colleagues 16.5
corporation 16.4
tie 16.1
working 15.9
wheeled vehicle 15.4
worker 14.5
formal 14.3
guy 14.2
modern 14
together 14
attractive 14
looking 13.6
face 13.5
employee 13.4
sitting 12.9
friendly 12.8
businessmen 12.7
talking 12.4
desk 12.3
bartender 12.1
expression 11.9
technology 11.9
leader 11.6
leadership 11.5
restaurant 11.5
workplace 11.4
career 11.4
senior 11.2
company 11.2
women 11.1
busy 10.6
staff 10.5
boss 10.5
look 10.5
table 10.4
waiter 10.2
lifestyle 10.1
discussing 9.8
partner 9.7
clothing 9.6
partnership 9.6
ethnic 9.5
smart 9.4
container 9.3
phone 9.2
occupation 9.2
indoors 8.8
using 8.7
entrepreneur 8.5
finance 8.4
hand 8.4
notebook 8.4
mature 8.4
service 8.3
glasses 8.3
holding 8.3
human 8.3
necktie 8
coat 7.8
happiness 7.8
standing 7.8
black 7.8
masculine 7.8
conversation 7.8
older 7.8
management 7.7
serious 7.6
casual 7.6
student 7.6
plan 7.6
city 7.5
cheerful 7.3
center 7.3
colleague 7.2
hall 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.1
man 98.9
outdoor 96.9
suit 81.6
old 80
black 78.7
white 67.2
posing 38.9

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 62-72
Gender Male, 100%
Confused 45.3%
Calm 35.5%
Sad 10.4%
Surprised 8.3%
Fear 6.3%
Angry 1.3%
Disgusted 1.2%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Female, 96.5%
Fear 98.1%
Surprised 6.3%
Sad 2.2%
Calm 0.1%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 2-10
Gender Female, 58.7%
Calm 73.1%
Happy 21%
Surprised 6.9%
Fear 6.8%
Sad 2.5%
Confused 0.7%
Disgusted 0.6%
Angry 0.2%

Microsoft Cognitive Services

Age 44
Gender Male

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Suit
Glasses
Hat
Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Person 88.9%
Person 87.1%
Person 62.2%
Suit 96.9%
Glasses 93.9%
Hat 93.6%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a suit and hat sitting on a bench -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image depicts a man seated on a bench in an urban setting, dressed in a suit and tie, complemented by a straw hat with a ribbon. He is holding an open book in his hand, suggesting he may be reading or pausing in contemplation. The background showcases a street scene with historic architectural details, including large windows, a storefront, railings, and a billboard. People are faintly visible in the photograph, contributing to the lively atmosphere of a public space.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a person sitting on a bench outdoors, dressed in a suit with a tie and wearing a straw boater hat. The person is holding an open book in their right hand, which is resting on the arm of the bench. In the background, there is a street scene with a metal fence and several buildings, including one with large windows, one with an awning, and an advertisement on a wall. The setting appears to be an urban environment, possibly a park or plaza.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows a man wearing a hat and glasses, standing in front of a storefront. He appears to be an older gentleman, dressed in a suit and tie, and is holding some papers or documents in his hands. The background includes other buildings and storefronts, suggesting this is a city street scene. The image has a black and white, vintage aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white photograph that appears to be from an earlier era, likely the 1920s or 1930s. The image shows a person sitting on what appears to be a public bench, wearing a formal suit with a tie and a straw boater hat. They are wearing round spectacles and have a somewhat stern or serious expression. The person is holding what appears to be an open book or document. In the background, there is a city street scene with buildings, windows, and what looks like an iron fence or railing. The overall composition suggests this may have been taken in an urban setting, perhaps near a business district or public square.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man sitting on a bench, reading a book. The man is wearing a suit, tie, and hat, and is holding the book in his left hand. He appears to be sitting in a park or other outdoor setting, with buildings visible in the background.

  • The man is wearing a suit, tie, and hat.
  • He is holding a book in his left hand.
  • He appears to be sitting in a park or other outdoor setting.
  • Buildings are visible in the background.

The image suggests that the man is taking a break from his daily activities to enjoy some reading time in a peaceful outdoor setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black and white photograph of a man sitting on a bench, reading a book. The man is dressed in a suit, tie, and hat, with his right arm resting on the back of the bench and his left hand holding the book. He appears to be wearing glasses with large lenses.

In the background, there are buildings and a fence, suggesting that the scene is set in an urban environment. The overall atmosphere of the image is one of quiet contemplation, with the man lost in thought as he reads his book.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of a man sitting on a bench. He is wearing a suit, a tie, and a hat with a wide brim. He has glasses on his face and is holding a book in his hands. Behind him, there is a fence with plants and a building with glass windows. The image has a vintage look, suggesting it was taken in the past.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white image shows a man sitting on a bench outside a building. He is wearing a suit, a tie, a hat, and glasses. He is holding a book in his left hand, while his right hand is resting on the bench. Behind him, there is a black fence with plants and bushes. The building has a signboard with some text, and there are some people walking behind the fence.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph that appears to be from the mid-20th century. It portrays a man sitting on a park bench, holding an open book. The setting seems to be an urban environment with buildings visible in the background.

Details:

  • The Man: He is the central focus. He's wearing a suit, a tie, a hat, and round glasses. His expression is serious, almost contemplative.
  • The Setting: The backdrop reveals buildings, possibly commercial or office structures, with windows. In the background, there's also an advertisement for "Sunkist Oranges". A wrought-iron fence and foliage suggest that the man is in a park or a similar public space.
  • Composition: The photographer likely used the rule of thirds, placing the man on the right side of the frame to showcase both the subject and the context. The lines of the bench and the buildings in the background offer depth.
  • Mood/Atmosphere: The photo has a somewhat formal and perhaps introspective feel. The man's serious expression and the vintage aesthetic create a sense of history.

If you have another image, feel free to share it!

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

This is a black and white photograph of a man sitting on a bench in what appears to be a public park or urban setting. The man is wearing a suit and tie, a light-colored hat, and round eyeglasses. He is holding a book open in his hands, though he is looking directly at the camera with a slightly somber expression.

Behind the man, there is a low, decorative wrought iron fence and some greenery. In the background, there are buildings with windows and what looks like a store or business front with an awning. One of the signs in the background says "Sunkist Oranges." The background details suggest an urban environment, likely taken sometime in the mid-20th century based on the clothing and style of the buildings.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting an older man sitting on a park bench in an urban setting. He is wearing a suit and tie, a light-colored hat, and distinctive round glasses. He appears to be reading a book or a newspaper. The background shows a city street with buildings, storefronts, and a few other people. The overall atmosphere suggests a scene from the mid-20th century, possibly in a busy downtown area. The man's expression is serious and focused, and the photograph captures a moment of quiet amidst the bustling city environment.

Text analysis

Amazon

AGE
Oranges
9
E
9 NV E PRES
AGE EV
PRES
NV
EV
SUNKIST Oranges
SUNKIST