Human Generated Data

Title

Untitled (Boris Gorelick in front of the United States Court House, Artists' Union and Artists' Committee of Action demonstration for job relief and a municipal art gallery, Foley Square, New York City)

Date

October 27, 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3924

Human Generated Data

Title

Untitled (Boris Gorelick in front of the United States Court House, Artists' Union and Artists' Committee of Action demonstration for job relief and a municipal art gallery, Foley Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 27, 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3924

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 99.9
Building 99.9
Hospital 99.9
People 99.7
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Clothing 99
Hat 99
Baseball Cap 98
Cap 98
Coat 97.3
Person 96.3
Adult 96.3
Male 96.3
Man 96.3
Person 95
Adult 95
Male 95
Man 95
Person 94.9
Person 91.8
Adult 91.8
Male 91.8
Man 91.8
Crowd 91.5
Photography 91.4
Face 90.9
Head 90.9
Person 89.6
Adult 89.6
Bride 89.6
Female 89.6
Wedding 89.6
Woman 89.6
Person 88.6
Person 87
Male 87
Boy 87
Child 87
Person 85.1
Person 82.6
Body Part 73.7
Finger 73.7
Hand 73.7
Indoors 70.1
Factory 66.4
Person 64.5
Accessories 64.1
Glasses 64.1
Clinic 63.2
Classroom 57.9
Room 57.9
School 57.9
Sunglasses 57
Audience 56.8
Operating Theatre 56.7
Portrait 55.6
Doctor 55.4
Medical Procedure 55.4
Shirt 55.2

Clarifai
created on 2018-05-10

people 99.7
adult 98
man 96.7
woman 92.9
group 92
hospital 91.1
administration 90
wear 88.8
medical practitioner 88.6
two 88.4
room 88.1
furniture 87.1
canine 86.8
one 85.7
group together 84.6
monochrome 83
offense 80.1
uniform 79.4
police 78.3
portrait 78.1

Imagga
created on 2023-10-06

negative 27
person 23.2
film 21.9
people 21.2
man 19.5
mask 18
photographic paper 17
black 16.3
adult 15.2
happy 14.4
portrait 14.2
fashion 13.6
male 13.5
winter 11.9
happiness 11.7
smile 11.4
photographic equipment 11.3
hair 11.1
cat 11
model 10.9
snow 10.8
holiday 10.7
clothing 10.7
face 10.6
human 10.5
cold 10.3
love 10.3
fur 10.2
dress 9.9
costume 9.7
one 9.7
sexy 9.6
couple 9.6
home 9.6
men 9.4
hand 9.1
attractive 9.1
cute 8.6
child 8.1
cheerful 8.1
lady 8.1
family 8
dog 7.9
eyes 7.7
pretty 7.7
bride 7.7
youth 7.7
old 7.7
head 7.6
outdoors 7.5
joyful 7.3
pet 7.3
smiling 7.2
suit 7.2
celebration 7.2
disguise 7.1
day 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 96.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 99.1%
Surprised 6.4%
Fear 6%
Sad 2.2%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Confused 0%

Feature analysis

Amazon

Person
Adult
Male
Man
Bride
Female
Woman
Boy
Child
Glasses
Person 99.1%
Person 96.3%
Person 95%
Person 94.9%
Person 91.8%
Person 89.6%
Person 88.6%
Person 87%
Person 85.1%
Person 82.6%
Person 64.5%
Adult 99.1%
Adult 96.3%
Adult 95%
Adult 91.8%
Adult 89.6%
Male 99.1%
Male 96.3%
Male 95%
Male 91.8%
Male 87%
Man 99.1%
Man 96.3%
Man 95%
Man 91.8%
Bride 89.6%
Female 89.6%
Woman 89.6%
Boy 87%
Child 87%
Glasses 64.1%

Categories

Captions

Microsoft
created by unknown on 2018-05-10

a man holding a cat 39.1%
a man standing next to a cat 39%
a man and a woman taking a selfie 25.5%

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a woman in a coat and hat standing in front of a crowd of people -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image appears to be a negative photograph depicting a formal gathering or event. A person is standing prominently in the center wearing a formal coat, surrounded by a crowd of people. Many individuals are wearing hats, including fedoras and other formal styles, suggesting the event might hold a historical significance. The background includes structural elements such as scaffolding or industrial architecture, and a sign can be seen in the top-right corner, though the text is partially obscured.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a negative photograph showing a man wearing a coat standing among a group of people, who are all wearing hats. The scene appears to be set in front of a building, possibly a construction site or industrial area, as there are visible scaffolding and structural elements in the background. Additionally, there is a sign on the wall of the building indicating it is related to the United States Court House, with references to court events and proceedings. The crowd is closely gathered around the central figure. The photograph has been processed as a negative, reversing the colors and creating a distinct visual style.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a large crowd of people, mostly men, gathered in an outdoor setting. In the center of the image, a man in a long coat and hat stands out, appearing to be addressing or speaking to the crowd. The people in the crowd have a mix of expressions, some appearing attentive while others seem more casual or distracted. The background includes some buildings or structures, suggesting an urban or industrial setting. Overall, the image conveys a sense of a public gathering or event, with the central figure drawing the attention of the crowd.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white historical photograph that appears to show an exceptionally tall person standing in a crowd. The tall individual is wearing a long overcoat and appears to be towering over the surrounding crowd, who are wearing hats typical of the early 20th century. The image seems to be taken outdoors, possibly near a ship or building with railings visible in the background. The photo has a distinctive quality characteristic of early photography, and according to the credit line, it's from the Harvard University Art Museums collection.

The stark height difference between the central figure and the surrounding crowd makes this a particularly striking image, highlighting what appears to be someone of unusual stature, possibly someone who may have had gigantism. The crowd appears to be gathered around this person, suggesting they were a person of interest or notability at the time the photograph was taken.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man standing in front of a crowd, likely taken in the early 20th century.

  • The man is standing in the center of the image, wearing a dark-colored suit and tie. He has short hair and appears to be speaking or addressing the crowd.
  • The crowd is made up of men, all of whom are wearing hats. They are facing the man and appear to be listening intently to what he is saying.
  • In the background, there is a sign that reads "UNITED STATES COURT" and lists the names of several individuals, including "JAMES STEWART & Co."
  • The overall atmosphere of the image suggests that it was taken during a formal event or ceremony, possibly related to the court or legal proceedings.

The image provides a glimpse into a moment in time, capturing the attention and interest of the crowd as they listen to the man's words.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This black-and-white image depicts a man standing in front of a crowd, with a sign visible behind him. The man is dressed in a long coat and has short hair. He appears to be speaking to the crowd, which is gathered around him.

The sign behind the man reads "UNITED STATES COURT" and includes additional text that is not fully legible. The background of the image features a building with windows, suggesting that the scene is taking place outdoors.

Overall, the image captures a moment of public speaking or address, with the man at the center of attention.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image shows a man standing in front of a crowd, possibly giving a speech. The man is wearing a long coat and has a serious expression on his face. The crowd is gathered in front of him, and some of them are wearing hats. Behind the man, there is a building with a sign that reads "UNITED STATES COURT" and "U.S. Treasury Department." The image has a black-and-white filter and a watermark in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-10

A black-and-white photo shows a man standing in front of a crowd of people. The man is wearing a coat and has his mouth open, possibly speaking to the crowd. The crowd is wearing hats and is looking at the man. Behind the man is a building with a sign on the wall. The photo is in a vintage style, with a watermark on the bottom right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-05-21

Certainly! Here's a description of the image you sent:

General Description:

The image is a black and white photograph showing a man in a coat standing before a crowd of people. It has a distinct vintage feel. The image appears to be a negative, which accounts for the unusual contrast and colors.

Details:

  • Central Figure: A man in a coat is standing and addressing a crowd. He has a smile on his face and appears to be giving a speech or presentation.
  • Crowd: A crowd of people are gathered, appearing to listen to the speaker.
  • Background: Behind the man there are some windows and sign which says "UNITED STATES COURT"

Created by gemini-2.0-flash-lite on 2025-05-21

Here's a description of the image:

Overall Impression: The image appears to be a historic photograph, possibly from the early to mid-20th century. It is a negative, meaning the colors are inverted: light areas are dark, and dark areas are light.

Subject and Composition: The central focus is a man standing and addressing a crowd. He is wearing a long coat or jacket, and his hands are in his pockets. The crowd, made up of other men, is gathered around him, likely listening to him speak. Some people are wearing hats. The background suggests a public space, possibly outdoors or near a building with windows. There's a sign visible on the wall.

Details:

  • The Man: He has a distinctive hairstyle. His facial expression is hard to discern due to the negative, but it looks like he might be speaking or smiling.
  • The Crowd: The crowd is mostly composed of men, and they appear to be focused on the speaker.
  • Setting: There are architectural elements in the background, possibly windows or a building facade, suggesting an outdoor or semi-outdoor setting.
  • Sign: A sign in the background mentions "United States Court" and some other names/organizations.

Style and Technique: The image is black and white, with a grainy texture characteristic of older photographic processes. The composition and subject matter suggest a documentary or journalistic style, capturing a public event or speech.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph showing a man standing on a ship's deck. He is dressed in a heavy coat, suggesting cold weather, and he is wearing dark goggles, likely to protect his eyes from the elements. The man appears to be in a jovial mood, as he is smiling broadly.

In the foreground, there are several people wearing heavy fur clothing, which further suggests that the setting is in a cold climate. These individuals are facing away from the camera, and their attire indicates they are likely part of an expedition or voyage.

The background shows part of the ship's structure, including railings and a sign that reads "UNITED STATES COURT, U.S. TREASURY DEPT., CUSTOMS SERVICE, CUSTOMS HOUSE, JAMES STEWART & CO." This suggests that the ship may be docked at a port where customs procedures are being carried out.

Overall, the photograph captures a moment during a maritime journey, likely an expedition, in a cold region, with the man in the goggles being a central figure in the scene.

Text analysis

Amazon

(Harvard
Art
College
of
Fellows
Harvard
Museums)
and
President and Fellows of Harvard College (Harvard University Art Museums)
University
UNITED
JAMES
P1970.3924.0000
President
-
COURT
- -
IN
CASS
DEPT
TREASURY
5
U
UNITED STATES COURT e
U 5 Khai TREASURY DEPT -
STATES
JAMES MONDALE STEWARS - & - to IN
to
&
e
STEWARS
Public
Public with
INC
with
Khai
MONDALE

Google

UNITED STAIES COR President and Fellows of Harvard College (Harvard University Art Museums) P1970.3924.0000
UNITED
STAIES
COR
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.3924.0000