Human Generated Data

Title

Untitled (Division IX, May Day Parade, Communist Party route, Twenty-fifth Street between Fifth and Sixth Avenues, New York City)

Date

May 1, 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4020

Human Generated Data

Title

Untitled (Division IX, May Day Parade, Communist Party route, Twenty-fifth Street between Fifth and Sixth Avenues, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1, 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4020

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Sun Hat 99.9
Face 95.7
Head 95.7
Overcoat 82.2
Photography 63.2
Portrait 63.2
Cowboy Hat 57.9
Cap 57.4
Formal Wear 56.2
Suit 56.2
Hardhat 55.2
Helmet 55.2

Clarifai
created on 2018-05-10

people 99.7
adult 97.1
man 96.4
wear 92.7
group 92.1
monochrome 91.9
veil 90.1
portrait 89
woman 88.9
street 88.7
leader 88.1
one 85.5
two 84.6
lid 84
group together 82.8
child 80.1
administration 79.8
outfit 79.6
three 77.5
black and white 76

Imagga
created on 2023-10-05

person 40.3
barbershop 33.7
patient 31.1
man 28.2
senior 28.1
people 26.8
shop 26.5
happy 23.8
male 22.3
elderly 22
portrait 21.4
mercantile establishment 20.2
couple 20
old 19.5
nurse 19.3
adult 18.9
health 18.8
smile 18.5
love 18.2
mature 17.7
hairdresser 17
case 16.9
bed 16.1
family 16
hospital 15.5
sick person 15.3
looking 15.2
medical 15
retired 14.6
groom 14.5
women 14.2
lifestyle 13.7
place of business 13.6
home 13.6
smiling 13
child 13
aged 12.7
husband 12.5
surgeon 12.5
mother 12.5
retirement 12.5
bride 12.5
care 12.4
doctor 12.2
men 12
happiness 11.8
wife 11.4
human 11.3
sitting 11.2
affection 10.6
married 10.6
pretty 10.5
illness 10.5
coat 10.2
girls 10
lady 9.7
medicine 9.7
together 9.6
resting 9.5
lab coat 9.4
face 9.2
inside 9.2
wedding 9.2
treatment 9.2
parent 9
romantic 8.9
life 8.9
indoors 8.8
hair 8.7
grandfather 8.6
model 8.6
lying 8.5
room 8.2
pensioner 8.2
close 8
professional 7.9
grandmother 7.8
black 7.8
affectionate 7.7
expression 7.7
females 7.6
relaxation 7.5
relaxed 7.5
relationship 7.5
holding 7.4
daughter 7.4
gown 7.3
dress 7.2
worker 7.2
work 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.6
man 97.1
black 71.7
white 69.9
old 50.5
posing 42.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 50-58
Gender Male, 89.4%
Calm 45.3%
Happy 24.6%
Sad 11.3%
Disgusted 9.1%
Surprised 8.7%
Fear 6.1%
Confused 2.2%
Angry 1.7%

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Coat

Clarifai

Clothing
Human face
Man
Hat
Human nose
Human head
Human hair

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 98%

AWS Rekognition

Adult 97%

AWS Rekognition

Adult 87.4%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 98%

AWS Rekognition

Male 97%

AWS Rekognition

Male 87.4%

AWS Rekognition

Man 99.1%

AWS Rekognition

Man 98%

AWS Rekognition

Man 97%

AWS Rekognition

Man 87.4%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97%

AWS Rekognition

Person 87.4%

AWS Rekognition

Hat 83.7%

AWS Rekognition

Coat 68.9%

Clarifai

Clothing 96.4%

Clarifai

Clothing 42.9%

Clarifai

Human face 94.3%

Clarifai

Human face 61.5%

Clarifai

Human face 57.5%

Clarifai

Human face 46.3%

Clarifai

Man 85.3%

Clarifai

Man 85.3%

Clarifai

Man 37.2%

Clarifai

Hat 69.5%

Clarifai

Human nose 42.7%

Clarifai

Human head 39.8%

Clarifai

Human hair 38.1%

Categories

Imagga
created on 2023-10-05

paintings art 99.6%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

a man in a hat and suit is standing in front of a crowd

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a man in a suit and hat with a white hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image appears to be a photographic negative. It depicts a man in the foreground, wearing a suit, tie, and a hat, with his face slightly shadowed. He is standing in an environment where other people are visible in the background. Several of these individuals are wearing coats and hats, suggesting an early to mid-20th-century setting, possibly outdoors or near a building. The negative format distorts the colors and lighting, giving it a reversed tonal effect characteristic of film negatives.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a photographic negative depicting a man wearing a coat and a hat in a crowd. As a negative, the colors and brightness are inverted, making the whites appear dark and the shadows appear light. The man is in focus and positioned centrally, looking directly at the camera. The background is out of focus and shows several other individuals, most of whom are also wearing hats and coats, suggesting a historical setting where such attire was common. The presence of multiple people and the apparent architectural elements suggest this could be a public or urban setting. The negative has some visible dust and scratches, which is typical of older film photography.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to show a group of people wearing long, flowing robes or cloaks. The figures are indistinct and difficult to make out clearly, but they seem to be gathered together in a crowded or confined space. The image has a grainy, black and white quality, suggesting it may be an older photograph. Overall, the scene conveys a sense of mystery and anonymity, with the individuals obscured by their voluminous garments.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph that appears to be from Harvard College/Harvard University Art Museums. The image shows several people in a line or row wearing light-colored clothing and what appear to be wide-brimmed hats. The photo has a grainy, vintage quality typical of early photography, with some spots and imperfections visible. The subjects are shown in profile or from the side, and their clothing style suggests this image is from an earlier era, possibly the late 19th or early 20th century. The image has a formal, institutional quality to it, which is fitting given its Harvard connection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man in a hat and coat, with other people in the background.

  • The man in the foreground is wearing a light-colored hat and a light-colored coat.
    • He has a serious expression on his face.
    • He is looking directly at the camera.
  • There are several other people in the background, but they are not clearly visible.
    • They appear to be standing in a group, possibly in a street or alleyway.
    • Some of them are wearing hats and coats, similar to the man in the foreground.
  • The background of the image is out of focus, but it appears to be a city street or alleyway.
    • There are buildings and other structures visible in the distance.
    • The overall atmosphere of the image is one of a busy, urban setting.

In summary, the image is a black-and-white photograph of a man in a hat and coat, with other people in the background. The man is looking directly at the camera with a serious expression, and the background is out of focus but appears to be a city street or alleyway.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man in a suit and hat, with other people in the background. The man in the foreground is wearing a light-colored suit, a dark shirt, and a tie. He is also wearing a light-colored hat. The background of the image is out of focus, but it appears to be a group of people standing together. The overall atmosphere of the image suggests that it was taken at a formal event or gathering.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph featuring a man dressed in a suit and a hat, standing prominently in the foreground. His expression is neutral, and he is looking directly at the camera. Behind him, there are several other individuals, also dressed in suits and hats, who appear to be engaged in conversation or observing something. The background is blurred, but there are hints of architectural details, suggesting an indoor setting, possibly a formal event or a gathering. The overall atmosphere of the photograph is formal and serious, with the focus clearly on the man in the foreground.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a man in a suit and hat, standing in front of a crowd. The man's face is obscured by a bright light, making it difficult to see his features. He is wearing a suit and tie, and his hat is tilted slightly to one side. The crowd behind him is blurry, and it appears that they are gathered in a public space. The image has a vintage look, suggesting that it was taken many years ago.

Google Gemini

Created by gemini-2.0-flash on 2025-05-26

This black and white image shows a crowd of people. In the foreground, a man wears a suit and hat. Behind him and to the side are other figures, including a woman wearing a hat. The image appears to be from an old photographic negative, given the style and the inscription at the bottom, which reads: "© President and Fellows of Harvard College (Harvard University Art Museums)."

Created by gemini-2.0-flash-lite on 2025-05-26

Here's a description of the image:

Overall Impression: The image is a black-and-white negative photograph, giving it a reversed color scheme. It seems to be a snapshot from a historical event. The focus is on a man in the foreground who is facing towards the camera.

Foreground:

  • The Main Subject: A man wearing a fedora hat, a suit jacket, a collared shirt, and a tie. The negative effect makes the details of his facial features visible.
  • Attire and Style: His clothing suggests a formal or semi-formal setting, possibly from the early to mid-20th century.
  • Pose and Expression: He appears to be posing for a photograph or looking towards the camera.

Background:

  • Blurred Figures: There are blurred figures in the background, suggesting a crowd or other people in attendance.
  • Setting: The background elements are difficult to discern due to the blur, but they could be part of a building, an event, or other unspecified place.

Overall: The photograph captures a moment from an era and event, probably during the early to mid 20th century. The negative processing gives it a slightly dreamlike or surreal quality. The image appears to be of archival quality, with the text added at the bottom.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph featuring a group of people. The central figure is an older man wearing a hat and a suit. He is smiling and appears to be in a cheerful mood. He is surrounded by other individuals, some of whom are also wearing hats. The photograph seems to be taken outdoors, possibly during an event or gathering. The image has a vintage quality, suggesting it might be from an earlier era. The background includes architectural elements, indicating it could be taken in an urban setting. The image has some visible wear and tear, such as scratches and spots, which add to its historical feel. The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image is a black-and-white photograph of a statue. The statue appears to depict a man wearing a wide-brimmed hat, a coat, and a tie. The statue's face is smiling, and the background shows a blurred crowd of people, suggesting that the statue might be located in a public place, possibly near a monument or historical site. The overall style of the image and the attire of the statue suggest it might be from an earlier era, possibly the early to mid-20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This black-and-white photograph features a man in the foreground, dressed in formal attire. He is wearing a large hat, a tie, and a coat. The background is slightly blurred, showing several other people, some of whom are also wearing hats and coats. The image appears to be from an earlier time period, possibly the early to mid-20th century, given the style of clothing and the quality of the photograph. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Text analysis

Amazon

College
(Harvard
Harvard
Fellows
Museums)
Art
and
of
President and Fellows of Harvard College (Harvard University Art Museums)
University
President
P1970.4020.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4020.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4020.0000