Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3844

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3844

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 100
Face 95.9
Head 95.9
Photography 95.9
Portrait 95.9
Architecture 94.7
Building 94.7
Hospital 94.7
Body Part 92.7
Neck 92.7
Clinic 57.1
Electrical Device 57
Finger 56.8
Hand 56.8
Lab Coat 56.5

Clarifai
created on 2018-05-10

people 99.2
adult 97.8
monochrome 97.5
man 95.7
one 94
portrait 93.7
wear 87.1
woman 84.4
black and white 78.5
retro 75.4
street 73.8
administration 72.7
window 71.8
wall 71.3
business 70.8
indoors 70.6
vintage 70.2
actor 69.4
child 69
leader 63.3

Imagga
created on 2023-10-05

man 45
person 37
male 29.1
people 26.2
work 23.6
portrait 21.4
worker 20.9
professional 20.3
medical 20.3
office 20.3
adult 19.9
senior 18.7
looking 18.4
coat 17.8
smiling 17.4
face 17.1
nurse 16.1
old-timer 15.8
men 15.5
serious 15.3
business 15.2
businessman 15
lab coat 14.9
mustache 14.9
happy 14.4
patient 14.3
job 14.2
old 13.2
doctor 13.2
hat 12.9
sitting 12.9
smile 12.1
mature 12.1
surgeon 12
home 12
student 11.9
medicine 11.5
technology 11.1
health 11.1
hair 11.1
lab 10.7
laboratory 10.6
computer 10.6
indoors 10.5
elderly 10.5
education 10.4
study 10.3
black 10.2
hand 9.9
scholar 9.7
working 9.7
chemistry 9.7
test 9.6
exam 9.6
hospital 9.6
biology 9.5
shirt 9.5
grandfather 9.3
glasses 9.3
laptop 9.2
occupation 9.2
confident 9.1
human 9
science 8.9
to 8.9
scientist 8.8
illness 8.6
research 8.6
college 8.5
desk 8.5
one person 8.5
one 8.2
lifestyle 8
happiness 7.8
intellectual 7.8
garment 7.7
casual 7.6
clothing 7.6
executive 7.5
equipment 7.4
uniform 7.1
handsome 7.1
interior 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

man 99.1
person 95.8
wall 95.5
hat 66.8
old 49.9
posing 48.9

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 47-53
Gender Male, 98.2%
Calm 59.8%
Sad 28.1%
Surprised 9.4%
Fear 7.2%
Disgusted 3.2%
Happy 3%
Confused 2.9%
Angry 2.6%

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person

Clarifai

Human face
Man
Human nose
Human mouth
Human eye

AWS Rekognition

Adult 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Person 99.4%

Clarifai

Human face 98.7%

Clarifai

Man 92.1%

Clarifai

Human nose 38.2%

Clarifai

Human mouth 37.7%

Clarifai

Human eye 37.5%

Categories

Imagga
created on 2023-10-05

interior objects 97.5%
pets animals 1.7%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-05

a man in a hat is standing in front of a door

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a lab coat and a lab coat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image is in black-and-white negative form and depicts part of an indoor setting with various objects visible. On the left, there is a display with signs that include text such as "Favorites," "Hot," "5.95," and other indecipherable details. Below this display are boxes or containers. The background features vertical panels, likely part of a door or wall structure, and a transparent window or framed opening. The individual shown is wearing a flat cap and has a collared shirt or coat visible.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a black and white negative featuring a person wearing a shirt or coat and a hat. In the background, there are several visible elements: a door, a sign for merchandise or a service that displays "5.95", and what appears to be a shelf or countertop with various items, one of which includes text "FRESH PLUM..." suggesting a grocery store setting. The overall atmosphere has a vintage or retro feel due to the style and presentation of the content.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image appears to be a black and white photograph of a person wearing a hat and coat, standing in what looks like a doorway or hallway. The person's face is partially obscured, and there are various objects and signs visible in the background, including a sign that says "Favorite HOTS GED". The overall atmosphere of the image seems somewhat somber or serious.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-17

The black and white image shows a man wearing a flat cap and a white lab coat or jacket. He appears to be in a laboratory or research setting, with various scientific equipment and supplies visible in the background, such as test tubes and beakers on shelves. The man has a serious, pensive expression as he looks slightly downward. The grainy, aged quality of the photograph suggests it was taken some time ago, likely in the mid-20th century based on the man's attire and the vintage look of the laboratory equipment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white photograph that appears to be from a historical collection at Harvard University. The image shows someone wearing a flat cap (or newsboy cap) and what appears to be a white coat or uniform. The setting looks like it might be some kind of shop or business interior, with what appears to be a cash register or mechanical device visible in the background, along with some signage. The image has the grainy, vintage quality typical of mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of a man standing in front of a door, wearing a white coat and a flat cap. The man is positioned in the center of the image, facing to the right. He has dark skin and is wearing a white coat over a dark shirt. On his head, he wears a flat cap with a small brim.

Behind the man, there is a door with a white frame. To the left of the door, there is a wall with various objects attached to it, including a sign that reads "5" in large numbers, a small box with a dial on top, and a stack of papers or cards. In the background, there is a wall with a white door and a window.

The overall atmosphere of the image suggests that the man is in a professional or medical setting, possibly a hospital or laboratory. The white coat and the presence of medical equipment in the background support this interpretation. However, without more context, it is difficult to determine the exact location or purpose of the image.

The image appears to be a vintage photograph, possibly from the mid-20th century, given the style of clothing and the equipment in the background. The quality of the image is low, with visible grain and scratches, which adds to its nostalgic and retro feel.

Overall, the image presents a simple yet intriguing scene, inviting the viewer to wonder about the story behind the man and his surroundings.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of a man standing in front of a storefront. The man is wearing a dark shirt and a light-colored jacket or coat, and he has a hat on his head. He appears to be looking down at something, possibly a newspaper or a book.

In the background, there are several signs and advertisements visible through the window of the store. One sign reads "Favorite HOTS GED," which may be an advertisement for hot dogs or other food items. Another sign appears to be an advertisement for a film or movie, but the text is not clear enough to read.

The overall atmosphere of the image suggests that it was taken in the 1960s or 1970s, based on the style of the man's clothing and the appearance of the storefront. The image may have been taken by a photographer who was documenting everyday life in a urban setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-25

The black-and-white image depicts a man standing in front of a door. He is wearing a hat and a white coat. The man's head is slightly tilted, and he is looking to the left. Behind him, there is a wall with various posters and advertisements. The door is closed, and there is a reflection of the man in the glass. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" in the bottom left corner.

Created by amazon.nova-pro-v1:0 on 2025-05-25

A black-and-white photo features a man with a hat standing in front of a white door. He is wearing a white coat, and his face is illuminated by a light. Behind him, there is a white wall with a few posters attached to it. The posters have text and some images, and one of them has the text "FAVORITE HOTS GGED" on it. The image has a watermark on the bottom left corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

Overall Impression:

The image appears to be a black and white negative of a man. It's a portrait, showing the man from the chest up, likely taken indoors.

Key Elements:

  • The Man: He's wearing a flat cap and a light-colored, possibly white, jacket. His expression is somewhat serious or thoughtful, and he's looking slightly off-camera.
  • Background: The background is a bit indistinct, but there are signs of an interior setting. We see what looks like a door, a sign that says "39", a sign that says "favorite HOTS GED", and a sign that says "FRESH FILMS / DENICED", some sort of vending machine, as well as a sign that says "5%"
  • Lighting: The lighting seems soft and somewhat diffused, typical of indoor photography.

Overall Style:

The image's style suggests it's an older photograph, likely taken in the mid-20th century or earlier, given the film format and the subjects. The negative effect gives it a slightly eerie, vintage feel.

Created by gemini-2.0-flash on 2025-05-22

The black and white photograph is an inverted image, and shows a man wearing a tweed cap and a jacket or coat. To his left, there are boxes with words like "favorite HOTS GED" and "FRESH FILMS REDUCED." A sign with the number "5" followed by a cent symbol is visible above these boxes. In the background, there is a door and other indistinct items. The image is slightly scratched and has some imperfections, consistent with an older photograph or negative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-26

The image is a black-and-white photograph of a man wearing a flat cap and a white jacket. The man appears to be standing in front of a wall that has several posters and signs. The posters include text that is partially legible, with one clearly reading "Favorite Hots" and "Ged." There is also a small sign on the wall that appears to be an electrical panel or a meter, with the number "5" visible on it. The overall setting suggests an urban environment, possibly a street or a public area. The man's face is partially obscured by the shadow of his cap, giving the photograph a somewhat mysterious and artistic quality. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Text analysis

Amazon

Art
College
Fellows
(Harvard
Museums)
Harvard
and
President and Fellows of Harvard College (Harvard University Art Museums)
HOTS
University
of
GED
favorite
FRESH
FRESH FILMS
FILMS
95
5
President
P1970.3844.0000
39
23
г
ALL 23 г
DENUCERI
ALL
AND

Google

favarite OTS GED 22. President and Fellows of Harvard College (Harvard University Art Museums) P1970.3844.0000
favarite
OTS
GED
22.
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.3844.0000