Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4164

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4164

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Baseball Cap 100
Cap 100
Clothing 100
Hat 100
Body Part 100
Finger 100
Hand 100
Face 99.7
Head 99.7
Photography 99.7
Portrait 99.7
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.5
Adult 98.5
Male 98.5
Man 98.5
Person 98.3
Adult 98.3
Male 98.3
Man 98.3
Person 91.5
Baby 91.5
Neck 85.8
Formal Wear 77.4
Suit 77.4
Art 56.1
Collage 56.1
Mouth 55.5
Teeth 55.5
Sun Hat 55.3
Accessories 55.2
Goggles 55.2
Earring 55.2
Jewelry 55.2

Clarifai
created on 2018-05-10

people 99.7
monochrome 97.9
adult 96.4
man 96.1
child 94.7
woman 94.4
group 94.3
portrait 93.8
wear 92.2
group together 87.8
facial expression 87.4
indoors 86.6
two 84.9
one 81.9
three 80.5
street 80.2
sit 77.9
recreation 77.6
administration 76.1
black and white 75.5

Imagga
created on 2023-10-05

man 25.5
portrait 22.6
male 22.3
people 21.2
person 20.2
happy 18.2
black 18
adult 17.5
old 16.7
child 15.9
face 14.9
smiling 14.5
world 13.1
human 12.7
car 12.2
couple 12.2
smile 11.4
antique 11.2
happiness 11
passenger 10.8
family 10.7
men 10.3
art 9.9
one 9.7
looking 9.6
home 9.6
cadaver 9.5
love 9.5
senior 9.4
hand 9.1
vintage 9.1
holding 9.1
religion 9
statue 8.8
automobile 8.6
god 8.6
sitting 8.6
mother 8.4
head 8.4
dark 8.3
inside 8.3
fun 8.2
dress 8.1
suit 8.1
sculpture 8
baby 8
neonate 7.9
ancient 7.8
pray 7.8
spiritual 7.7
bride 7.7
spectator 7.6
clothing 7.5
vehicle 7.5
mature 7.4
historic 7.3
lady 7.3
parent 7.3
color 7.2
lifestyle 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 95

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 26-36
Gender Female, 74.6%
Calm 97.8%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Confused 0.8%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 98.5%
Happy 84.4%
Calm 9.9%
Surprised 6.6%
Fear 6.1%
Sad 2.3%
Confused 1.9%
Disgusted 1.2%
Angry 0.9%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Baby
Suit
Person 98.8%
Person 98.5%
Person 98.3%
Person 91.5%
Adult 98.8%
Adult 98.5%
Adult 98.3%
Male 98.8%
Male 98.5%
Male 98.3%
Man 98.8%
Man 98.5%
Man 98.3%
Baby 91.5%
Suit 77.4%

Categories

Imagga

paintings art 59.7%
people portraits 31.4%
food drinks 7.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of people standing around a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image appears to be a photographic negative showing a group of individuals in close proximity. Two visible figures are engaged in an apparent conversation or interaction, with one person wearing a cap and the other appearing to gesture or touch their face. The background is dimly lit, with faint structures or objects visible. The overall composition suggests an informal or candid moment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a black and white negative photograph depicting a group of individuals engaged in an apparent conversation or interaction. One person in the center is wearing a hat and is holding his hand near his head, possibly in a gesture of thought or attention. To the right of this individual, another person is visible, also wearing a hat, with their hand raised to their mouth as if in the midst of speaking or intently listening. The scene appears to take place outdoors, possibly at night or in low-light conditions given the darker background, and the people are likely engaged in a communal or social activity.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting three individuals wearing masks or coverings on their faces. The masks or coverings appear to be distorted or exaggerated, creating an unsettling or eerie atmosphere. The individuals are shown in close proximity, suggesting some kind of interaction or scene. The overall impression is one of a surreal, unsettling, and potentially unsettling nature.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a medical or surgical setting. The image shows what appears to be medical personnel, likely surgeons or medical students, looking upward. They are wearing surgical attire including what seems to be scrubs and surgical caps. The lighting creates a dramatic effect with strong contrasts between light and shadow on their faces. The image has an artistic quality to it, capturing an intense moment of concentration or observation. According to the citation at the bottom, this photograph is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of four individuals, likely students, engaged in conversation. The person on the left is wearing a dark shirt and a baseball cap, with their mouth open as if speaking. The individual in the center is dressed in a dark shirt and a light-colored hat, with their right hand raised to their head. The person on the right is wearing a dark shirt and a dark hat, with their mouth open as if speaking. Behind them stands another person, partially obscured by the group in the foreground.

In the background, a blurry view of a room or hallway is visible, suggesting that the photograph was taken indoors. The overall atmosphere of the image appears to be one of casual conversation and camaraderie among friends or classmates.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of four men, with the man on the left wearing a dark-colored shirt and a baseball cap. The man in the middle is wearing a light-colored shirt and has his hand on his forehead. The man on the right is wearing a dark-colored shirt and a hat. There is another man standing behind them, but only his torso is visible.

In the bottom-left corner of the image, there is a copyright notice that reads "© President and Fellows of Harvard College (Harvard University Art Museums)". In the bottom-right corner, there is a number that reads "P1970.4164.0000".

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

A black-and-white photo of four people wearing hats and shirts is displayed on a black background. The man in the middle is looking at something with his hand on his forehead. The man on the right is holding a cigarette in his mouth. The man on the left is looking at the man in the middle. Behind them is a blurry background of a person standing and a structure.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white image shows three men in front of a mirror. The man on the left is smiling, while the man in the middle is holding his head with his left hand. The man on the right is holding something in his mouth. Behind them is another person wearing a hat and a white shirt with a belt. The image has a watermark at the bottom that reads "P19704164.0000".

Google Gemini

Created by gemini-2.0-flash on 2025-05-25

Here is a description of the image:

This is a black and white inverted image featuring four people. The most prominent person is on the left, a man with a balding head, looking slightly upward with his mouth open, as if speaking or reacting to something. He's dressed in a dark, collared shirt or jacket.

Behind him stands another person, possibly a woman, with a scarf or draped cloth around the neck and shoulders. The person is wearing what seems to be a buttoned shirt.

To the right, there are two other individuals. The person in the middle is wearing a cap and appears to be looking down, touching his forehead with his hand. The person on the far right is also wearing a cap and is seen from the side, with a hand raised to the mouth, perhaps in a gesture of contemplation.

The image seems to be a snapshot of a moment, capturing different expressions and poses, suggesting an interaction or conversation among these people. The inverted tones give the picture a surreal, almost dreamlike quality.

Created by gemini-2.0-flash-lite on 2025-05-25

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white negative of a group of four people. The composition appears to be capturing a moment of interaction or conversation. The tone is somewhat dramatic due to the negative image effect, enhancing contrasts and creating a sense of depth and texture.

Key Elements:

  • Foreground: There are three figures in focus. The one in the leftmost part of the image is a man facing slightly toward the right. The man in the center is holding his hand up to his head. The man on the right side is facing the man in the center and has his hands close to his mouth.
  • Background: A fourth person is standing in the background partially obscured by the others.
  • Lighting and Contrast: The negative effect gives the image high contrast. The light is highlighting the faces of the men in the foreground, helping to emphasize their expressions.
  • Setting: The exact setting isn't entirely clear, but the presence of multiple people suggests a social or public space.
  • Text/Metadata: There is some text visible at the bottom indicating the source of the image.

Overall, the image captures a moment of interaction between the subjects with a dramatic effect.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring a group of four individuals. They appear to be in a casual setting, possibly a social gathering or a candid moment. Here are some detailed observations:

  1. Individuals:

    • The person on the far left is wearing a cap and a jacket. They have a surprised or animated expression, with their mouth open and eyes wide.
    • The second person from the left is partially obscured by the first person. They are wearing a jacket and have a somewhat neutral expression.
    • The third person, near the center, is wearing a cap and a jacket. They are holding their head with one hand, possibly indicating a gesture of thought or fatigue.
    • The fourth person on the far right is wearing a cap and appears to be smiling or laughing, with their mouth open.
  2. Setting:

    • The background is dark, suggesting an indoor environment with low lighting.
    • There are some indistinct objects and possibly other people in the background, but they are not clearly visible.
  3. Mood:

    • The overall mood of the image seems light-hearted and casual, with the individuals appearing relaxed and engaged in conversation or shared amusement.
  4. Photographic Style:

    • The photograph has a grainy quality, which is characteristic of older film photography.
    • The lighting is uneven, with the faces of the individuals being more illuminated than the background.

The image captures a moment of camaraderie and interaction among the group, providing a snapshot of their expressions and gestures.

Text analysis

Amazon

Harvard
College
Art
and
University
(Harvard
of
President and Fellows of Harvard College (Harvard University Art Museums)
Fellows
Museums)
President
P1970.4164.0000

Google

President and Fellows of Harvard College (Harvard University Art Museums) P1970.4164.0000
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4164.0000