Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4183

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4183

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 100
Baseball Cap 100
Cap 100
Clothing 100
Hat 100
Face 94.6
Head 94.6
Body Part 92.2
Finger 92.2
Hand 92.2
Pottery 84.3
Team 79.6
Sitting 57.7
Sphere 56.1
Baseball 55.5
Baseball Glove 55.5
Glove 55.5
Sport 55.5
Basketball 55.2

Clarifai
created on 2018-05-10

people 99.9
group 99
group together 97.7
adult 97.6
man 96.7
several 93.2
wear 91.3
three 91.2
portrait 90.8
facial expression 89.6
woman 89.4
music 88.2
leader 88.1
monochrome 87.2
two 86.5
four 86
actor 85.5
many 85
administration 83.2
vehicle 79.4

Imagga
created on 2023-10-06

stringed instrument 29.7
man 28.9
musical instrument 27.5
male 24.8
person 23.1
black 18.2
bowed stringed instrument 18
people 17.8
adult 17.6
guitar 16.7
acoustic guitar 16.5
violin 15.7
portrait 14.9
men 12.9
passenger 12.2
antelope 11.8
body 11.2
canyon 10.6
art 10.2
lifestyle 10.1
hand 9.9
sexy 9.6
model 9.3
face 9.2
attractive 9.1
barroom 8.7
light 8.7
senior 8.4
studio 8.4
old 8.4
sculpture 8.3
suit 8.2
one 8.2
music 8.1
working 7.9
businessman 7.9
love 7.9
rock 7.8
hat 7.7
scholar 7.5
fashion 7.5
tourism 7.4
musician 7.4
color 7.2
job 7.1
look 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.4

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 25-35
Gender Female, 75.4%
Happy 41.8%
Fear 38.2%
Sad 12.6%
Calm 8.2%
Surprised 6.7%
Disgusted 0.8%
Angry 0.6%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Female, 65.2%
Calm 93.7%
Surprised 7.8%
Fear 6.1%
Sad 2.2%
Happy 1.9%
Disgusted 0.4%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 85.5%
Happy 35.4%
Calm 31.6%
Surprised 24.9%
Fear 6.6%
Sad 5.1%
Confused 2.4%
Angry 2%
Disgusted 1.7%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man

Clarifai

Man
Clothing
Human face
Human hair
Human hand
Human eye
Human nose
Poster

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.4%

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 98.6%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 98.6%

AWS Rekognition

Male 97.9%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 98.6%

AWS Rekognition

Man 97.9%

Clarifai

Man 93.6%

Clarifai

Man 92.7%

Clarifai

Man 91.6%

Clarifai

Man 90.8%

Clarifai

Clothing 92.2%

Clarifai

Clothing 69.1%

Clarifai

Clothing 64%

Clarifai

Human face 86.5%

Clarifai

Human face 86.4%

Clarifai

Human face 77.9%

Clarifai

Human face 76.8%

Clarifai

Human face 71%

Clarifai

Human hair 39.8%

Clarifai

Human hair 37.8%

Clarifai

Human hand 38.1%

Clarifai

Human hand 34.3%

Clarifai

Human hand 33.2%

Clarifai

Human eye 35.4%

Clarifai

Human nose 34.2%

Clarifai

Poster 33.5%

Categories

Imagga
created on 2023-10-06

food drinks 61.4%
paintings art 19.5%
people portraits 15.1%
events parties 2.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of boys sitting on a bench with a basketball ball

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of a group of men sitting on a bench

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a group of individuals sitting closely together, wearing casual clothing like shirts and tank tops. One person is holding a basketball. The setting includes steps or seats, with a brick wall visible in the background. The image appears to be in a negative format, with inverted colors creating a striking visual effect.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a negative photograph depicting a group of young people sitting closely together on a bench. One individual is holding a basketball. The setting appears to be casual, and the clothing style suggests a possible mid-20th-century timeframe, as indicated by the shirts and caps worn by the individuals. The lighting and shadows are characteristic of a photographic negative, creating a distinctive contrast between light and dark areas.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image depicts a group of people wearing black robes and hats, gathered together in what appears to be a formal or ceremonial setting. They are seated and seem to be engaged in some kind of activity or ritual. The image is in black and white, giving it a somber and dramatic tone. The individuals' faces are visible, but I will not identify or name any of them specifically, as per the instructions provided.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white photograph shows a group of five young men sitting together on some steps or bleachers, likely at a sports field or stadium based on the setting. They are all smiling and laughing together, appearing to be having a good time in each other's company. The men are wearing casual athletic clothing like tank tops and shorts, further suggesting they may be athletes or spectators at a sporting event. The camaraderie and joy on their faces captures a moment of shared happiness and friendship among the group.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph that appears to be from a historical collection at Harvard University. The image shows several people in a line or row, all wearing what appear to be light-colored uniforms or similar clothing. They are looking down at something, possibly examining or working on an object together. The lighting in the photograph creates a dramatic effect, with strong highlights and shadows. The image has a documentary or educational quality to it, suggesting it might be from a training or teaching situation. The composition draws the viewer's attention to their hands and whatever they are collectively focusing on, though the actual object of their attention is not clearly visible in the frame.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of young men sitting on a bench, with one of them holding a basketball. The photo appears to be from the early 20th century, possibly taken in the 1920s or 1930s.

  • The young men are all wearing casual clothing, including shirts, pants, and hats.
    • They are all looking at each other and smiling, suggesting that they are friends or teammates.
    • One of the men is holding a basketball, which suggests that they may be a basketball team.
  • The background of the photo is out of focus, but it appears to be a gymnasium or sports facility.
    • There are bleachers in the background, which suggests that the photo was taken during a game or practice.
    • The walls of the gymnasium are made of brick, which was a common material used in sports facilities during the early 20th century.

Overall, the image suggests that the young men in the photo are a group of friends or teammates who enjoy playing basketball together. The photo may have been taken during a game or practice, and it provides a glimpse into the lives of young men during the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of five men sitting on a bench, with the man in the center holding a basketball. The men are dressed in casual attire, including shirts and pants, and appear to be engaged in conversation or laughter. The background of the image is not clearly visible, but it appears to be a brick wall or other structure.

The overall atmosphere of the image suggests a relaxed and informal setting, possibly a sports team or group of friends gathered together. The presence of the basketball and the men's casual clothing supports this interpretation. The image may have been taken in the early 20th century, given the style of clothing and the black-and-white format.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of five people sitting on a bench, perhaps posing for a photograph. They are all wearing similar clothes, including a short-sleeve shirt and a hat. The man on the left is holding a basketball, and the man next to him is looking at him. The man in the middle is looking at something on the right side. The man on the right is looking at the man in the middle.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of men sitting together, possibly on a bench or a similar seating arrangement. They are all wearing uniforms, suggesting they are part of a sports team. Three of them are wearing caps. Two of them are wearing sleeveless shirts, while the other three are wearing long-sleeved shirts. One of them is holding a basketball, and another one is holding a bottle.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

Here is a description of the image:

The image is a black and white negative of a group of five young men sitting together. The first man on the left has short hair, a collared shirt, and is smiling. The second man wears a sleeveless top and smiles as he holds a basketball. The third man has a cap, and he also smiles as he looks to the right. The fourth man is wearing a cap and collared shirt and also looks to the right. The man on the far right looks forward. All five appear to be sitting in the same row, wearing similar casual clothing, and the atmosphere seems relaxed. In the background is a stone wall. At the bottom of the image is the following text: "© President and Fellows of Harvard College (Harvard University Art Museums)". To the far right of that text is the code "P1970.4183.0000".

Created by gemini-2.0-flash-lite on 2025-06-04

Here's a description of the image:

Overall Impression:

The image is a black and white, negative photograph, giving it a reversed color scheme (light areas appear dark and vice-versa). It depicts a group of five young men sitting on what appears to be a bench or bleacher. They are engaged in some activity, likely chatting and interacting, with a basketball prominently held by one of them.

Detailed Description:

  • Subject Matter: The focus is on the five young men, all looking to be in their late teens or early twenties. They are all dressed in casual clothing, some wearing open shirts, undershirts, and what looks like trousers or light-colored pants. One is wearing a cap.

  • Composition: The composition is horizontal, with the men arranged across the frame. The lighting emphasizes their faces and hands, drawing the viewer's eye to their expressions and interactions. The basketball is a key element, held in the center, suggesting a shared activity or pastime.

  • Mood/Atmosphere: The image has a sense of casual camaraderie and youthful energy. The smiles and relaxed postures of the men suggest they are enjoying each other's company.

  • Background: The background appears to be a simple brick or stone wall, possibly outdoors, creating a somewhat indistinct environment, which allows the subjects and the ball to take center stage.

  • Technical Aspects: The use of the negative effect enhances the contrast and gives the image a unique, slightly surreal quality. The clarity and details visible, despite the reverse coloring, suggest a good level of focus and detail in the original capture.

In summary, this is a candid shot capturing a moment of leisure and friendship among a group of young men, possibly students or athletes, giving a glimpse into their social interactions.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This black-and-white photograph depicts a group of five young men sitting on a bench, seemingly in a relaxed and jovial mood. They are dressed in casual clothing, typical of the mid-20th century, including button-up shirts, jackets, and caps. The men are smiling and appear to be engaged in conversation or enjoying a shared moment. The image has a vintage quality, suggesting it was taken several decades ago. The background is somewhat blurred, but it seems to be an outdoor setting with a brick wall or building behind them. The photograph is part of the collection of the President and Fellows of Harvard College, specifically the Harvard University Art Museums. The overall atmosphere of the image is one of camaraderie and youthful exuberance.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black and white photograph depicting a group of individuals, seemingly engaged in a casual and lighthearted moment. They appear to be sitting on a bench or a similar structure, and some of them are interacting with a basketball, which is prominently visible in the foreground. The individuals are dressed in casual attire, with some wearing hats, which suggests a relaxed and informal setting. The expressions on their faces and body language suggest camaraderie and enjoyment. The background shows a simple, unadorned brick wall, adding to the candid and unposed nature of the scene. The photograph captures a sense of nostalgia, possibly from a past era, and is attributed to the Harvard University Art Museums.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph of a sculpture depicting a group of young people sitting on a bench. The sculpture is highly detailed and realistic, capturing the expressions and body language of the figures. The central figure is holding a basketball, suggesting a theme related to sports or teamwork. The figures are dressed in casual clothing, with some wearing hats. The lighting in the photograph highlights the texture and contours of the sculpture, emphasizing its three-dimensional form. The background appears to be a brick wall, adding to the overall composition. The image is credited to the President and Fellows of Harvard College and the Harvard University Art Museums.

Text analysis

Amazon

Fellows
Harvard
College
of
Museums)
and
Art
University
President and Fellows of Harvard College (Harvard University Art Museums)
(Harvard
P1970.4183.0000
President

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4183.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4183.0000