Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4184

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4184

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
People 97.6
Jacket 94.6
Person 67.4
Fashion 67.3
Person 66.6
Raincoat 57.5
City 55.5
Shirt 55.4

Clarifai
created on 2018-05-10

people 99.6
portrait 99.5
one 98.5
man 97.3
adult 96.8
lid 93.7
monochrome 93.2
wear 89.4
street 89
leader 87.1
cap 86.3
administration 81.7
outfit 78.5
veil 77.1
facial expression 76.9
old 76
coat 75.4
uniform 74.3
education 70.5
art 70.4

Imagga
created on 2023-10-06

man 46.5
male 41.9
person 37.6
portrait 36.9
face 30.5
adult 29.1
people 27.3
old 27.2
head 22.7
sculpture 22
statue 22
black 21.7
one 20.9
senior 20.6
handsome 20.5
mature 20.5
serious 19.1
bow tie 18.8
human 17.2
looking 16
art 15.6
men 15.5
grandfather 15.4
casual 15.3
expression 14.5
hair 14.3
necktie 14.1
glasses 13.9
smiling 13
happy 12.5
bust 12.4
studio 12.2
closeup 12.1
guy 11.8
model 11.7
elderly 11.5
spectacles 11.5
age 11.4
close 11.4
ancient 11.2
attractive 11.2
smile 10.7
retired 10.7
businessman 10.6
emotion 10.1
religion 9.9
older 9.7
look 9.6
antique 9.5
clothing 9.5
hand 9.1
confident 9.1
vintage 9.1
crazy 9
beard 8.8
pensive 8.8
eyes 8.6
sitting 8.6
culture 8.6
professional 8.5
business 8.5
shirt 8.5
suit 8.2
cheerful 8.1
eye 8
home 8
work 7.8
standing 7.8
garment 7.5
religious 7.5
style 7.4
camera 7.4
alone 7.3
lifestyle 7.2
gray 7.2
optical instrument 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

man 95.9
person 93.3

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 48-56
Gender Male, 99.6%
Calm 41.8%
Happy 27.1%
Surprised 13%
Fear 7%
Sad 6.5%
Confused 4.7%
Disgusted 3.3%
Angry 2.8%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Person 99.7%
Person 67.4%
Person 66.6%
Adult 99.7%
Male 99.7%
Man 99.7%

Categories

Captions

Microsoft
created by unknown on 2018-05-10

a man wearing a hat 76.9%
a man looking at the camera 76.8%
a man wearing a black hat 71.6%

Clarifai
created by general-english-image-caption-blip on 2025-05-31

a photograph of a man in a leather jacket and a leather jacket -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image appears to be a negative photographic representation. It depicts a person wearing a jacket and a cap, with the shirt collar slightly visible. The background shows a building with rectangular windows, likely part of an architectural structure, with additional elements like people faintly visible in the outdoor setting. The tones are inverted, typical of a photographic negative.

Created by gpt-4o-2024-08-06 on 2025-06-11

This image appears to be a negative photograph featuring a person wearing a coat and a hat, standing outside in front of a large building with a row of windows. The photograph has a high contrast, typical of negative imaging, which inverts the colors and tones. In the background, there are several people visible, who appear to be standing in a group. The scene seems to take place in an open area with the backdrop of a brick or stone building. The lighting suggests it might be taken during daylight, given the bright contrasts and shadows.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a close-up portrait of a person wearing a raincoat or similar outerwear. The person has a friendly, smiling expression on their face. The background appears to be a city street or urban setting, with buildings visible in the background. The image is in black and white, giving it a classic, historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a striking black and white photograph that appears to be taken at night or in low light conditions. The subject is wearing a baseball cap and what looks like a reflective or shiny raincoat. The lighting creates an unusual effect where their face appears to be illuminated or glowing. In the background, there appears to be a large building with multiple windows lit up, and some figures can be faintly seen in the distance. The image has a somewhat eerie or supernatural quality due to the lighting effects. According to the attribution, this photograph is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black and white photograph of a statue of a man in front of a building.

  • The statue is of a man wearing a cap, a jacket, and a scarf around his neck.
    • The man has short hair and is facing forward.
    • The statue appears to be made of metal or stone.
  • The background of the image is out of focus but appears to be a large building with many windows.
    • The building is likely a university or college campus.
    • There are people standing in front of the building, but they are not clearly visible.
  • The overall atmosphere of the image suggests that it was taken at night, as the lighting is dim and there are no visible shadows.
    • The image has a vintage feel to it, suggesting that it may have been taken in the past.
    • The image may have been taken for historical or archival purposes.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man standing in front of a building. The man is wearing a light-colored hat, a dark shirt, and a light-colored jacket or coat. He appears to be smiling and looking directly at the camera.

In the background, there is a large building with multiple windows and a fence in front of it. The overall atmosphere of the image suggests that it was taken during the daytime, possibly in a urban or suburban setting.

The image has a copyright notice at the bottom that reads "© President and Fellows of Harvard College (Harvard University Art Museums)" and a catalog number "P1970.4184.0000". This suggests that the image is part of a collection held by the Harvard University Art Museums.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of a man standing in front of a building. The man is wearing a hat and a long-sleeve shirt with a collar. He is smiling and looking directly at the camera. Behind him, there is a blurry image of people standing on a field, and in the distance, there is a building with several windows. The image has a watermark in the bottom right corner that reads "President and Fellows of Harvard College (Harvard University Art Museums)" and "P1970.4184.0000".

Created by amazon.nova-pro-v1:0 on 2025-06-02

The image shows a man standing in front of a building with a smile on his face. He is wearing a hat and a jacket, with a bow tie around his neck. He is looking straight ahead, possibly posing for a photograph. The background is blurred, and there are several people standing near the building. The image is in black and white, giving it a vintage look.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

Here is a description of the image:

The image is a black and white negative. In the foreground is a man wearing a cap and a scarf, along with a shirt and jacket. He appears to be smiling. Behind him is a large building with many windows. To the left of the man, in the background, there are some figures, possibly people, on a field. The overall impression is of a posed photograph taken in an outdoor setting. The clarity is not high, giving it an older, somewhat hazy, quality.

Created by gemini-2.0-flash-lite on 2025-05-29

Here's a description of the image:

Overall Impression:

The image is a black and white, likely negative, photograph. It depicts a man standing outdoors, looking directly at the camera with a slight smile. The overall tone is somewhat surreal or ghostly due to the inversion of colors.

Subject:

  • Man: The central figure is a man wearing a cap, a neckerchief, and a long coat or jacket. His features are visible, and he appears to be smiling.

Setting:

  • Background: In the background, there's a building with several windows and a dark area that might be a street. Some indistinct figures of people can be seen in the distance.

Composition:

  • The composition is a medium shot, focusing on the man's upper body and face.
  • The building in the background creates a sense of depth.

Technical aspects:

  • The image is black and white, and the colors are inverted (like a negative).
  • There are some signs of wear and tear, such as scratches or imperfections.

Overall, the image has a vintage feel, and the inverted colors give it a unique artistic quality.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a statue of a man wearing a cap and gown, which are typically associated with academic or scholarly attire. The statue appears to be outdoors, with a building in the background. The building has a classical architectural style, featuring tall windows and a symmetrical design. The scene is likely set on a university campus, given the academic attire of the statue and the architectural style of the building.

The statue itself seems to be made of a light-colored material, possibly stone or marble, and is positioned prominently in the foreground. The background shows a few indistinct figures, likely people, adding a sense of scale and context to the setting. The photograph is in black and white, which gives it a historical or vintage feel. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums), suggesting that it is part of their collection or archives.

Text analysis

Amazon

(Harvard
College
Fellows
Harvard
of
Museums)
and
Art
President and Fellows of Harvard College (Harvard University Art Museums)
University
P1970.4184.0000
President

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4184.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4184.0000