Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4116

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4116

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Body Part 99.6
Finger 99.6
Hand 99.6
People 97.3
Person 97.1
Crowd 97
Person 96.1
Person 95.5
Adult 95.5
Male 95.5
Man 95.5
Person 93.2
Baby 93.2
Person 92.5
Person 92.4
Face 89.2
Head 89.2
Box 87.1
Person 84.8
Person 80.7
Adult 80.7
Male 80.7
Man 80.7
Person 78.3
Person 76.9
Person 74.3
Person 73.7
Baby 73.7
Person 73.5
Audience 68.8
Cross 63.1
Symbol 63.1
Person 61.8
Outdoors 61.6
Back 57.9
Cardboard 56.8
Carton 56.8
Funeral 55.3

Clarifai
created on 2018-05-10

people 99.9
group 98.6
adult 98.6
many 96.5
woman 96.1
man 95.2
child 94.1
one 93.9
furniture 93.8
group together 93.3
two 92.4
wear 91.6
administration 90.2
leader 89.5
war 88.5
portrait 86.7
military 86
seat 85.8
education 85.6
reclining 83.9

Imagga
created on 2023-10-07

cemetery 52.7
negative 27.4
structure 26.3
memorial 25
sculpture 24.1
film 23.5
fountain 21.8
gravestone 21.5
stone 21.1
architecture 19.7
statue 18.9
old 17.4
photographic paper 16.7
famous 14.9
building 12.9
water 12.7
city 12.5
art 12.4
column 12.4
people 12.3
travel 12
culture 12
ancient 11.2
photographic equipment 11.1
traditional 10.8
religion 10.7
history 10.7
marble 10.6
sky 10.2
obelisk 10.2
historic 10.1
outdoor 9.9
monument 9.3
fence 9.1
landmark 9
detail 8.8
picket fence 8.7
black 8.4
house 8.4
tourism 8.2
human 8.2
love 7.9
person 7.9
rock 7.8
face 7.8
bride 7.7
man 7.5
dress 7.2
home 7.2
river 7.1
adult 7.1
sand 7.1
day 7.1
life 7

Google
created on 2018-05-10

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 30-40
Gender Male, 98.4%
Calm 82.9%
Sad 9.7%
Surprised 6.5%
Fear 6.2%
Happy 2%
Angry 1.5%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 16-22
Gender Female, 69.6%
Fear 29.9%
Calm 26.3%
Surprised 18.4%
Sad 14.3%
Happy 8.5%
Disgusted 3.7%
Angry 3.7%
Confused 0.7%

AWS Rekognition

Age 11-19
Gender Female, 83.2%
Happy 38.4%
Calm 32.7%
Disgusted 16.4%
Surprised 8%
Fear 6.7%
Confused 4.3%
Sad 2.6%
Angry 1.6%

AWS Rekognition

Age 22-30
Gender Male, 94.2%
Calm 96.9%
Surprised 6.3%
Fear 6.1%
Sad 2.5%
Disgusted 0.6%
Confused 0.5%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 89.5%
Sad 96.2%
Calm 33.7%
Disgusted 8.2%
Surprised 7.8%
Fear 6.3%
Confused 2.7%
Angry 1.7%
Happy 0.3%

AWS Rekognition

Age 20-28
Gender Male, 77.2%
Sad 93.5%
Calm 44%
Surprised 8.1%
Fear 7.5%
Confused 1.2%
Disgusted 1%
Happy 0.7%
Angry 0.6%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 88.6%
Surprised 6.7%
Fear 6%
Disgusted 5.4%
Happy 2.4%
Sad 2.3%
Confused 1.1%
Angry 0.5%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Baby
Person 97.1%
Person 96.1%
Person 95.5%
Person 93.2%
Person 92.5%
Person 92.4%
Person 84.8%
Person 80.7%
Person 78.3%
Person 76.9%
Person 74.3%
Person 73.7%
Person 73.5%
Person 61.8%
Adult 95.5%
Adult 80.7%
Male 95.5%
Male 80.7%
Man 95.5%
Man 80.7%
Baby 93.2%
Baby 73.7%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created by unknown on 2018-05-10

a group of people sitting on a bed 45.3%
a group of people on a bed 45.2%
a group of people in a bed 45.1%

Clarifai
created by general-english-image-caption-blip on 2025-05-31

-100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image appears to be a black-and-white negative, showing a crowd of people gathered outdoors. Many individuals seem to be raising objects above their heads, such as chairs or wooden furniture. The scene takes place at night or in dim lighting, with trees and a building visible in the background. The distorted negative effect makes the details harder to distinguish, creating an unsettling or dramatic ambiance. The image likely captures a moment of public gathering, demonstration, or chaos.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image appears to be a photographic negative, showing a group of people gathered closely together. In the foreground, several individuals are holding up pieces of furniture, particularly chairs, above their heads. The people in the image are densely packed, suggesting a gathering or event. The background shows trees and the outline of buildings, which may indicate an outdoor setting, likely at night given the negative exposure and high contrast between the subjects and the background. The expressions of the people are not clear due to the nature of the negative, but they seem to be involved in some collective activity or demonstration.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

This image is a black and white photograph of a crowd of people, with a large sculpture in the foreground. The sculpture appears to be made of stone or metal and features geometric shapes, including a large "M" and a cross-like structure. The crowd is gathered around the sculpture, with some people looking at it intently while others seem to be engaged in conversation.

In the background, there are trees and buildings visible, suggesting that the scene is taking place outdoors in an urban setting. The overall atmosphere of the image is one of curiosity and interest, as the crowd gathers to examine the sculpture.

The image has a copyright notice at the bottom, which reads "© President and Fellows of Harvard College (Harvard University Art Museums)". This suggests that the image is part of a collection held by the Harvard University Art Museums, and may have been taken by a photographer affiliated with the museum.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of a group of people gathered around a large sculpture. The sculpture appears to be made of stone or concrete and features a geometric design with sharp angles and points.

  • Sculpture:
    • Made of stone or concrete
    • Geometric design with sharp angles and points
    • Large size, possibly several feet tall
  • People:
    • Gathered around the sculpture
    • Some are standing, while others are sitting or leaning against the sculpture
    • They appear to be admiring or examining the sculpture
  • Background:
    • Trees and buildings can be seen in the distance
    • The sky is dark, suggesting that the photo was taken at night or in low light conditions
  • Overall:
    • The image conveys a sense of community and appreciation for art
    • The people in the photo seem to be enjoying the sculpture and each other's company

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white photo depicts a crowd of people gathered around a large sculpture. The sculpture is made of wood and has a geometric design with sharp edges. The crowd is gathered closely around the sculpture, and some people are touching it. The people in the crowd are dressed in various clothing styles, including hats and glasses. In the background, there are trees and a building.

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image depicts a group of people gathered in an outdoor setting, possibly a park or a public space. The photo is black and white, adding a sense of nostalgia or historical context. The people in the image are engaged in some kind of activity, possibly a performance or a demonstration. Some of them are holding wooden structures or props, which they appear to be using in their activity. The group is somewhat dense, with people standing closely together. In the background, there are trees and a fence, suggesting a natural or semi-urban environment.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

Here is a description of the image:

The image is a black and white photograph featuring a crowd of people in the foreground, with trees and a building visible in the background. A group of people is carrying large, geometric objects or structures that partially obscure the view of the crowd behind them. The objects appear to be made of flat, possibly wooden, panels. Two figures, possibly officials or uniformed personnel, stand out in the background behind the crowd. They appear to be wearing hats or caps and uniforms, and their presence suggests an official event or gathering. The photograph's contrast and texture indicate it may be a vintage print or a reproduction of a historical image.

Created by gemini-2.0-flash-lite on 2025-05-29

Here's a description of the image:

Overall Impression: The image appears to be a negative print of a historical photograph, showing a crowd of people and some large, geometric structures being held up by hands. The scene is somewhat unclear due to the negative print and the close-up perspective, but the composition suggests a public event or demonstration.

Key Elements:

  • Crowd: A large group of people are visible in the foreground. Their faces are the most easily distinguishable due to the negative print. They seem to be looking towards the geometric structures.
  • Geometric Structures: Prominently featured are a series of large, blocky, white structures. These appear to be made of wood or a similar material. Their shapes are irregular and abstract, possibly part of a larger construction.
  • Hands: Several hands are holding up the geometric structures.
  • Background: The background shows a line of trees and what appears to be a building in the distance. There are also some people that can be seen.

Visual Characteristics:

  • Monochromatic: The image is entirely in shades of gray, typical of a black and white negative print.
  • Contrast: The contrast is high, which further enhances the sharpness of the image.
  • Focus: The focus is primarily on the geometric structures, as well as the people.

Possible Context:

Given the visual elements, the image may depict an event involving art, construction, or a public protest or demonstration. The historical context is suggested by the negative print and the likely age of the photograph. The geometric shapes could be temporary structures or props used for a specific purpose.

Additional details:

  • The image has text at the bottom that credits "President and Fellows of Harvard College (Harvard University Art Museums)"
  • The image has text at the bottom that labels the image as "P1970.4116.0000"

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a group of people gathered outdoors at night, seemingly participating in an event or celebration. The crowd is focused on a large, intricately designed float that appears to be part of a parade. The float features a structure resembling a castle or fortress with pointed towers and a central figure, possibly a statue or effigy, dressed in historical or ceremonial attire.

The people in the crowd are dressed in what appears to be period or formal clothing, with some wearing hats. They are closely gathered around the float, suggesting a festive or ceremonial occasion. The background shows a line of trees and a dark sky, indicating that the event is taking place in the evening or night.

The photograph is credited to the President and Fellows of Harvard College, specifically the Harvard University Art Museums, suggesting it may be part of a historical or cultural archive. The image has a timestamp or identifier "P1970.4116.0000" at the bottom right corner.

Text analysis

Amazon

Harvard
College
and
University
Art
(Harvard
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
of
Museums)
President
P1970.4116.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4116.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4116.0000