Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4117

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4117

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Photography 100
Body Part 99.9
Finger 99.9
Hand 99.9
Tripod 99
Person 98.7
Face 98.6
Head 98.6
Portrait 98.6
Person 96.9
Baby 96.9
Person 96.7
Person 96
Adult 96
Male 96
Man 96
Person 94.7
Adult 94.7
Male 94.7
Man 94.7
Person 93.4
Person 93
Adult 93
Male 93
Man 93
Person 90.2
Back 76.4
Computer 68
Electronics 68
Laptop 68
Pc 68
Architecture 63.7
Building 63.7
Classroom 63.7
Indoors 63.7
Room 63.7
School 63.7
Crowd 60.5
Clothing 57.3
T-Shirt 57.3
Brush 56.6
Device 56.6
Tool 56.6
Canvas 55.8
Photographer 55.5

Clarifai
created on 2018-05-10

people 99.6
man 95.3
adult 94.6
monochrome 94.4
group 92.3
woman 92.2
portrait 90.1
wear 87.6
one 86.8
group together 86.6
music 86.3
street 85.5
indoors 82.9
administration 82.2
child 78.8
leader 78.3
two 77.9
chair 76.5
war 74.8
facial expression 73.8

Imagga
created on 2023-10-06

passenger 60.3
man 39
male 29.1
people 29
person 28.3
adult 24.6
portrait 19.4
face 18.5
senior 17.8
sitting 16.3
happy 16.3
seat 15.6
men 15.4
plane seat 15
indoors 14.9
home 14.4
love 14.2
couple 13.9
old 13.9
smile 13.5
lifestyle 13
smiling 12.3
looking 12
retired 11.6
black 11.4
mature 11.2
work 11.1
hospital 10.9
grandfather 10.9
retirement 10.6
elderly 10.5
one 10.4
room 10.3
expression 10.2
hairdresser 9.7
husband 9.5
hair 9.5
happiness 9.4
shop 9.2
child 9.2
inside 9.2
attractive 9.1
human 9
handsome 8.9
family 8.9
job 8.8
working 8.8
support 8.7
women 8.7
day 8.6
wife 8.5
head 8.4
house 8.4
alone 8.2
aged 8.1
barbershop 8
kid 8
business 7.9
together 7.9
pensioner 7.8
affection 7.7
worker 7.6
casual 7.6
illness 7.6
hand 7.6
light 7.3
device 7.3
computer 7.2
interior 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.4

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 31-41
Gender Male, 86.9%
Calm 74.2%
Sad 13.2%
Fear 9.7%
Surprised 6.7%
Happy 0.9%
Confused 0.8%
Disgusted 0.8%
Angry 0.8%

AWS Rekognition

Age 36-44
Gender Female, 60.2%
Calm 99%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0%
Angry 0%
Disgusted 0%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Baby
Adult
Male
Man
Person 98.7%
Person 96.9%
Person 96.7%
Person 96%
Person 94.7%
Person 93.4%
Person 93%
Person 90.2%
Baby 96.9%
Adult 96%
Adult 94.7%
Adult 93%
Male 96%
Male 94.7%
Male 93%
Man 96%
Man 94.7%
Man 93%

Categories

Imagga

pets animals 97.4%
nature landscape 2.6%

Captions

Microsoft
created by unknown on 2018-05-10

a group of people sleeping on the floor 28.5%
a group of people in a room 28.4%

Clarifai
created by general-english-image-caption-blip on 2025-05-31

a photograph of a man is painting a picture on a wall -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image appears to depict a scene of artistic activity in a reversed color scheme, resembling a photographic negative. A central figure is actively engaged in painting or drawing on a canvas positioned on an easel. Surrounding the artist are individuals wearing varied clothing, standing in close proximity and observing the ongoing work. The composition conveys a sense of interaction and focus within a creative or communal environment.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image appears to be a negative photograph featuring a scene with several individuals in a casual setting. One person is seated in the foreground, holding a brush or similar tool and is positioned in front of an easel or drawing board, suggesting they may be engaged in some form of art or sketching. The setting seems informal, with people casually standing around, some with their arms crossed or touching their faces. The environment has a dynamic feel, as if capturing a moment of concentration or creative activity.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting a group of people in a crowded, chaotic scene. In the foreground, there is a person wearing a striped shirt who is facing away from the camera. The background is blurred, but it seems to show other people in the scene. The overall impression is one of a busy, dynamic environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a historical collection at Harvard University, as indicated by the credit line. The image shows what appears to be a group of people standing in a line or formation. The lighting creates strong contrasts between light and shadow, giving the image a dramatic quality. The figures are wearing what look like light-colored shirts or uniforms, and there's a particular focus on one person in darker striped clothing in the foreground. The composition has an interesting depth to it, with the figures seeming to recede into the background. The image has a documentary or archival quality typical of institutional photography from an earlier era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a man painting on an easel, with a crowd of people in the background. The man is wearing a striped shirt and has short hair. He is leaning over the easel, intently focused on his work. The easel is positioned at an angle, with the canvas facing the viewer.

In the background, there are several people standing around, some of whom appear to be watching the man paint. They are dressed in casual clothing, and their faces are blurred. The overall atmosphere of the image suggests that the man is creating art in a public setting, possibly at an event or exhibition.

The image has a copyright notice in the bottom-left corner, which reads "© President and Fellows of Harvard College (Harvard University Art Museums)". This indicates that the photograph is part of a collection owned by the Harvard University Art Museums. In the bottom-right corner, there is a numerical code "P1970.4117.0000", which likely corresponds to the museum's cataloging system.

Overall, the image presents a captivating scene of artistic creation, with the man's focus and concentration drawing the viewer's attention. The presence of the crowd in the background adds a sense of community and shared experience to the image, highlighting the importance of art in bringing people together.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man painting on an easel, with a group of people watching him in the background. The man is wearing a striped shirt and has short hair. He is holding a paintbrush in his right hand and appears to be focused on his work.

In the background, there are several people standing around the man, watching him paint. They are all wearing casual clothing and seem to be interested in what he is doing. Some of them are leaning forward, as if they are trying to get a closer look at the painting.

The overall atmosphere of the image suggests that the man is giving a demonstration or lesson on painting, and the people in the background are his students or observers. The image conveys a sense of creativity and learning, and it appears to be a moment of artistic expression and appreciation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

A black-and-white photograph shows a person sitting on a chair and painting on a canvas. The person is wearing a striped shirt. Behind him, a few people are standing, and one of them is holding a pen in his hand. The person in front of him is holding a pen in his hand and seems to be looking at the person painting. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" on the bottom left.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black and white image shows a man painting on a canvas while sitting on a chair. He is wearing a striped shirt and looking at the canvas while holding a paintbrush. Behind him, several people are standing, and some are wearing hats. One of them is holding a paint palette. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" on the bottom left.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

Here is a description of the image:

This appears to be a black and white negative image of a group of people. The main focus is on a person in the foreground, who is drawing or painting at an easel. The person is turned in profile, with their back towards the viewer, and is wearing a striped shirt. They are holding a paintbrush. There are other people in the background, seemingly observing or participating in the same activity. The image is underexposed, making it difficult to discern details, but it appears to be an art class or some similar activity. The image is grainy, suggesting an older photograph.

Created by gemini-2.0-flash on 2025-05-31

The image is a black and white photo of a group of people, seemingly in an art studio or class setting. In the foreground, a person with short hair, possibly male, is focused on an easel, painting with a brush. The individual is wearing a striped shirt. Behind them, there are several other people, some standing and looking at the artwork being created. There's also what appears to be an art supply box or case on a surface behind the artist. The image is inverted.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting an art class or workshop. The central figure is a young person wearing a striped shirt, who appears to be working on a piece of art on an easel. The individual is holding a brush and seems to be deeply focused on their work.

Surrounding the central figure are several other people, likely fellow students or participants in the class. Some are standing and observing, while others are also engaged in artistic activities. The environment looks like a studio or classroom, with various art supplies and materials visible. The overall atmosphere suggests a collaborative and creative learning environment. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Text analysis

Amazon

Harvard
College
and
Art
University
(Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
Fellows
of
Museums)
President
P1970.4117.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4117.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4117.0000