Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: panels 1 and 2, north wall, "Police Line up")

Date

1934-1935

People

Artist: Walker Evans, American 1903 - 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.51

Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: panels 1 and 2, north wall, "Police Line up")

People

Artist: Walker Evans, American 1903 - 1975

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.51

Machine Generated Data

Tags

Amazon
created on 2022-04-05

Person 99.1
Human 99.1
Person 98.7
Clothing 96.8
Apparel 96.8
Person 95.7
Painting 84.3
Art 84.3
Coat 83.9
Person 82.3
Overcoat 81.8
Text 79.4
Drawing 76.7
Person 74.3
Person 62.7
Suit 61.1
Book 59.7
Military Uniform 59.5
Military 59.5
Person 56.3
Furniture 56.2
Advertisement 55.6
Person 51.6
Person 50.1

Clarifai
created on 2023-10-14

people 99.9
adult 98.7
group 98.5
sepia pigment 98.2
vintage 98
art 97.6
two 97.6
man 97.5
print 96.8
wear 96.5
sepia 93.2
portrait 91.9
train 91.8
street 91.2
illustration 90.9
retro 90.4
three 89.4
veil 88.3
woman 87.9
one 87.2

Imagga
created on 2022-04-05

statue 57.8
sculpture 47
architecture 39.3
art 30.9
monument 29
stone 28.6
ancient 28.5
building 26.1
history 25.9
old 25.8
landmark 25.3
structure 25.2
fountain 24.3
marble 23.3
historic 22
travel 21.8
historical 21.6
tourism 21.5
sketch 20.5
famous 20.5
religion 19.7
culture 18.8
city 18.3
carving 17.4
drawing 17.4
god 17.2
temple 17
antique 15.2
column 14.1
representation 13.8
church 13
vintage 12.4
facade 12.3
detail 12.1
memorial 12
money 11.9
tourist 11.8
paper 11.8
arch 11.4
statues 10.8
palace 10.8
religious 10.3
dollar 10.2
cash 10.1
currency 9.9
figure 9.6
spirituality 9.6
bank 9
cathedral 8.8
baroque 8.8
symbol 8.8
catholic 8.8
architectural 8.7
attraction 8.6
roman 8.5
finance 8.4
decoration 8.4
cemetery 8
mythology 7.9
heritage 7.7
us 7.7
holy 7.7
brass 7.7
rich 7.4
banking 7.4
water 7.3
ornate 7.3

Google
created on 2022-04-05

Microsoft
created on 2022-04-05

drawing 99.2
sketch 98.6
clothing 93.7
old 92.1
text 91.7
person 90.2
outdoor 87.3
cartoon 86.7
man 71.8
white 66.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 41.9%
Sad 25.3%
Angry 10%
Confused 9.4%
Disgusted 6.3%
Fear 3%
Surprised 2.1%
Happy 2%

AWS Rekognition

Age 43-51
Gender Male, 92.8%
Calm 99.4%
Angry 0.3%
Surprised 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 72.7%
Confused 75.2%
Calm 8%
Happy 7.8%
Fear 2.8%
Surprised 2.4%
Angry 1.6%
Sad 1.2%
Disgusted 1%

AWS Rekognition

Age 24-34
Gender Male, 66.3%
Calm 48.1%
Confused 26.1%
Sad 15.4%
Angry 4.5%
Fear 2.1%
Surprised 1.3%
Happy 1.3%
Disgusted 1.2%

AWS Rekognition

Age 16-24
Gender Male, 98.1%
Calm 40.2%
Sad 39.8%
Fear 6.1%
Angry 4.5%
Disgusted 3.8%
Confused 2.4%
Surprised 1.6%
Happy 1.5%

AWS Rekognition

Age 10-18
Gender Male, 93.6%
Fear 43.4%
Calm 18.9%
Sad 12.5%
Confused 10.7%
Surprised 5.5%
Angry 4%
Happy 3.2%
Disgusted 1.8%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Fear 54.2%
Happy 21%
Sad 7.8%
Calm 6.3%
Angry 5.9%
Disgusted 2.5%
Confused 1.3%
Surprised 1%

AWS Rekognition

Age 19-27
Gender Female, 81.5%
Sad 52.2%
Happy 21.7%
Calm 16.2%
Fear 4.2%
Angry 3.1%
Confused 1%
Surprised 0.9%
Disgusted 0.7%

AWS Rekognition

Age 25-35
Gender Female, 98.9%
Calm 75.5%
Confused 20.8%
Angry 1.2%
Sad 0.7%
Fear 0.6%
Surprised 0.6%
Happy 0.4%
Disgusted 0.3%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.1%
Person 98.7%
Person 95.7%
Person 82.3%
Person 74.3%
Person 62.7%
Person 56.3%
Person 51.6%
Person 50.1%
Painting 84.3%

Categories

Imagga

paintings art 99%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-02

The image depicts a detailed drawing of a scene with various elements indicative of law enforcement, justice, and criminal activity. On the left side, there is a building resembling a courthouse with the phrase "THE TRUE ADMINISTRATION OF JUSTICE IS THE FIRMEST PILLAR OF GOOD" inscribed on it. Below this building, a table or counter is present, staffed with individual seated figures reviewing images of people, possibly suspects or convicts. In the center of the image, under bright lights reminiscent of interrogation or mugshot lights, there are two men in long coats standing on a small platform. There is a height measurement stick next to them, suggesting that they are being processed or identified. This scene implies a lineup or similar identification process. To the right, another figure is seen in full profile within a narrow space, next to posters that read "CHILD KILLER," "GUNMAN," and "RACKETEER" with target silhouettes of these criminal types. A group of figures appears in the background outside of a building, implying a crowd or a gathering, possibly employees or law enforcement officers given the historical context. Finally, the area beneath the platform where the men are standing is depicted with dark shadows and a view of figures lying down, possibly representing captured or deceased individuals within the darker side of the criminal justice world. Overall, the image presents a profound commentary on the justice system and the ways in which suspects were processed historically.

Created by gpt-4 on 2024-11-15

This image is an artwork that depicts an elaborate scene consisting of different panels and sections, each representing a unique setting or concept. The art piece is characterized by sepia and earthy tones, with many intricate details: - On the left, we see a classic building that appears to resemble a government edifice with columns, and a sign that includes text related to the administration of justice. In front of this building, there's a display case with portraits of individuals, arranged in rows, potentially signifying important figures or historical persons. - Center stage features two figures in business suits with their faces unidentifiable. They seem to be standing on a platform that has a ruler along its left edge, indicating measurement or perhaps metaphorically signifying judgment or evaluation. Underneath the platform, there appears to be a space that suggests confinement or perhaps a holding cell, given the barred enclosure and the figures within it. - To the right, there's a wall with printed words "CHILD KILLER?", "GUNMAN", and "RACKETEER", each positioned above respective outlines of a human figure, which implies a categorization of criminal types or accusations. A figure is standing beside this wall, facing away, and wearing a hat, possibly watching or guarding. - In the background, partially obscured by the central platform, buildings evoke a cityscape, with a dome-capped structure reminiscent of a religious or governmental building. A group of figures is gathered there, possibly signifying a public assembly or a queue. The entire composition conveys a theme of societal structures, justice, and perhaps the categorization and judgment of individuals within a system. The distinct architectural elements, symbols, and use of space all contribute to a sense of narrative or commentary the artist may be implying about social organization and roles.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a historical illustration depicting what seems to be a scene related to organized crime or corruption in an urban setting. The artwork shows two men in long coats standing on what appears to be a stage or platform, with various elements in the background including a building with columns, target-like figures labeled "GUNMAN" and "RACKETEER," and a domed structure. Below the platform are what appear to be scattered newspapers or documents. The style suggests this might be from the Prohibition era or early 20th century, possibly a political cartoon or commentary on crime and corruption of that period. The sepia-toned or monochromatic artwork has a stark, dramatic quality typical of editorial illustrations of that era.

Created by claude-3-haiku-20240307 on 2024-11-14

The image appears to be a detailed illustration or drawing depicting a scene in what looks like a city street or urban setting. The central focus is on two men standing together, dressed in suits and overcoats, suggesting they are likely businessmen or professionals of some kind. In the background, there are various architectural elements, such as buildings, storefronts, and signage, as well as a crowd of people in the distance. The overall style of the illustration has a vintage or historical feel to it, with the use of sepia tones and the detailed, almost sketched-like rendering of the scene.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image is a black-and-white drawing of a scene with two men standing on a platform, surrounded by various elements. The man on the left wears a long coat and a cap, while the man on the right also wears a long coat but without a cap. They stand on a wooden platform, with a microphone positioned between them. In the background, there are several other scenes depicted. On the left side, a building resembling a courthouse or government building is visible, accompanied by a display case containing images of people's faces. A man sits at a desk in front of the display case, engaged in an activity that is not clearly discernible. On the right side of the image, a bridge or walkway is shown, with people walking across it. Above the bridge, a sign reads "GUNMAN" and features a drawing of a person holding a gun. Another sign below it displays the word "PACKETEER" and includes a drawing of a person. The overall atmosphere of the image suggests that it may be related to a crime scene or a news broadcast, given the presence of the microphone and the signs indicating a gunman and a packeteer. However, without more context, it is difficult to determine the specific meaning or purpose of the image.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-01

The image is a black and white drawing of a scene depicting two men standing on a scale, with various other figures and objects in the background. The two men are standing on a wooden platform, facing each other. They are both wearing long coats and hats, and they appear to be of similar height. The man on the left has his hands in his pockets, while the man on the right has his hands by his sides. Between them is a tall scale with a round dial at the top and a long, thin beam extending from the base to the top. The scale is positioned in front of a wall with a large window, through which a crowd of people can be seen. In the background, there are several other figures and objects. To the left of the men, there is a large building with columns and a dome. To the right, there is a group of people standing in front of a brick wall. In the foreground, there is a small table with a chair behind it, and a large, ornate lamp hanging from the ceiling. Overall, the image appears to be a commentary on the relationship between two individuals, possibly representing different aspects of society or different perspectives on a particular issue. The use of a scale as a central element suggests a focus on balance, equality, or fairness, while the presence of a crowd in the background may indicate a sense of community or collective action.

Text analysis

Amazon

RACKETEER
KILLER
PILLAR
ADMINISTRATION
CE
FIRMEST
RI
THE
CHILD KILLER
OF
CHILD
GUNMAN
TRUE
THE TRUE ADMINISTRATION OF CE 's THE FIRMEST PILLAR oz GOOD
WANTED
oz
OMI
's
litter
ENE OMI
litter SUPER
GOOD
ENE
NORTH
SUPER

Google

THE TRUE ADNIINISTRATON &EJICE IS THt FIRMEST PILLAR OF GUAD CHILA KILLER RI GUNMAN RACKETEER NO HE WANTES
THE
TRUE
ADNIINISTRATON
&EJICE
IS
THt
FIRMEST
PILLAR
OF
GUAD
CHILA
KILLER
RI
GUNMAN
RACKETEER
NO
HE
WANTES