Human Generated Data

Title

Untitled (smiling clown in hat leaning on wooden crate)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11844

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (smiling clown in hat leaning on wooden crate)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11844

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.1
Human 99.1
Clothing 96.7
Apparel 96.7
Goggles 94
Accessories 94
Accessory 94
Face 89.6
Home Decor 87.9
Hat 86.1
Chair 77.8
Furniture 77.8
Portrait 70.1
Photography 70.1
Photo 70.1
Helmet 70.1
Plant 68.9
People 68.7
Wood 68
Costume 66.2
Sphere 64.2
Outdoors 59.4
Meal 59.4
Food 59.4
Sunglasses 58.1
Glasses 55.7

Clarifai
created on 2023-10-25

people 99.7
monochrome 98
one 97.9
man 97.6
portrait 97.4
adult 97.1
street 96.2
mask 93.3
veil 90.5
art 90.4
wear 88.5
lid 88.1
costume 84.5
black and white 84
woman 83.6
clown 81.4
actor 81.2
music 78.9
theater 78.7
comedy 77.5

Imagga
created on 2022-01-15

mask 100
protective covering 95
ski mask 84.5
face mask 67.5
covering 61.8
man 38.3
danger 32.8
male 32
protection 31.9
safety 26.7
person 26.7
toxic 25.4
gas 25.1
black 22.3
military 22.2
war 22.1
portrait 20.7
chemical 20.3
protective 19.5
security 19.3
radiation 18.6
nuclear 18.4
pollution 18.3
soldier 17.6
disaster 17.6
adult 17.5
respirator 16.8
radioactive 15.7
criminal 15.7
equipment 15.6
crime 15.6
human 15
environment 14.8
face 14.2
people 14
thief 13.8
dangerous 13.3
gas mask 12.9
robber 12.9
gun 12.7
weapon 12.6
disguise 12.6
uniform 12.4
ecology 11.9
burglar 11.9
professional 11.8
army 11.7
dark 11.7
air 11.1
theft 10.9
poison 10.8
holding 10.7
law 10.7
fear 10.6
hat 10
bandit 9.9
studio 9.9
gangster 9.9
steal 9.9
illegal 9.9
business 9.7
looking 9.6
biology 9.5
head 9.2
hand 9.1
clothing 9.1
suit 9
warfare 8.9
bad 8.8
horror 8.7
chemistry 8.7
men 8.6
guy 8.3
one 8.2
teenager 8.2
helmet 8.1
information 8
businessman 8
medical 8
sneak 7.9
terrorism 7.9
camouflage 7.9
boy 7.8
warrior 7.8
wearing 7.6
tie 7.6
environmental 7.5
technology 7.4
sport 7.4
hair 7.1
working 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

person 99.7
text 99.4
helmet 97.6
clothing 87.7
black and white 80.4
man 68.3
human face 58.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Male, 73.8%
Calm 39.8%
Sad 15.5%
Surprised 15.3%
Angry 8.7%
Fear 7.4%
Confused 5.3%
Disgusted 5.3%
Happy 2.7%

Feature analysis

Amazon

Person
Hat
Person 99.1%
Hat 86.1%

Categories

Imagga

paintings art 98.6%

Captions

Microsoft
created by unknown on 2022-01-15

a man wearing a hat 86.3%
a man in a hat 85.4%
an old photo of a man 83.6%

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a man in a mask mask and a mask on his face -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image appears to be a negative photograph featuring a person wearing a cap and leaning on a wooden surface, such as a fence or railing. The individual is dressed in a patterned shirt underneath a jacket or coat. The background shows an outdoor setting with several figures and objects, including signs and vehicles, suggesting a public gathering or event. The scenery includes trees and an open area.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image appears to be a black and white photograph of a person leaning against a wooden structure, possibly a fence or a railing. The person is wearing a hat and a long-sleeved coat over a striped shirt. The photograph is processed as a negative, so the colors and tones are inverted. In the background, there is a group of people, some wearing hats, and a sign is visible which seems to contain text. The scene includes trees and an open area which suggests it may be outdoors. The image has a dynamic and candid quality, capturing the person in a relaxed pose.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a man dressed in a clown costume, leaning on a wooden box. The man's attire consists of a white shirt with a striped pattern, a dark jacket, and a cap. His face is painted with a clown design, featuring a large nose, red lips, and exaggerated eyebrows.

In the background, a grassy area is visible, with several people standing around. A table with a white cloth is also present, although it is not clear what is on the table. The overall atmosphere of the image suggests that the man is participating in some sort of event or performance, possibly a circus or carnival.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a clown sitting on a wooden box. The clown is wearing a light-colored hat, a dark jacket, and a light-colored shirt with dark stripes. He has a large smile painted on his face, which is also dark. His arms are crossed, and he appears to be looking at something off-camera.

In the background, there are several people standing around, but they are not clearly visible due to the low contrast between their clothing and the surrounding environment. There are also some trees and buildings in the distance, but they are not well-defined.

Overall, the image suggests that the clown is performing or entertaining a crowd, possibly at a fair or carnival. The atmosphere appears to be lively and festive, with the clown's bright smile and colorful clothing adding to the sense of excitement and joy.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white photograph depicts a person wearing a mask standing in front of a wooden box. The person is wearing a hat and a jacket, and his arms are crossed. The person is smiling, and his eyes are looking straight at the camera. Behind him, there are several people standing in front of a building, and a few trees are planted in the distance. The sky is dark, and it seems to be nighttime.

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring a man wearing a mask, leaning on a wooden box. He is dressed in a jacket with a striped shirt underneath, and he has his arms crossed. His head is covered with a cap. The photograph is captured at night, as indicated by the darkness of the sky and the presence of a streetlight in the background. The man's expression is somewhat enigmatic, with a hint of a smile on his face.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

This black and white photograph shows a clown resting his arms on a wooden box. The clown is in the foreground of the picture and has a white clown hat and dark makeup with white outlines around the eyes, nose, and mouth. He is wearing a striped shirt and a jacket. His face is in a pleasant, inviting expression. The background is blurry, but it appears to be a crowd of people in an outdoor setting. There is also a sign that reads "Ringling Barn Combs" visible in the background. The photograph appears to be a negative, with the colors inverted.

Created by gemini-2.0-flash-lite on 2025-05-18

Here is a description of the image:

The image is a black and white negative of a clown. The clown is the primary subject, standing in the foreground. He is wearing a white clown hat and his face is painted in the traditional clown style, with a white face, black outlines for the eyes and mouth, and a red nose. He is smiling, and his arms are crossed, resting on a wooden crate. He's wearing a striped shirt, and a long-sleeved jacket. In the background, there are other people, and what appears to be a sign that says "Ringling Bros. Barnum & Bailey Circus." The image is well-lit, and the details of the clown's face paint and clothing are clearly visible. The negative gives the image a somewhat ghostly appearance due to the inversion of light and dark tones.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring a person dressed in a clown costume. The clown is wearing a cap, a striped shirt, and a jacket. The clown's face is painted with exaggerated features typical of clown makeup, including a large, white-painted mouth and eyes. The clown is sitting on a wooden crate or box, with one hand resting on it and the other hand holding an object, possibly a prop. The background appears to be an outdoor setting, possibly a fair or carnival, with other people and structures visible. The overall mood of the image is somewhat nostalgic, capturing a candid moment in a classic carnival or circus environment.

Text analysis

Amazon

-
- Bean
RINGLE
can
Bean