Human Generated Data

Title

Untitled (man with large mortar and pestle)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7846

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with large mortar and pestle)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7846

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.3
Clothing 81.6
Apparel 81.6
Face 77.6
Worker 69
Coat 60.9
Soil 56.9
Shelf 55.6

Clarifai
created on 2023-10-25

people 100
one 99.6
adult 99.3
art 96.5
man 96.4
two 96.2
portrait 95.5
wear 93
woman 91.1
elderly 90.8
veil 90.5
furniture 89.8
leader 89
group 87.5
administration 87.5
bucket 87.5
recreation 86.8
print 85
sculptor 83.2
writer 82.7

Imagga
created on 2022-01-09

statue 34.3
sculpture 34.1
art 22.8
architecture 22
old 20.9
religion 19.7
ancient 18.2
history 17
stone 16.1
city 15.8
window 15.4
culture 15.4
building 15.2
travel 14.1
monument 14
temple 13.2
religious 13.1
antique 13.1
figure 12.6
traditional 12.5
god 12.4
historical 12.2
historic 11.9
carving 11.8
person 11.6
vintage 11.6
tourism 11.6
decoration 11.5
column 11.4
famous 11.2
people 10.6
detail 10.5
fountain 10.3
male 9.9
marble 9.9
artistic 9.6
man 9.4
church 9.2
head 9.2
structure 9.2
mask 9.2
dress 9
landmark 9
catholic 8.8
covering 8.7
wall 8.7
golden 8.6
portrait 8.4
lady 8.1
interior 8
face 7.8
spirituality 7.7
spiritual 7.7
clothing 7.6
fashion 7.5
decorative 7.5
style 7.4
shop 7.3
makeup 7.3
black 7.3
shelf 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 98.6
statue 94.2
person 90.3
standing 81
clothing 78.9
black and white 71.4
sculpture 64.6
man 64.2

Color Analysis

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 99.3%

Categories

Imagga
created on 2022-01-09

streetview architecture 88.5%
paintings art 9.4%
interior objects 1.9%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a hat and a vase with flowers

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-23

The response was filtered due to the prompt triggering Azure OpenAI's content management policy. The content filter results follow.

hate: safe
self-harm: safe
sexual: safe
violence: high

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a man standing in what appears to be a garden or greenhouse setting. He is holding a large wooden object, possibly a tool or sculpture, and is surrounded by various potted plants and other objects. The man has an intense, focused expression on his face, suggesting he is deeply engaged in his work or surroundings. The image is in black and white, giving it a timeless, contemplative quality.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The black and white photograph depicts an elderly man standing in front of a window, holding a large wooden spoon or ladle. The man has a weathered, wrinkled face and is wearing a collared shirt with the sleeves rolled up. Behind him, various potted plants can be seen on shelves or ledges by the window. The image has an aged, vintage quality, suggesting it was taken some time ago, likely documenting the man's work or craft involving the large wooden implement he is holding.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph that appears to be from an earlier era, showing someone working in what looks like a greenhouse or plant nursery setting. The person is wearing work clothes and is surrounded by potted plants and wooden supports or posts. In the background, there are several plants in pots arranged on shelves or benches. The image has a documentary or candid quality typical of mid-20th century photography, capturing someone in their natural working environment among the plants they tend to.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of an older man standing in a garden, holding a large mortar and pestle.

The man has short, wavy hair and wears a collared shirt with rolled-up sleeves and light-colored pants. He stands in front of a wooden post, holding the pestle in his right hand and the mortar in his left. The mortar is large and made of wood, with a long handle and a bowl-like shape.

In the background, there are several potted plants on shelves, as well as a table or bench with more plants on it. The overall atmosphere of the image suggests that the man is engaged in some kind of gardening or cooking activity, possibly preparing ingredients for a meal.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of an older man standing in front of a wooden structure, likely a garden or greenhouse. The man has short hair and wears a collared shirt with rolled-up sleeves and pants. He holds a long stick in his right hand, which appears to be attached to a large, dark-colored object resembling a mortar and pestle. The mortar is positioned on the ground, and the pestle is held upright by the man.

In the background, there are several potted plants on shelves, suggesting that the setting is a garden or greenhouse. The overall atmosphere of the image is one of a serene and peaceful environment, with the man engaged in a quiet activity surrounded by nature.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of an elderly man standing in front of a wooden structure. He is holding a large, hollowed-out wooden post, which is resting on the ground in front of him. The man is wearing a long-sleeved shirt and pants, and he appears to be focused on something in front of him, possibly the post. Behind him, there is a wooden shelf with several potted plants on it. The shelf is attached to a wall, and there is a small window or opening in the wall behind the man. The image has a vintage or historical feel, and it appears to have been taken in a rural or agricultural setting.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man standing in front of a wooden structure. The man is wearing a long-sleeved shirt and pants. He is holding a wooden pole with his left hand and resting his right hand on the pole. He is looking to the left, and his facial expression seems to be serious or contemplative. Behind him, there are shelves filled with various items, including potted plants, bottles, and other objects. The background is somewhat blurred, suggesting that the focus is on the man and the wooden structure.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

This appears to be a black and white negative of a photograph. The image shows a man standing in front of what looks like a large mortar and pestle. He is holding the pestle and seemingly using it. The scene is outdoors, with plants visible in the background, perhaps suggesting a garden or patio setting. The man is dressed casually in a shirt and jeans. The lighting is such that it highlights the shapes and textures of the mortar, pestle, and surrounding foliage. The fact that it's a negative gives the image a unique, somewhat ethereal quality, as the light and dark areas are inverted.

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

This is a black and white photograph showing a man standing in what appears to be a garden or outdoor area. The image has a slightly ghostly, inverted look, indicative of it being a negative.

The man, who is centered in the frame, is holding a large wooden pestle in both hands. The pestle is positioned inside a large mortar.

Behind him, there's a shelf filled with various potted plants and other items. The background is somewhat blurry, suggesting a shallow depth of field. To his right, there's what looks like a tree trunk.

The man is wearing a collared shirt and jeans. The overall composition is simple and focuses on the man and his activity, giving the image a documentary feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts an elderly man engaged in a traditional activity. He is using a large wooden mortar and pestle, which is commonly used for grinding or crushing ingredients. The man is dressed in a simple shirt and light-colored pants, with the sleeves of his shirt rolled up, indicating that he is actively working.

In the background, there are various plants and containers, suggesting that this activity might be taking place in a rural or semi-rural setting, possibly in a garden or a farm. The plants in the background appear to be flowering, adding a touch of nature to the scene. The overall atmosphere of the image conveys a sense of tradition and manual labor, highlighting the simplicity and hard work involved in such tasks.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

The image is a black and white photograph featuring a man in an indoor setting, possibly a small garden or workshop. He is holding a piece of wood, which appears to be part of a larger object or tool. The man is wearing a short-sleeved shirt and pants, and his expression is serious or contemplative. Behind him, there are several potted plants arranged on shelves, and the background includes a window with curtains and additional plants. The overall atmosphere of the image suggests a calm, focused environment, possibly related to gardening or woodworking. The photograph has a vintage quality, with a visible border and a stamp in the top right corner that reads "KODAK SAFETY."

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This is a black-and-white photograph of a man engaged in an activity that appears to be traditional or cultural in nature. He is holding a long wooden tool that he is using to press or grind something inside a large, bowl-like container. The container looks like it might be made from a natural material, possibly a coconut shell or a similar object. The man is wearing a collared shirt and light-colored pants. The setting appears to be outdoors or in a semi-outdoor area, with shelves containing various items such as jars and potted plants in the background. The image has a vintage quality, suggesting it was taken some time ago.

Text analysis

Amazon

YТ3

Google

YT3RA2-AGON
YT3RA2-AGON