Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

Date

July 1938-August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2153

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2153

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Carpenter 99.9
Architecture 99.1
Building 99.1
Factory 99.1
Manufacturing 95.2
Face 84.5
Head 84.5
Wood 75.2
Workshop 67.5
Machine 64.5
Clothing 58.8
Worker 55.5
Cap 55.2

Clarifai
created on 2018-05-10

people 100
one 99.5
adult 99.3
wear 98.4
man 98
two 96.9
artisan 96.1
sewing machine 95.9
grinder 95.4
raw material 94.8
production 94.8
concentration 94.3
room 92.7
industry 92.6
group 92.1
furniture 91.3
employee 90.7
military 90.5
three 90.5
war 89.5

Imagga
created on 2023-10-06

loom 34.8
machine 33.9
textile machine 28.4
work 26.3
machinist 26
man 24.9
industry 24.7
metal 22.5
steel 22.1
industrial 21.8
device 20.3
worker 19.5
factory 19.1
old 18.8
working 18.6
equipment 17.6
construction 17.1
building 16.6
job 15
person 14.8
male 14.2
iron 14.1
people 13.9
men 13.7
manufacturing 13.7
repair 13.4
safety 12.9
occupation 12.8
light 12.7
heat 12
welder 11.9
manual 11.7
labor 11.7
skill 11.6
tools 11.4
power 10.9
hot 10.9
craft 10.9
welding 10.9
product 10.8
mask 10.8
newspaper 10.5
fire 10.3
carpenter 10.3
protection 10
structure 9.9
black 9.7
vehicle 9.3
tool 9.2
gloves 8.7
technical 8.7
site 8.4
adult 8.4
house 8.4
seller 8.2
engineer 8.1
weld 7.9
business 7.9
spark 7.9
sparks 7.9
urban 7.9
mechanic 7.8
helmet 7.7
engineering 7.6
build 7.6
creation 7.5
flame 7.5
car 7.5
human 7.5
smoke 7.4
technology 7.4
dirty 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 94.2
black 72.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 16-22
Gender Female, 94.5%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Happy 0.1%
Confused 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Boy
Child
Male
Wheel
Hat

Clarifai

Clothing
Human face
Hat
Human leg
Human arm
Human nose

AWS Rekognition

Person 99%

AWS Rekognition

Boy 99%

AWS Rekognition

Child 99%

AWS Rekognition

Male 99%

AWS Rekognition

Wheel 64.5%

AWS Rekognition

Hat 58.8%

Clarifai

Clothing 86.1%

Clarifai

Human face 75%

Clarifai

Hat 44.2%

Clarifai

Human leg 43.3%

Clarifai

Human arm 37.1%

Clarifai

Human nose 34.1%

Categories

Imagga
created on 2023-10-06

paintings art 80.9%
food drinks 5.3%
interior objects 5.2%
cars vehicles 4.4%
pets animals 1.3%

Captions

Microsoft
created by unknown on 2018-05-10

a black and white photo of a man 65.7%
a man sitting on a bench 40.3%
black and white photo of a man 40.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man sitting on a bench in a workshop

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a man sitting in a workshop

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-23

The response was filtered due to the prompt triggering Azure OpenAI's content management policy. The content filter results follow.

hate: safe
self-harm: safe
sexual: safe
violence: high

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a person, likely a man, sitting in a cluttered workshop or shed. He is wearing overalls and a cap, and appears to be working on some kind of machinery or tool. The background is filled with various tools, parts, and other items, creating a sense of a busy, industrial environment. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from a workshop or repair shop. The image shows someone wearing work clothes and a cap, working at what appears to be a workbench. The wall behind them is covered with various tools and equipment hanging on it. The person appears to be focused on some kind of repair or craftwork at the bench. The setting has an industrial or mechanical feel to it, typical of a repair shop or maintenance facility from what seems to be an earlier era, possibly mid-20th century based on the image quality and setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a man sitting in a workshop, surrounded by various tools and equipment. The man is wearing overalls and a hat, and is seated on a wooden bench or stool. He appears to be engaged in some sort of activity, possibly working on a project or repairing a tool.

In the background, there are several pieces of equipment and machinery, including a lathe, a drill press, and a workbench. There are also various tools and materials scattered about, such as hammers, saws, and nails. The overall atmosphere of the image suggests a sense of industriousness and productivity, as if the man is hard at work in his workshop.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This black-and-white photograph depicts a man sitting in a workshop, surrounded by various tools and equipment. The man is dressed in a hat, denim shirt, and overalls, with his hands clasped together in front of him. He sits on an anvil, facing to the right, with his back straight and his head turned slightly towards the camera.

The workshop appears to be cluttered, with numerous tools and objects scattered throughout the room. A workbench is visible on the left side of the image, while a bucket labeled "NATIONAL MOTOR OIL" sits on the floor to the right of the man. The background of the image features a wall lined with tools and equipment, including saws, hammers, and other machinery.

Overall, the image suggests that the man is a craftsman or tradesperson who works in the workshop, surrounded by the tools and equipment necessary for his trade. The photograph may have been taken in the early 20th century, given the style of clothing and the types of tools depicted.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image shows a black-and-white photograph of a person sitting on an anvil in a workshop. The person is wearing a hat and suspenders, and they are looking down, possibly working on something. Behind them, there are various tools and equipment, including a saw, a drill, and a hammer, hanging on the wall. There is also a wooden box on the floor, and a bucket with the word "NATION" on it. The image has a vintage feel, suggesting it was taken in the past.

Created by amazon.nova-pro-v1:0 on 2025-06-01

In a black-and-white image, a person is sitting on an anvil, perhaps in a workshop. The person is wearing a hat and a shirt, and he is looking to the left. Behind him, a shelf is mounted on the wall, and a few tools are placed on it. A storage box is kept on the floor, and a bucket is placed beside him. A few wooden planks are placed on the floor.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

Here's a description of the image:

This is a black and white photograph that shows a man sitting in what appears to be a workshop or blacksmith shop. He is the primary subject of the image.

The man is wearing a simple, dark-colored work shirt with the sleeves rolled up to his elbows, light-colored overalls with suspenders, and a brimmed hat. He is seated on what looks like a metal anvil. His hands are clasped together in his lap, and he is gazing off to the side with a somewhat thoughtful expression.

The background of the image is filled with various tools and equipment associated with a workshop. There are saws, a vise, possibly a grinding wheel, and other mechanical parts hanging on the wooden walls. There is also a bucket labeled "National Motor Oil" visible near the lower right corner of the image.

The lighting appears to come primarily from the right side of the frame, casting shadows and highlights that emphasize the textures and forms within the shop. The overall impression is one of a quiet, rustic setting, perhaps from a bygone era.

Created by gemini-2.0-flash-lite on 2025-05-28

Here is a description of the image:

The image is a black and white photograph of a young man seated on an anvil. He is wearing a work hat, a long-sleeved shirt with rolled-up sleeves, and overalls. The man is looking off to the side with a contemplative expression. The setting appears to be a rustic workshop or shed, with wooden walls and various tools and equipment visible in the background. A partially visible saw blade hangs on the wall. There is a bench with a vise on the left, and a bucket is to the right, and behind the bucket are some wooden planks. The lighting is dim, but there is light entering from the right side of the frame. The overall mood of the image suggests a sense of quiet reflection or a moment of rest within a working environment.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a young boy in what appears to be a workshop or a woodworking area. The boy is sitting on a wooden bench or stool, wearing a cap, overalls, and a long-sleeved shirt. He is looking intently at something in front of him, possibly a piece of wood or a tool.

The background is filled with various tools and equipment typically found in a woodworking shop. There are saws, hammers, and other tools hanging on the wall. The environment appears to be cluttered but organized, with wooden planks and other materials scattered around. There is a can labeled "NATIONAL MOTOR OIL" visible on the floor to the right side of the image.

The setting suggests a time from the early to mid-20th century, given the style of clothing and the tools present. The boy's attire and the tools indicate that he might be engaged in some form of manual labor or learning a craft, possibly under the guidance of an adult. The overall atmosphere of the image conveys a sense of industriousness and craftsmanship.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This image is a black-and-white photograph depicting a person sitting in what appears to be a workshop or garage. The individual is wearing a wide-brimmed hat, overalls, and a short-sleeved shirt, suggesting a rustic or labor-intensive environment. The person is seated on a piece of wood, with knees bent, and appears to be looking off to the side, possibly deep in thought or observing something outside the frame.

The background is filled with various tools and machinery, including what looks like a workbench with clamps and other equipment, a large fan, and tools hanging on the wooden walls. There is also a partially visible label on a container that reads "NATIONAL MOTOR OIL," indicating that the location might be a place where mechanical or agricultural work is done. The lighting is somewhat dim, with some light coming from the right side of the frame, creating a contrast between the brightly lit area and the darker background. The overall scene gives a sense of a historical or rural setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a person seated in what appears to be a workshop or tool shed. The individual is wearing a hat, a short-sleeved shirt, and overalls. They are sitting on a wooden bench or box, with their legs crossed and one arm resting on their knee. The background is filled with various tools and equipment hanging on the walls, including wrenches, a saw, and other mechanical parts. The setting suggests a rustic, utilitarian environment.

Text analysis

Amazon

MOTO
NATION
of
a

Google

NATIO
NATIO