Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

Date

August 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3338

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3338

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Face 100
Head 100
Photography 100
Portrait 100
Sun Hat 99.4
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Hat 98.3
Person 96.5
Wood 81.3
Cap 69.4
Shirt 60.2
Outdoors 57.5
Beard 55.8
Baseball Cap 55.4
Architecture 55.2
Building 55.2
Wall 55.2
Body Part 55.1
Finger 55.1
Hand 55.1

Clarifai
created on 2018-05-10

people 99.7
lid 99.7
man 97.9
adult 97.6
monochrome 97.1
veil 96.8
portrait 96.4
one 95.4
cowboy hat 92.9
elderly 92.9
wear 92.9
fedora 88.4
cap 85.8
retro 85.2
uniform 84.2
military 83.5
cowboy 83.5
cowman 82.9
outfit 82.5
street 81.7

Imagga
created on 2023-10-05

cowboy hat 100
hat 100
headdress 78.7
clothing 62.1
man 39.7
male 36.9
person 34.4
consumer goods 31.8
covering 31.5
people 29
portrait 22.7
adult 21.3
worker 21.2
happy 20.1
men 18.9
cowboy 18.6
job 18.6
work 18.1
uniform 18
handsome 17.8
shirt 17.7
helmet 17.7
smile 16.4
two 16.1
guy 15.9
face 15.6
western 15.5
industry 15.4
style 14.8
model 14.8
military uniform 14.7
builder 14.6
construction 14.5
fashion 14.3
outdoors 14.2
safety 13.8
smiling 13.7
hand 13.7
senior 13.1
standing 13
engineer 13
occupation 12.8
industrial 12.7
hair 12.7
black 12.6
look 12.3
expression 11.9
building 11.9
looking 11.2
together 10.5
attractive 10.5
one 10.5
horse 10.4
mature 10.2
professional 10.1
foreman 9.8
old 9.8
business 9.7
couple 9.6
wearing 9.5
outside 9.4
happiness 9.4
lifestyle 9.4
site 9.4
child 9.2
emotion 9.2
equipment 9.2
posing 8.9
hardhat 8.8
labor 8.8
boy 8.7
engineering 8.6
hard 8.6
pair 8.5
dark 8.4
indoor 8.2
cheerful 8.1
working 8
cowgirl 7.9
protective 7.8
contractor 7.8
middle aged 7.8
architect 7.7
elderly 7.7
serious 7.6
casual 7.6
manager 7.5
protection 7.3
pose 7.3
suit 7.2
romantic 7.1
love 7.1
interior 7.1
architecture 7
country 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 93.8
man 90
hat 88.7
old 75.5

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 98.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 1.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Person 99.4%
Person 96.5%
Adult 99.4%
Male 99.4%
Man 99.4%
Hat 98.3%

Captions

Microsoft
created by unknown on 2018-05-10

a man wearing a hat 94.8%
an old photo of a man wearing a hat 93.9%
a man wearing a hat in front of a window 89.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a man in a hat and overalls stands in front of a picture of a -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a man standing in front of a wooden wall with his hands on his hips, wearing denim overalls and a light-colored hat with a dark band. A pin or badge is visible on his overalls. To the right, a rectangular mirror hangs on the wood paneling, reflecting part of another individual in the background. The composition gives a rustic and contemplative feel.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a person standing against a wooden wall. They are wearing a straw hat with a dark band, a button-up shirt, and overalls. The person has their hands on their hips, and a small button is visible on the strap of the overalls. To the right of the person, a mirror is hanging on the wall, reflecting part of the scene in front of it. The wooden wall consists of horizontal planks, and there is a vertical divider or doorway on the left side of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a man standing in front of a wooden building. He is wearing overalls, a hat, and appears to be an older man with a serious expression on his face. Behind him, there is a framed photograph hanging on the wall, though the contents of the photograph are not clearly visible. The overall scene suggests a rural or working-class setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, likely the early-to-mid 20th century. The image shows someone wearing typical American rural or farm worker attire - overalls and a straw hat with a dark band. They are standing against what appears to be a wooden wall or building exterior. The person is wearing a light-colored shirt under the overalls and has their hands on their hips in a confident or assertive pose. There's a framed picture or mirror hanging on the wall behind them. The photograph has a documentary-style quality typical of Depression-era photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man in overalls standing in front of a wall with a picture frame.

  • The man is wearing a light-colored hat with a dark band around it, and his hands are on his hips. He has a round pin on his shirt pocket. His shirt is short-sleeved and his overalls are light-colored.
  • The wall behind him is made of horizontal wooden planks. There is a picture frame on the wall to the right of the man. The picture inside the frame is blurry, but it appears to be a person sitting down.
  • The overall atmosphere of the image suggests that it was taken in a rural or agricultural setting, possibly during the 1930s or 1940s based on the clothing and style of the photograph.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man standing in front of a wall. The man is wearing a light-colored hat with a dark band around it, and a light-colored shirt with overalls. He has his hands on his hips and is looking to the right side of the image.

Behind him, there is a wall made of horizontal wooden planks. On the wall, there is a framed picture hanging from a nail. The picture appears to be a close-up of a person's face or body, but it is not clear due to the low resolution of the image. Above the picture, there is an object that resembles a hammer or a tool of some kind.

The overall atmosphere of the image suggests that it was taken in a rural or rustic setting, possibly in the early 20th century. The man's clothing and the style of the wall and the picture frame suggest a simple, country lifestyle.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of a man standing in front of a wooden wall. The man is wearing a hat and overalls, and he has his arms crossed. He is looking to the side, possibly at the camera. The wall behind him has a wooden texture and is painted in a light color. There is a mirror hanging on the wall, reflecting a blurry image of a person. The mirror is framed in a simple white frame.

Created by amazon.nova-pro-v1:0 on 2025-06-02

A black-and-white photo of a man standing with his hands on his hips. He is wearing a hat, a shirt, and denim overalls. Behind him, there is a wooden wall with a picture frame mounted on it. The picture frame contains a blurry image of a person, probably a woman, with a baby. Above the picture frame, there is a black object hanging from the wall.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

In this black and white photograph, a man stands with his hands on his hips, leaning against a wooden door and wall. He wears denim overalls over a short-sleeved shirt and a straw hat with a dark band. A circular pin is visible on his overalls. To his right, a small, square mirror hangs on the wall, reflecting what appears to be the back of a person. Above the mirror, a dark, T-shaped object is mounted on the wall. The wooden planks of the door and wall are arranged horizontally.

Created by gemini-2.0-flash-lite on 2025-05-29

Here's a description of the image:

Overall:

The image is a black and white photograph of a man leaning against a wooden wall. The man is wearing overalls and a hat, and there's a small mirror hanging on the wall behind him. The style suggests it was taken during the mid-20th century.

The Man:

  • He's leaning against a wooden wall, with his arms resting on his hips.
  • He's wearing what appears to be denim overalls and a short-sleeved shirt.
  • He has a hat with a dark band.
  • He has a focused or perhaps somber expression.
  • There's a small badge or pin on his overalls.

Background:

  • The background is a horizontal wooden wall.
  • A small rectangular mirror hangs on the wall. The reflection in the mirror is somewhat blurred but appears to show a person.
  • There's an object mounted above the mirror, possibly for attaching the mirror.

Atmosphere:

The photograph evokes a sense of weariness or contemplation. The man's posture and expression, combined with the rural setting, hint at a hardworking life.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a man standing in front of a wooden structure, possibly a barn or a shed. The man is wearing overalls, a long-sleeve shirt, and a hat with a black band and a light-colored brim. He has a cigarette in his mouth and is looking directly at the camera with a somewhat stern expression.

The wooden wall behind him has horizontal planks and a small window with a decorative item hanging above it. The decorative item appears to be a horse-shaped object, possibly a weather vane or a piece of folk art. The overall scene suggests a rural setting, likely from the mid-20th century, given the style of clothing and the photographic quality. The man's attire and the setting imply he might be a farmer or a laborer.