Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

Date

August 6, 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3381

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 6, 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3381

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Face 93.3
Head 93.3
Cowboy Hat 66.5
Photography 60.8
Portrait 60.8
Smoke 57.8

Clarifai
created on 2018-05-10

people 100
lid 99.8
veil 99.1
man 98.4
adult 98.2
two 97.6
three 97.4
elderly 97.1
portrait 95.7
wear 95.6
fedora 94.7
group 94.1
cowboy 93.9
four 92.1
one 91
cowboy hat 90.3
cowman 89.1
mustache 89
retro 87.8
five 86.3

Imagga
created on 2023-10-06

hat 61.9
man 51.7
old-timer 44.1
cowboy hat 42.1
male 41.2
person 34.9
clothing 29.4
people 27.9
portrait 25.9
headdress 25.2
grandfather 24.8
senior 24.4
face 24.1
men 24
adult 20
bow tie 19.6
old 19.5
hand 19
happy 18.2
work 17.3
guy 16.7
necktie 16.6
smile 15.7
uniform 13.8
worker 13.8
elderly 13.4
covering 13.4
look 13.1
shirt 13.1
cowboy 12.9
looking 12.8
expression 12.8
couple 12.2
mature 12.1
black 12
consumer goods 12
casual 11.9
model 11.7
handsome 11.6
smiling 11.6
job 11.5
style 11.1
hair 11.1
beard 11.1
two 11
professional 11
head 10.9
western 10.7
interior 10.6
together 10.5
attractive 10.5
outdoors 10.4
business 10.3
love 10.3
occupation 10.1
one 9.7
home 9.6
happiness 9.4
lifestyle 9.4
safety 9.2
indoor 9.1
fashion 9
garment 9
father 8.9
wearing 8.6
industry 8.5
vintage 8.3
human 8.2
friendly 8.2
pose 8.2
military uniform 8.1
eye 8
family 8
close 8
businessman 7.9
labor 7.8
mysterious 7.8
boys 7.8
affectionate 7.7
husband 7.6
serious 7.6
wife 7.6
dark 7.5
glasses 7.4
equipment 7.4
retro 7.4
teenager 7.3
room 7.3
suit 7.3
aged 7.2
building 7.1
posing 7.1

Microsoft
created on 2018-05-10

person 98.7
man 96.8
old 96.1
outdoor 96.1
hat 94.2
white 70.7
older 66

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 19-27
Gender Female, 80.5%
Sad 100%
Confused 13%
Surprised 6.3%
Fear 5.9%
Calm 4.1%
Angry 0.3%
Disgusted 0.2%
Happy 0%

AWS Rekognition

Age 51-59
Gender Male, 99.7%
Calm 53.2%
Angry 44.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.9%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat

Clarifai

Man
Human face
Fedora
Cowboy hat
Human head
Human nose
Human eye
Human hand

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 97.7%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 98.8%

AWS Rekognition

Male 97.7%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 98.8%

AWS Rekognition

Man 97.7%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 97.7%

AWS Rekognition

Hat 99.2%

AWS Rekognition

Hat 98.2%

AWS Rekognition

Hat 55.7%

Clarifai

Man 96%

Clarifai

Man 95.1%

Clarifai

Man 91.8%

Clarifai

Human face 86.9%

Clarifai

Human face 84.5%

Clarifai

Human face 81.5%

Clarifai

Fedora 62.8%

Clarifai

Cowboy hat 51.5%

Clarifai

Cowboy hat 39%

Clarifai

Human head 43.3%

Clarifai

Human nose 40%

Clarifai

Human nose 37.3%

Clarifai

Human nose 36.3%

Clarifai

Human eye 34.1%

Clarifai

Human hand 33.6%

Categories

Imagga
created on 2023-10-06

paintings art 95%
people portraits 4%

Captions

Microsoft
created by unknown on 2018-05-10

a vintage photo of a man wearing a hat 93.6%
an old photo of a man wearing a hat 93.5%
a man wearing a hat 93.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a hat and a woman in a hat

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a man and woman in front of a barn

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This black-and-white image depicts a group of people near a wooden structure, possibly a rural home or barn. The foreground features a person wearing a wide-brimmed hat, suspenders, and a collared shirt. Another individual wearing a hat is positioned next to them, slightly behind. In the background, another person in overalls can be observed near a doorway. The setting suggests a historical or rustic atmosphere, with weathered wooden walls and a casual posture among the individuals.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a black and white photograph depicting three individuals standing in front of what appears to be a wooden structure. The person on the left is wearing a long-sleeved shirt, suspenders, and a black wide-brimmed hat. Their arms are crossed as they lean on a surface. Next to them, a person is wearing a brimmed hat with a ring design on it and appears to be holding something near their mouth. In the background, there is another person partially visible through a doorway, wearing a brimmed hat and rolled-up sleeves, suggesting they might be working or just observing something nearby. The setting has a rustic feel, likely taking place in a rural or farming context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image depicts three men standing in a wooden structure, likely a barn or shed. The man in the foreground is an older gentleman with a beard, wearing a cowboy hat and suspenders. Next to him is a younger man wearing a wide-brimmed hat. In the background, another man can be seen partially obscured by the wooden structure. The image has a black and white, vintage aesthetic, suggesting it is an older photograph capturing a scene from the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from the early to mid-20th century. In the image, there are three people standing near what looks like a wooden doorway or entrance. In the foreground, there's a man wearing a dark wide-brimmed hat, suspenders, and a light-colored shirt. He has a beard and appears to be middle-aged or older. Behind him is someone wearing a decorative sun hat, and further in the background, another person in a hat can be seen. The image has the documentary style characteristic of Depression-era photography, with strong contrast and detail in the textures of the clothing and wooden structure.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of three individuals standing in front of a wooden structure. The man on the left is attired in a light-colored shirt, dark suspenders, and a dark hat. He has his arms crossed and appears to be looking to the right. Behind him, a woman wears a light-colored hat with a dark band and a light-colored shirt. She is adjusting her hat with her right hand. In the background, a man stands in the doorway of the wooden structure, wearing a light-colored shirt and a dark hat.

The overall atmosphere of the image suggests that it was taken in a rural or agricultural setting, possibly during the early 20th century. The clothing and hairstyles of the individuals in the photo are consistent with this time period. The image may have been captured by a photographer who was documenting everyday life in a rural community.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of three individuals standing in front of a wooden structure. The man on the left is attired in a dark hat, light-colored shirt, and suspenders, with his arms crossed. Behind him stands a woman wearing a light-colored hat and shirt, holding a cigarette in her mouth. To the right of the woman is another man, also wearing a light-colored hat and shirt, with his back against the wall.

The background of the image features a wooden structure, which appears to be a building or a fence. The overall atmosphere of the image suggests that it was taken during the daytime, possibly in a rural or outdoor setting. The style of the clothing and the presence of cigarettes suggest that the image may have been taken in the early 20th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-05

A black-and-white image of three people standing in front of a wooden door. The man on the left is wearing a hat, suspenders, and a shirt with his arms crossed. He is looking to the right. Next to him is a woman wearing a hat and a shirt with her hand on her chin. She is looking to the left. Behind them is a man wearing a hat and a shirt. He is looking to the right.

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of three people standing in front of a wooden structure. The man in the front is wearing a hat and suspenders and has his arms crossed. The woman behind him is wearing a hat and holding a cigarette in her hand. The man behind the woman is wearing a hat and a shirt. The photograph appears to be taken in a rural setting, possibly a farm or a barn.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

This black and white photograph depicts three individuals, likely in a rural setting, with an emphasis on an older man in the foreground.

The main subject is an elderly man with a weathered face, wearing a wide-brimmed dark hat. He has light-colored stubble or a short beard. He's wearing a collared shirt with suspenders. His arms are crossed. He appears to be standing in front of a wooden structure, likely a wall or side of a building.

Behind him and slightly to the right is a younger person, possibly a woman, wearing a straw hat. They seem to be holding something to their mouth. Further back, another man is partially visible, also wearing a hat and suspenders, standing near a doorway or opening in the wooden structure. The scene has a documentary or candid feel, suggesting it may have been taken during an era of rural or agricultural life.

The grainy quality and tonal range of the black and white medium contribute to the vintage aesthetic of the photo. The wooden structure adds to the rustic environment and reinforces the narrative.

Created by gemini-2.0-flash-lite on 2025-05-08

Here is a description of the image:

This black and white photograph depicts three men in a rural setting, likely during the Dust Bowl era or similar period.

  • Foreground: The primary focus is on an older man with a weathered face, gray beard, and a stern expression. He wears a wide-brimmed black hat, a light-colored button-down shirt, and suspenders. His arms are crossed, suggesting a serious or contemplative mood. He stands against a weathered wooden wall.
  • Midground: To the right of the first man, a younger man with a straw hat is visible. He is smoking, his face slightly obscured by the hat.
  • Background: The third man is partially seen behind the second, also wearing a hat and a light-colored shirt. He appears to be standing within a doorway or opening of a wooden structure, suggesting a rural or agricultural setting.

The lighting is stark and creates strong contrasts, which enhances the textures and the mood of the image. The photograph's composition, coupled with the subjects' attire and expressions, evokes a sense of hardship, resilience, and the social and economic conditions of the time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring three individuals standing in front of a rustic wooden structure, possibly a barn or shed.

  1. Foreground:

    • An older man is prominently positioned in the foreground. He is wearing a dark, wide-brimmed hat, a light-colored shirt with rolled-up sleeves, and suspenders. His arms are crossed, and he has a beard and mustache.
    • A younger woman stands slightly behind him. She is wearing a light-colored shirt and a hat with a decorative band. She is holding a cigarette in her hand and appears to be looking off to the side.
  2. Background:

    • Another man, slightly obscured, stands in the doorway of the wooden structure. He is wearing a hat and a light-colored shirt, and he appears to be looking outward.

The setting suggests a rural or agricultural environment, possibly from an earlier time period, given the style of clothing and the rustic surroundings. The expressions and postures of the individuals suggest a candid moment captured in their daily life.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image is a black-and-white photograph depicting three individuals in an outdoor setting that appears to be rustic or rural. The setting includes a wooden structure, possibly a barn or shed, which serves as the backdrop.

  1. Foreground: On the left side, there is an older man wearing a wide-brimmed black hat and a light-colored shirt with suspenders. He has a beard and is looking off to the side with a serious or contemplative expression. His arms are crossed, giving him a reserved stance.

  2. Middle Ground: In the center, there is a woman wearing a wide-brimmed hat, possibly indicating a warm climate or a fashion choice. She is dressed in a light-colored outfit and is holding a cigarette in her hand. Her expression appears thoughtful or pensive as she looks in the same direction as the older man.

  3. Background: On the right side, another individual, possibly a man also wearing a hat, is partially visible through a doorway or opening in the wooden structure. This person is facing away from the camera and seems to be inside the structure.

The overall mood of the photograph is serious and reflective, with a sense of rustic simplicity and a historical or rural setting. The clothing and hats suggest a time period that could be mid-20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph appears to depict a scene of rural or farm life. In the foreground, there is an older man wearing a wide-brimmed hat, a buttoned-up shirt, and suspenders. He has a serious expression on his face and is looking off to the side. Behind him, a woman wearing a straw hat is visible; she is holding a cigarette and also looking in the same direction as the man. In the background, another man wearing a hat and a buttoned-up shirt is standing in the doorway of a wooden building, looking out. The overall atmosphere of the image suggests a moment of contemplation or concern among the individuals.