Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

Date

August 6, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.725

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 6, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.725

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 99.9
Face 89.8
Head 89.8
Shirt 56.6
Accessories 56.6
Coat 56.2
Photography 55.3
Portrait 55.3
Cowboy Hat 55.3
Cap 55.2
Body Part 55.2
Finger 55.2
Hand 55.2

Clarifai
created on 2018-05-11

people 99.9
group 98.6
military 98.3
group together 98
adult 97.5
administration 95.9
man 95.9
lid 95.8
many 95.6
uniform 95.5
leader 93.9
wear 93.4
outfit 93
vehicle 92.7
veil 92.1
war 92
several 91.9
soldier 91
military uniform 89
woman 85

Imagga
created on 2023-10-06

hat 100
cowboy hat 89.5
clothing 58.1
headdress 56.9
man 40.9
male 36.8
uniform 35.1
person 28.6
consumer goods 27.9
covering 27.5
people 27.3
cowboy 26.6
military uniform 22.2
adult 22
portrait 22
western 19.4
engineer 18.1
smile 17.1
two 16.9
shirt 16.8
guy 16.5
work 16.5
helmet 16.3
outdoors 15.7
men 15.4
hand 15.2
job 15
gun 14
worker 13.8
happy 13.8
military 12.5
handsome 12.5
leisure 12.4
horse 12.3
boy 12.2
standing 12.2
face 12.1
looking 12
soldier 11.7
equipment 11.6
weapon 11.6
war 11.6
senior 11.2
outside 11.1
industry 11.1
danger 10.9
black 10.2
smiling 10.1
protection 10
child 10
activity 9.8
fun 9.7
safety 9.2
foreman 9.1
style 8.9
together 8.8
hair 8.7
mask 8.6
player 8.6
expression 8.5
attractive 8.4
manager 8.4
old 8.4
occupation 8.2
children 8.2
recreation 8.1
cowgirl 7.9
country 7.9
business 7.9
couple 7.8
construction 7.7
outdoor 7.6
pair 7.6
field 7.5
one 7.5
mature 7.4
sport 7.4
playing 7.3
industrial 7.3
tourist 7.2
pose 7.2
team 7.2
game 7.1
kid 7.1
happiness 7
travel 7

Microsoft
created on 2018-05-11

person 99.9
people 69.5
old 64.4
white 63.8
group 59.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 54-64
Gender Male, 91.8%
Calm 46.7%
Surprised 24.2%
Confused 21.5%
Fear 6%
Angry 5.6%
Sad 3.4%
Happy 3.2%
Disgusted 1.1%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 93.9%
Surprised 7.2%
Fear 6.1%
Sad 2.3%
Angry 1.2%
Confused 1%
Disgusted 0.8%
Calm 0.4%

AWS Rekognition

Age 22-30
Gender Male, 98.4%
Calm 72.8%
Confused 23.5%
Surprised 6.5%
Fear 5.9%
Sad 2.9%
Angry 0.4%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 87.7%
Surprised 8.2%
Fear 6.1%
Confused 3.5%
Sad 2.6%
Angry 2.1%
Disgusted 0.9%
Happy 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Confused 92%
Surprised 6.9%
Fear 5.9%
Disgusted 4.9%
Sad 2.2%
Calm 0.6%
Angry 0.6%
Happy 0.4%

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Calm 99%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Sad 99.8%
Confused 23.2%
Surprised 6.5%
Fear 6.1%
Disgusted 3.5%
Angry 1%
Calm 0.8%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 76.2%
Calm 89.8%
Surprised 7%
Fear 6%
Confused 3.5%
Sad 3.2%
Happy 0.8%
Disgusted 0.8%
Angry 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 58.4%
Happy 30.1%
Surprised 8.3%
Fear 6.2%
Confused 3.3%
Sad 2.3%
Angry 2.1%
Disgusted 1.1%

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Glasses

Clarifai

Man
Clothing
Human face
Drum
Tree
Hat

AWS Rekognition

Adult 98.4%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Adult 97.7%

AWS Rekognition

Adult 97.3%

AWS Rekognition

Adult 96.7%

AWS Rekognition

Adult 96.5%

AWS Rekognition

Adult 93.2%

AWS Rekognition

Adult 91.4%

AWS Rekognition

Male 98.4%

AWS Rekognition

Male 97.9%

AWS Rekognition

Male 97.7%

AWS Rekognition

Male 97.3%

AWS Rekognition

Male 96.7%

AWS Rekognition

Male 96.5%

AWS Rekognition

Male 93.2%

AWS Rekognition

Male 91.4%

AWS Rekognition

Man 98.4%

AWS Rekognition

Man 97.9%

AWS Rekognition

Man 97.7%

AWS Rekognition

Man 97.3%

AWS Rekognition

Man 96.7%

AWS Rekognition

Man 96.5%

AWS Rekognition

Man 93.2%

AWS Rekognition

Man 91.4%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 93.2%

AWS Rekognition

Person 91.4%

AWS Rekognition

Person 89.3%

AWS Rekognition

Person 87.5%

AWS Rekognition

Person 79%

AWS Rekognition

Person 78%

AWS Rekognition

Person 75.9%

AWS Rekognition

Person 70.5%

AWS Rekognition

Person 65.2%

AWS Rekognition

Person 56.8%

AWS Rekognition

Hat 92.8%

AWS Rekognition

Hat 70.3%

AWS Rekognition

Hat 58.4%

AWS Rekognition

Glasses 56.6%

Clarifai

Man 90%

Clarifai

Man 88.9%

Clarifai

Man 88.3%

Clarifai

Man 88.1%

Clarifai

Man 85.9%

Clarifai

Man 82.6%

Clarifai

Man 74.2%

Clarifai

Man 70.6%

Clarifai

Man 69.4%

Clarifai

Man 63.3%

Clarifai

Man 62.3%

Clarifai

Man 60.6%

Clarifai

Man 60.6%

Clarifai

Man 58.5%

Clarifai

Man 53.7%

Clarifai

Man 52.3%

Clarifai

Man 44%

Clarifai

Man 40.4%

Clarifai

Man 37.9%

Clarifai

Man 37.3%

Clarifai

Clothing 69.8%

Clarifai

Clothing 38.4%

Clarifai

Clothing 38.1%

Clarifai

Clothing 37.5%

Clarifai

Clothing 35.8%

Clarifai

Clothing 34.2%

Clarifai

Human face 65.8%

Clarifai

Human face 64.9%

Clarifai

Human face 62.7%

Clarifai

Human face 61.6%

Clarifai

Human face 53.7%

Clarifai

Human face 47.8%

Clarifai

Human face 45.7%

Clarifai

Human face 39.9%

Clarifai

Drum 49.6%

Clarifai

Tree 37.2%

Clarifai

Hat 36.1%

Clarifai

Hat 34.8%

Clarifai

Hat 34.4%

Categories

Imagga
created on 2023-10-06

people portraits 78%
paintings art 8%
pets animals 7.7%
nature landscape 4.2%
streetview architecture 1.1%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-05

a group of men in hats and overalls standing around a grill

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of men in hats and hats standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts a group of men gathered together outdoors, wearing attire typical of workers and farmers. Some are dressed in overalls, while others wear button-up shirts and hats for protection from the sun. One man prominently holds an object resembling a metal basket or sieve. The atmosphere suggests a rural or agricultural setting, possibly a meeting, demonstration, or event related to farming or labor. The background includes trees, indicating an outdoor location.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a group of men standing together, with many of them dressed in period attire, suggesting an event from the early to mid-20th century. Most of the men are wearing hats, ranging from straw hats to fedoras. In the foreground, one man is holding a large basket or container, possibly with some tools or equipment. They appear to be outdoors, as indicated by the trees visible in the background. The clothing includes suits, shirts, and overalls, indicating a diverse gathering, possibly a market, fair, or community event.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image depicts a group of men, likely in a rural or agricultural setting. They are wearing cowboy hats and work attire, suggesting they are farmers, ranchers, or laborers. The men appear to be gathered together, possibly for a meeting or gathering of some kind. The image has a black and white, vintage aesthetic, indicating it was likely taken in an earlier time period.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-13

The black and white image shows a group of men, likely farmers or agricultural workers, gathered together outdoors. They are wearing hats, shirts, and pants typical of rural attire from an earlier era, possibly the early to mid 20th century. The men have serious expressions and some are holding tools or implements, suggesting they may have been working or taking a break from labor. The background shows trees, indicating a rural or agricultural setting. The photograph captures a moment in time from the lives and work of these individuals.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white historical photograph showing a group of men wearing white straw hats, typical of the early to mid-20th century. The men are dressed in a mix of business attire (ties and white shirts) and work wear (denim overalls or jackets). The image appears to be taken at some kind of outdoor gathering or event. The style of dress and photographic quality suggests this was likely taken sometime in the 1920s or 1930s. The men appear to be focused on something outside the frame, and there's a sense of casual formality to the scene, as might be found at a community or business event of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image depicts a black-and-white photograph of a crowd of men gathered around a central figure, who is holding a basket and appears to be engaged in some sort of activity. The men are dressed in attire typical of the 1930s, with many wearing hats and casual clothing. The atmosphere suggests a gathering or event, possibly related to agriculture or community activities, given the presence of the basket and the casual attire of the men.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of a group of men gathered around a man who appears to be speaking. The man in the center is wearing a light-colored hat and a dark shirt, and he is holding a tool or object in his hand. He is standing in front of a large metal object that resembles a bucket or a tub.

To his left is another man wearing a white shirt and tie, holding a clipboard and pen. He appears to be taking notes or listening intently to the speaker. Behind them are several other men, all wearing hats and casual clothing. They seem to be engaged in a discussion or meeting, possibly related to work or a community project.

In the background, there are trees and foliage visible, suggesting that the scene is taking place outdoors. The overall atmosphere of the image is one of seriousness and focus, with the men appearing to be deeply engaged in their conversation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph depicting a group of men in a public setting. The men are standing around a central figure who is holding a basket and appears to be engaged in some activity. The central figure is wearing a hat and has a cigar in his mouth. The other men are also wearing hats and some are smoking cigarettes. The setting appears to be outdoors, with trees and a clear sky visible in the background. The men's clothing and hats suggest that they are farmers or rural workers. The image conveys a sense of camaraderie and shared experience among the men.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white image shows a group of people standing in an outdoor area. The person in front is holding a basket and a stick in his hands. He is wearing a hat, a shirt, and pants. The person next to him is holding a cigar in his mouth and a gun in his hand. Behind them, many people are standing and wearing hats. Some of them are wearing glasses.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here is a description of the image:

The image is a black and white photograph featuring a group of men, most of whom are wearing hats. The men are gathered around a circular object, perhaps a cooking pot or a drum. Some men are looking at the pot and others are looking at each other. One man to the left is wearing a white shirt and holding a notebook, while the man in the middle is wearing a hat and work clothes and is using a tool. The man to the right is wearing overalls and smiling while holding his hand to his face. The photograph's overall tone is candid and captures a moment in time, possibly a social gathering or a work event. The men's clothing and style suggest the photo was taken in the mid-20th century.

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

This black and white photograph captures a group of men gathered together, seemingly at an event. The composition is primarily focused on the foreground, where several men are positioned in a semi-circle. The men are all casually dressed, with the most common attire being shirts, trousers, and hats.

The man on the far left is wearing a light-colored shirt with a tie and high-waisted striped trousers, and a light-colored fedora hat. He is also wearing glasses and holding a book or clipboard. The man next to him is wearing a dark shirt and trousers and a light-colored fedora hat. The next man is wearing a button-up shirt and holding something in his hands, possibly utensils. The man to the right of him is wearing overalls and a hat, and looks pensive, with his finger on his chin.

In the background, more men can be seen, creating a sense of depth in the image. They are wearing a mix of hats and shirts, suggesting a variety of roles or styles. The setting appears to be outdoors, although the specifics of the location are difficult to discern. The photograph is well-composed, capturing a sense of community and camaraderie among the group of men. The overall tone is serious and thoughtful, with a hint of anticipation or excitement.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a group of men, likely from the early to mid-20th century, gathered together outdoors. The men are dressed in a variety of clothing styles typical of that era. Many are wearing hats, including cowboy hats and fedoras, and some are dressed in overalls and work shirts, suggesting they might be farmers or laborers.

The central figure in the image is wearing a wide-brimmed hat and a work shirt with rolled-up sleeves. He appears to be speaking or singing, as his mouth is open. To his right, a man in overalls and a hat is smiling and clapping his hands. Another man to the left is dressed more formally in a white shirt, tie, and dress pants, holding a rolled-up document or newspaper.

The background shows more men, some of whom are also wearing hats and casual clothing. The setting appears to be rural, possibly a farm or a community gathering place. The overall atmosphere seems to be one of camaraderie and engagement, with the men appearing to be participating in or observing some form of communal activity or event.

Qwen