Human Generated Data

Title

Citizens of Zinc, Arkansas, a deserted mining town

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2985

Human Generated Data

Title

Citizens of Zinc, Arkansas, a deserted mining town

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2985

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Human 99.8
Sun Hat 91
Cowboy Hat 76.1
Face 57.7

Clarifai
created on 2023-10-15

people 100
lid 99.7
portrait 99.6
adult 99.1
man 98.8
group together 97.7
group 97.7
veil 97.5
two 96.5
monochrome 95.7
three 93.9
woman 92.9
wear 92.7
four 90.7
child 89.9
elderly 89.1
recreation 85.9
cowboy 85.8
campsite 85.7
street 84.7

Imagga
created on 2021-12-15

hat 100
cowboy hat 91.3
headdress 81.3
clothing 58.6
sombrero 45.3
person 33.4
people 30.7
portrait 30.4
happy 27.6
man 27.6
consumer goods 27.3
covering 27.2
cowboy 27.2
male 25.5
outdoors 25.4
adult 24.6
face 22.7
senior 22.5
smile 20
smiling 18.1
shirt 17.8
happiness 15.7
western 15.5
straw 15.4
two 15.3
hair 15.1
model 14.8
elderly 14.4
fashion 14.3
human 14.3
attractive 14
couple 13.9
black 13.8
outside 13.7
hand 13.7
pretty 13.3
old 13.2
mature 13
child 13
looking 12.8
horse 12.3
farmer 12.1
fun 12
guy 12
casual 11.9
farm 11.6
summer 11.6
lifestyle 11.6
boy 11.3
one 11.2
style 11.1
beach 11
field 10.9
cowgirl 10.9
cute 10.8
posing 10.7
together 10.5
wearing 10.5
sexy 10.4
men 10.3
expression 10.2
hold 10.2
outdoor 9.9
lady 9.7
rural 9.7
enjoy 9.4
joy 9.2
leisure 9.1
cheerful 8.9
handsome 8.9
kid 8.9
country 8.8
agriculture 8.8
look 8.8
standing 8.7
love 8.7
play 8.6
enjoying 8.5
pair 8.5
dark 8.4
park 8.2
make 8.2
oriental 8.1
brown 8.1
romantic 8
brunette 7.8
sea 7.8
husband 7.6
head 7.6
traditional 7.5
grow 7.5
emotion 7.4
water 7.3
children 7.3
pose 7.3
gorgeous 7.3
fall 7.2
aged 7.2
childhood 7.2
women 7.1

Google
created on 2021-12-15

Photograph 94.2
White 92.2
Hat 90.7
Cap 87.4
Headgear 81.9
Sun hat 81.7
Adaptation 79.5
Tree 75.8
Plant 75.5
Monochrome photography 74.7
Snapshot 74.3
Vintage clothing 72.8
Landscape 72.7
Monochrome 71.8
Collar 68.1
Stock photography 63.6
Photo caption 62.5
Art 60.4
History 60.2
Moustache 59.5

Microsoft
created on 2021-12-15

person 99.2
hat 99.1
text 98.9
fashion accessory 96.5
outdoor 96.3
cowboy hat 92.5
clothing 92.4
fedora 90.7
man 90.6
sun hat 88.5
human face 87.9
black and white 86.1
monochrome 70.9
old 54.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 91.7%
Calm 84.6%
Angry 11.9%
Sad 2.9%
Confused 0.3%
Surprised 0.2%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 36-54
Gender Female, 94.3%
Sad 74.1%
Calm 17.9%
Angry 5.5%
Happy 0.6%
Fear 0.6%
Confused 0.5%
Disgusted 0.4%
Surprised 0.3%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

Human face
Man
Tree
Cowboy hat
Human nose
Human mouth
Human hair
Human eye
Human arm
Human head

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.7%

AWS Rekognition

Hat 99.8%

AWS Rekognition

Hat 83.6%

Clarifai

Human face 96.4%

Clarifai

Human face 91.8%

Clarifai

Man 94.9%

Clarifai

Man 78%

Clarifai

Man 65%

Clarifai

Tree 55.6%

Clarifai

Tree 46.8%

Clarifai

Tree 41.1%

Clarifai

Tree 39.2%

Clarifai

Tree 34.1%

Clarifai

Tree 33.8%

Clarifai

Cowboy hat 47.2%

Clarifai

Human nose 42.7%

Clarifai

Human nose 39.2%

Clarifai

Human mouth 39.3%

Clarifai

Human hair 37.5%

Clarifai

Human eye 35.3%

Clarifai

Human arm 34.2%

Clarifai

Human head 33.8%

Categories

Imagga
created on 2021-12-15

paintings art 99.6%

Captions

Microsoft
created by unknown on 2021-12-15

an old photo of a man 94.7%
a man wearing a hat 92.2%
old photo of a man 92.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

photograph of men in a field.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a man with a hat and a hat on a farm

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image depicts a rural setting with two individuals wearing work clothing, including overalls and hats. The background features modest houses surrounded by trees on a hillside, suggesting a countryside environment. The scene conveys a historical or working-class context, possibly from the early-to-mid 20th century. The individuals are positioned in the foreground and appear to be standing close to one another.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a black and white photograph that captures a rural setting. Two men are standing in the foreground, both wearing overalls and work shirts, indicative of manual labor attire. The man on the left is wearing a cap, while the man on the right is wearing a floppy hat and a coat over his overalls. The background features a landscape with grass and trees, and there are two houses visible on a gentle hillside, suggesting a rural or small community environment. The overall scene evokes a sense of the past, possibly from the early to mid-20th century, and reflects the attire and setting of rural working-class life.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image depicts two men in a rural setting. One man is wearing a hat, overalls, and a jacket, with a serious expression on his face. The other man is standing next to him, also wearing work clothes. In the background, there are several small buildings or structures, suggesting a rural or remote location. The image has a black and white, documentary-style aesthetic, capturing a moment in time of these two individuals in their rural environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from the early-to-mid 20th century. It shows what appears to be rural or farming scene, with white houses visible in the background on a hillside. In the foreground are two individuals wearing typical working clothes of the era - overalls and work jackets. The person more prominently featured in the frame is wearing a wide-brimmed hat and has a weathered, serious expression. The image has the documentary style characteristic of Depression-era photography, capturing the reality of rural American life during that period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of two men standing in front of a rural landscape. The man on the left wears a dark cap, a light-colored shirt, and dark overalls with suspenders. His arms are crossed, and he appears to be looking to his right. The man on the right wears a dark jacket over a light-colored shirt and dark overalls. He also wears a dark hat and has a serious expression.

In the background, there are several houses and trees. The overall atmosphere of the image suggests that it was taken in a rural area, possibly during the 1930s or 1940s, given the clothing and style of the men. The image may have been taken by a photographer documenting life in rural America during that time period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of two men standing in front of a rural landscape. The man on the left wears a dark cap and a light-colored shirt with suspenders, while the man on the right sports a wide-brimmed hat and overalls under a jacket. In the background, several houses are visible, surrounded by trees and grass. The overall atmosphere suggests a scene from the early 20th century, possibly during the Great Depression or another period of economic hardship.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph depicting three men standing on a road. The man in the foreground is wearing a wide-brimmed hat and an apron over a shirt, with a serious expression on his face. The man behind him, partially visible, is wearing a hat and a white shirt. The man in the background, also partially visible, is wearing a hat and a denim jacket. Behind them, there are houses and trees, and the ground is covered in grass.

Created by amazon.nova-pro-v1:0 on 2025-06-08

It is a black-and-white photograph of three men standing in an outdoor area, possibly in a rural area. Two of them are wearing hats, and one of them is wearing a hat and an apron. The man on the right side is wearing a jacket, and he seems to be looking at something. Behind them are houses, and there are trees in the distance.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely taken in a rural setting. It has a documentary feel, possibly capturing a moment in time from the early or mid-20th century. The composition focuses on two men and their surroundings.

Details:

  • Central Figure: The main focus is on a man wearing a wide-brimmed hat. He has a weathered face with a small beard and a serious, perhaps weary, expression. He is wearing overalls under a jacket.
  • Second Figure: To the left, a man is partially visible, wearing a cap and a button-down shirt with overalls. He has his arms crossed, adding to the sense of contemplation or concern.
  • Background: The backdrop includes a dirt road, a hillside with trees, and what appear to be modest, white-painted houses. The landscape suggests a rural or impoverished community.
  • Mood: The photograph evokes a sense of quiet observation and perhaps a hint of hardship. The individuals' expressions and the environment contribute to a feeling of realism and historical context.

Potential Context:

The image is likely a snapshot of a working-class or rural community, possibly from the Depression era or a similar period when photography documented the lives of ordinary people.

Created by gemini-2.0-flash on 2025-05-16

This black and white image depicts two men in an outdoor setting. The man in the foreground, centered slightly to the right, wears a wide-brimmed hat, overalls over a collared shirt, and a jacket. He has a weathered face, a short beard, and a somewhat stern expression. To the left of him, another man is partially visible, wearing a cap and overalls, with his arms crossed. The background features a dirt road and two houses, one of which is perched on a small hill. The overall tone is somber, possibly reflecting the time period or the subjects' economic circumstances.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting two men in a rural setting. The man on the right is prominently featured, looking directly at the camera. He is wearing a wide-brimmed hat, a dark jacket over a lighter shirt, and overalls. His facial expression appears serious, and he has a beard. The man on the left is partially visible, wearing a cap and overalls, and he seems to be looking away from the camera.

In the background, there are several buildings, likely farmhouses or rural dwellings, surrounded by trees and foliage. The scene suggests a rural or agricultural environment, possibly from an earlier time period given the style of clothing and the overall composition of the photograph. The image captures a moment of everyday life in a rustic setting.

Qwen

No captions written