Human Generated Data

Title

Untitled (Branchville, Maryland)

Date

November 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1855

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Branchville, Maryland)

People

Artist: Ben Shahn, American 1898 - 1969

Date

November 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1855

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Coat 100
Hat 100
Cap 99.9
Baseball Cap 90.1
Overcoat 88.6
Face 82.2
Head 82.2
Back 60.8
Body Part 60.8
Outdoors 60.5
Hardhat 55.7
Helmet 55.7
Sun Hat 55.1
Military 55

Clarifai
created on 2018-05-11

people 99.7
military 98.3
man 96.2
war 95.9
group 95.2
group together 95.2
adult 94.7
gun 92.4
vehicle 92
police 91.4
soldier 90.4
lid 89.5
administration 89.5
transportation system 89
two 87.7
weapon 87.5
uniform 87.3
wear 86.6
veil 86.2
recreation 84.1

Imagga
created on 2023-10-07

hat 36.7
man 34.3
male 29.8
cowboy hat 28.4
people 23.4
clothing 22
person 19.7
headdress 17.2
outdoors 16.4
adult 14.3
uniform 14.3
sport 14
outdoor 13
men 12.9
happy 12.5
military uniform 12.4
portrait 12.3
covering 12.1
suit 11.9
business 11.5
walk 11.4
couple 11.3
travel 11.3
one 11.2
two 11
lifestyle 10.8
leisure 10.8
active 10.8
silhouette 10.8
park 10.7
consumer goods 10.6
hiking 10.6
boy 10.4
saddle 10.2
mountain 9.8
old 9.7
stretcher 9.4
sitting 9.4
building 9.1
alone 9.1
cowboy 9.1
black 9.1
guy 8.9
working 8.8
backpack 8.8
together 8.8
love 8.7
child 8.6
play 8.6
construction 8.5
outside 8.5
horse 8.5
adventure 8.5
face 8.5
action 8.4
city 8.3
musical instrument 8.3
snow 8.2
fun 8.2
vacation 8.2
grandfather 8
businessman 7.9
tie 7.9
work 7.8
weapon 7.7
military 7.7
litter 7.7
sky 7.6
sidesaddle 7.6
walking 7.6
pair 7.5
field 7.5
smile 7.1
gun 7.1
happiness 7

Microsoft
created on 2018-05-11

person 99.2
man 90.3
outdoor 87.2
gun 26.7

Color Analysis

Feature analysis

Amazon

Adult
Male
Man
Person

Clarifai

Man
Clothing
Tree
Human face
Human head

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 99%

AWS Rekognition

Adult 98.9%

AWS Rekognition

Adult 98.9%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 99%

AWS Rekognition

Male 98.9%

AWS Rekognition

Male 98.9%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 99%

AWS Rekognition

Man 98.9%

AWS Rekognition

Man 98.9%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 93.1%

Clarifai

Man 85.4%

Clarifai

Man 82.7%

Clarifai

Man 76.3%

Clarifai

Man 46.2%

Clarifai

Clothing 85.2%

Clarifai

Clothing 45%

Clarifai

Tree 80.4%

Clarifai

Tree 64.6%

Clarifai

Human face 53.6%

Clarifai

Human face 45.7%

Clarifai

Human face 40.8%

Clarifai

Human face 39.9%

Clarifai

Human head 35.8%

Categories

Imagga
created on 2023-10-07

nature landscape 60.3%
paintings art 22.9%
streetview architecture 11%
pets animals 4.7%

Captions

Microsoft
created by unknown on 2018-05-11

a black and white photo of a man 88.4%
a group of people in uniform 87.2%
an old photo of a man 87.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a group of men standing on a truck bed

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of men in hats and coats sitting on the back of a truck

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The black-and-white image depicts a group of men sitting on the back of an open truck or similar vehicle. Their backs are turned to the camera, and they are wearing flat caps, with jackets or sweaters, which suggest an older time period or a rural/work setting. The bright background implies a sunny day, while some trees are visible to the right side of the image. The scene conveys a casual or work-oriented atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-12

The black and white image depicts a group of men sitting in the back of a truck. The men are dressed in dark outerwear and flat caps. The focus is on their backs, creating a silhouette effect against the bright sky in the background. The men's faces are partially visible as they turn slightly to the side, and the image captures a candid moment of them in conversation or contemplation. The photo has a vintage feel, likely from the early to mid-20th century. A tree with leaves occupies some of the space in the background, indicating an outdoor setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a group of men, likely from a historical period, standing together on what appears to be a platform or stage. They are all wearing hats and coats, suggesting they are dressed formally. The image is in black and white, giving it an older, vintage feel. The men are facing away from the camera, so their faces are not visible. The overall scene conveys a sense of formality and seriousness.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph showing several people sitting in a row, viewed from behind. They appear to be sitting on what looks like a bench or ledge with metal fixtures visible along its edge. Each person is wearing typical early-to-mid 20th century working class attire, including flat caps and jackets. The image has a documentary or candid quality to it, capturing what seems to be an everyday moment. The composition creates an interesting pattern with the lined-up figures, all facing the same direction, and their similar clothing and postures create a sense of unity in the scene.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of men standing in the back of a truck or trailer, facing away from the camera. The men are dressed in dark clothing and caps, with some wearing jackets or coats. They appear to be standing in a line, possibly waiting for something or someone.

The background of the image is a light-colored sky, with trees visible on the right side of the frame. The overall atmosphere of the image suggests that it may have been taken during a work-related event or activity, such as a construction project or a farm-related task.

The image appears to be an old photograph, possibly from the early 20th century, given the style of clothing and the quality of the image. The photograph has been scanned and digitized, resulting in a slightly grainy and faded appearance.

Overall, the image provides a glimpse into a moment in time, capturing the activities and attire of a group of men in a rural or industrial setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of men standing in the back of a truck. The men are all wearing dark jackets and caps, with their backs to the camera. They appear to be looking out at something in front of them, but it's not clear what that is.

The truck has a metal frame with bolts visible on the sides, and the men are standing on a flatbed. There are trees visible in the background, suggesting that the photo was taken outdoors. The overall atmosphere of the image is one of seriousness and focus, as if the men are engaged in some kind of important activity or task.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The black-and-white image shows a group of men sitting on the back of a vehicle, probably a truck. They are all wearing hats, and some of them are wearing glasses. The man on the left is wearing a long-sleeve shirt, while the man on the right is wearing a jacket. The man in the middle is wearing a coat. They are all looking in the same direction, and it seems like they are talking to each other.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photo shows a group of people standing on the back of a truck. They are all wearing hats and jackets, and they are all looking in the same direction. The truck is made of wood, and it has metal hinges on the back. There is a tree behind them, and the sky is clear. The truck seems to be moving, and the people are enjoying the ride.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

The black and white photograph shows a group of men wearing caps sitting on the edge of a vehicle, presumably a truck or wagon. Their backs are to the camera, and they seem to be looking at something in the distance. The men are dressed in what appears to be work clothes, suggesting they may be laborers or farmers. A tree stands to the right of the frame, with its bare branches indicating it might be autumn or winter. The scene is simple and evokes a sense of rural life or a time gone by.

Created by gemini-2.0-flash-lite on 2025-06-05

Here's a description of the image:

The image is a black and white photograph showing a group of men from the back, seated on what appears to be the edge of a truck bed or similar platform. The men are all wearing caps and dark jackets or sweaters.

Here's a breakdown:

  • Composition: The photo is taken from a low angle, looking up at the men. The focus is on their backs, creating a sense of anonymity.
  • Lighting: The lighting suggests it's a bright day, likely outdoors. The shadows cast by the men give definition to their forms and the surface they're sitting on.
  • Details:
    • The men are wearing what look like flat caps, common in many historical time periods.
    • The clothing appears practical and simple, possibly indicative of a working class or rural setting.
    • A few hints of foliage and a bright sky are visible in the background.
  • Overall Impression: The photograph evokes a sense of mystery and a connection to the past. It suggests a gathering or moment of observation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of people standing in the back of a truck. The people are seen from behind, facing away from the camera. They are dressed in heavy clothing, including coats and hats, suggesting a cold or cool climate. The truck appears to be an open-back vehicle, possibly used for transportation or labor. The background is somewhat blurred, but there are trees and foliage visible, indicating an outdoor setting. The overall mood of the image is somber and historical, possibly reflecting a period of hardship or significant historical events.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image is a black and white photograph featuring a group of men viewed from behind. They are standing in what appears to be the back of a truck or a similar vehicle, with their backs to the camera. The men are dressed in winter clothing, including coats and hats, suggesting a cold environment. The truck bed is visible in the foreground, with its edges and metal fastenings clearly shown. The background includes a bright sky and the tops of tree branches, indicating that the photo was taken outdoors on a day with clear weather. The overall composition and attire of the individuals suggest a historical or possibly wartime setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph shows a group of men standing in the back of a truck or similar vehicle. They are dressed in attire typical of the early to mid-20th century, including caps and jackets. The men appear to be looking in the same direction, possibly observing something of interest. The background includes trees, suggesting an outdoor setting. The image has a vintage quality, with some wear and tear visible on the edges and surface.