Human Generated Data

Title

Untitled (Branchville, Maryland)

Date

November 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1931

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Branchville, Maryland)

People

Artist: Ben Shahn, American 1898 - 1969

Date

November 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1931

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Photography 99.8
Clothing 99.4
Coat 99.4
War 95.2
Face 91.2
Head 91.2
Portrait 91.2
Captain 57.9
Officer 57.9
Military 57.7
Weapon 57.7
Military Uniform 57.3
Cannon 56.9
Hat 56.4
People 56.3
Worker 55.9
Soldier 55.7
Cap 55.5
Sitting 55.3
Gun 55.1

Clarifai
created on 2018-05-11

people 99.7
man 98.2
two 97.5
lid 94.5
adult 94
portrait 91.1
military 89.3
veil 87.2
woman 85.8
group 85.5
group together 84
wear 82.4
three 82.1
couple 78.9
partnership 77.6
administration 77.4
war 75.8
leader 74.6
outfit 71.1
uniform 69.6

Imagga
created on 2023-10-06

man 46.4
male 42.6
person 29.7
people 28.4
hat 28
suit 28
businessman 24.7
adult 24.1
business 23.7
men 21.5
black 19.2
professional 19.1
portrait 18.1
handsome 17.8
silhouette 16.6
face 16.3
corporate 16.3
executive 15.8
happy 15.7
success 15.3
job 15
worker 14.2
manager 13
office 12.8
smile 12.8
one 12.7
hand 12.3
guy 12.3
expression 11.9
attractive 11.9
clothing 11.7
human 11.2
work 11
model 10.9
boy 10.7
adolescent 10.7
occupation 10.1
successful 10.1
couple 9.6
boss 9.6
studio 9.1
laptop 9.1
fashion 9
looking 8.8
look 8.8
juvenile 8.6
formal 8.6
sitting 8.6
grandfather 8.6
elegant 8.6
construction 8.6
businesspeople 8.5
tie 8.5
casual 8.5
modern 8.4
mature 8.4
dark 8.3
team 8.1
group 8.1
computer 8
working 7.9
lifestyle 7.9
building 7.9
hands 7.8
spectator 7.8
serious 7.6
meeting 7.5
baron 7.5
safety 7.4
indoor 7.3
confident 7.3
love 7.1
cowboy hat 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 88.7
old 65.1
posing 43.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.5%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Calm 78.3%
Happy 7.5%
Sad 6.9%
Surprised 6.6%
Fear 6.3%
Disgusted 1.9%
Confused 1.6%
Angry 0.4%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person

Clarifai

Clothing
Man
Human face
Human arm

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 98.8%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 98.8%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 98.8%

Clarifai

Clothing 96.1%

Clarifai

Clothing 93.4%

Clarifai

Man 81.2%

Clarifai

Man 37.9%

Clarifai

Human face 81%

Clarifai

Human face 72.1%

Clarifai

Human face 68.5%

Clarifai

Human arm 43.1%

Clarifai

Human arm 33.3%

Categories

Imagga
created on 2023-10-06

nature landscape 36%
pets animals 22.6%
paintings art 18.5%
streetview architecture 15.7%
people portraits 2.2%
food drinks 1.9%
interior objects 1.6%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of men in suits and hats sitting on a boat

Created by general-english-image-caption-blip-2 on 2025-07-07

three men in hats sitting on a boat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This black-and-white photograph depicts three individuals sitting in the back of a vehicle, possibly a truck, with a wooden railing visible. They are wearing flat caps and attire suggesting a historical or work-related setting. The surrounding area hints at an outdoor environment, with a utility pole and electrical lines visible in the background.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts three individuals sitting on what appears to be the bed of a wooden truck or similar vehicle. The individuals are wearing caps and heavy clothing that suggest cooler weather or a working environment. The setting seems to be outdoors, possibly in a rural area, as indicated by the presence of wooden utility poles and what seems to be telegraph or telephone lines in the background. The photograph has a vintage black-and-white appearance, which might suggest that it was taken in an earlier era, such as the mid-20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows three men sitting in what appears to be a wooden cart or wagon. They are all wearing caps or hats and have serious expressions on their faces. The men seem to be from an earlier time period, likely the early to mid-20th century based on their clothing and the black and white nature of the photograph. The background is somewhat blurred, but there appears to be some kind of structure or building in the distance.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white vintage photograph showing three men sitting together, likely on some kind of vehicle or platform. They're all wearing similar working-class attire typical of the early-to-mid 20th century, including flat caps (also known as newsboy or driving caps) and what appears to be work clothes or jackets. Utility poles with power lines can be seen in the background. The image has the grainy, slightly blurred quality characteristic of photographs from this era. The men appear to be in a casual, relaxed setting, with one of them showing a slight smile. The composition suggests this might be a candid shot of workers during a break or while on the job.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of three men sitting on a bench. The man on the left is wearing a dark coat and a dark cap, and he is turned to the right, looking at the other two men. The man in the middle is wearing a dark shirt and pants, and a light-colored cap. He is sitting with his left elbow resting on his left knee and his right hand on his chin. The man on the right is wearing a dark coat and a dark cap, and he is turned to the left, looking at the other two men. The background of the image is a light sky, with a telephone pole visible behind the man on the right.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of three men sitting on what appears to be a train car. The man on the left is wearing a dark jacket and a cap, and he is looking at the camera with his head turned slightly to the right. The man in the middle is also wearing a dark jacket and a cap, and he is looking at the camera with his left hand raised to his chin. The man on the right is wearing a dark jacket and a cap, and he is looking at the camera with his hands in his pockets.

In the background, there are several power lines and poles visible, as well as a telephone pole. The sky is overexposed, making it difficult to determine the time of day or the weather conditions. Overall, the image suggests that the men are taking a break or waiting for something to happen, possibly related to their work on the train.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image shows three men sitting in the back of a truck, all wearing hats. The man on the left is sitting with his legs crossed, and the man in the middle is smiling while his hands are on his waist. The man on the right is looking to the side. The truck is parked on the side of the road, with a pole and electric wires in the background. The image is in black and white.

Created by amazon.nova-pro-v1:0 on 2025-06-10

A black-and-white photo of three men sitting on what seems to be a truck. The man in the middle is wearing a hat and has his arms crossed. The man on the left is wearing a hat and is holding a book. The man on the right is wearing a hat and is looking to the right. Behind them are what seem to be electric poles.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

The black and white photograph captures a scene of three men, likely in a work environment, possibly dating back several decades. They are all dressed in what appears to be working attire, which is suggestive of a manual labor background. The men are wearing similar hats, which suggest some degree of commonality. The man on the left is partially obscured by the vehicle he is leaning against, while the other two are in a seated position and facing forward. The presence of a utility pole in the background indicates an outdoor setting. The overall impression is that of a candid, perhaps informal, snapshot taken during a work break or a moment of respite. The graininess of the image gives it a vintage feel, potentially hinting at a historical context.

Created by gemini-2.0-flash on 2025-05-09

The image is a black-and-white photograph of three men. The man on the left is partially obscured, as if he's standing next to or behind a vehicle. He's wearing a cap and appears to be looking towards the right.

The man in the center is seated and has his hands clasped near his chest. He's also wearing a cap and looking directly at the camera with a slight smile.

The man on the right is wearing a jacket and a cap. He also appears to be seated and is looking towards the camera.

Behind the men, there's a hint of a fence or wire structure. The background is generally plain, with an overcast sky. The overall style and quality of the image suggest that it's an older photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring three men sitting on what appears to be the back of a vehicle or a large piece of machinery. The men are dressed in work attire, including jackets and flat caps, which suggests that the photo may have been taken in a work or industrial setting.

  • The man on the left is looking towards the camera with a neutral expression.
  • The man in the middle is leaning on his left arm, which is resting on his knee, and has a relaxed posture. He is smiling slightly.
  • The man on the right is also looking towards the camera with a neutral expression. He is wearing a tie and has his hands in his pockets.

The background is quite bright, possibly due to overexposure, making it difficult to discern specific details. However, there are some faint outlines of structures or buildings, indicating that they might be in an outdoor, possibly urban or industrial environment. The overall mood of the photograph seems casual and candid, capturing a moment of rest or a break from work.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph depicting three men sitting together outdoors. They appear to be dressed in early-to-mid 20th-century attire, including hats and jackets. The man on the left is partially obscured by a large, rectangular object, possibly a piece of equipment or machinery. The man in the center is smiling and has one hand near his neck, while the man on the right is looking directly at the camera with a neutral expression. The background is bright and overexposed, making it difficult to discern specific details, though some structures and possibly a utility pole are faintly visible. The overall style of the photograph suggests it could be from the 1930s or 1940s.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph showing three men sitting in the back of a vehicle, possibly a truck. All three men are wearing caps and are dressed in what appears to be work attire. The man on the left is leaning slightly forward, the man in the middle has his hand on his shoulder, and the man on the right is sitting upright. The background is plain, with a light-colored sky and some power lines visible. The image has a vintage feel, likely from the mid-20th century.