Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania

Date

1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3108

Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3108

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.4
Human 99.4
Person 99.4
Boy 89.4
Face 88
Wheel 86.9
Machine 86.9
Hat 79
Clothing 79
Apparel 79
Kid 62.6
Child 62.6
Outdoors 60.6
People 60.3
Smile 59.6
Photography 59.2
Photo 59.2
Portrait 58.8

Clarifai
created on 2023-10-15

people 100
portrait 99.7
group together 98.5
child 98.3
soldier 98.1
man 98
group 97.9
adult 97.9
three 97.5
war 97.3
boy 96.9
military 96.8
two 96.4
uniform 95.9
wear 94.5
documentary 90.6
son 90.2
army 88.3
veil 87.8
retro 85.5

Imagga
created on 2021-12-15

child 57.8
happy 26.9
person 26.2
people 26.2
male 24
adult 22.6
man 22.2
world 20.7
portrait 20.7
smiling 20.3
happiness 19.6
smile 18.5
outdoors 17.9
boy 17.4
love 17.4
summer 16.1
joy 15.9
family 15.1
juvenile 15.1
kid 15.1
sibling 14.9
sitting 14.6
parent 14.4
father 14.4
dad 14.1
couple 13.9
attractive 13.3
outdoor 13
cute 12.9
youth 12.8
fun 12.7
childhood 12.5
mother 12.5
together 12.3
face 12.1
looking 12
car 11.9
pretty 11.9
girls 11.8
beach 11.8
day 11
model 10.9
vacation 10.6
son 10.6
little 10.6
clothing 10.6
old 10.4
enjoying 10.4
black 10.3
women 10.3
grass 10.3
two 10.2
lifestyle 10.1
children 10
leisure 10
vehicle 9.9
sky 9.6
hair 9.5
outside 9.4
holding 9.1
one 9
sand 8.8
home 8.8
eyes 8.6
expression 8.5
relationship 8.4
park 8.2
playing 8.2
lady 8.1
handsome 8
brunette 7.8
play 7.8
work 7.7
laugh 7.7
fashion 7.5
care 7.4
camera 7.4
adorable 7.4
sexy 7.2
holiday 7.2
daughter 7.1
posing 7.1
look 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.7
human face 96.6
clothing 95.2
outdoor 95.1
person 93.4
smile 92.8
man 84.8
black and white 81.6
vehicle 75.7
land vehicle 65.9
car 59.3
posing 47.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 14-26
Gender Male, 98.2%
Happy 84.5%
Calm 14.7%
Angry 0.5%
Sad 0.1%
Surprised 0.1%
Fear 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 2-8
Gender Male, 99.6%
Happy 96.5%
Calm 1.4%
Confused 0.9%
Surprised 0.4%
Angry 0.4%
Sad 0.2%
Fear 0.2%
Disgusted 0%

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Wheel
Hat
Person 99.4%
Person 99.4%
Wheel 86.9%
Hat 79%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and a boy are posing for a picture -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This vintage photograph depicts two individuals dressed in rugged workwear, suggesting they may be laborers or involved in manual work. The scene has a gritty, industrial feel, with a wooden wheelbarrow, a metal bucket, chopped logs, and scattered debris in the foreground. In the background, an old car is partially visible, indicating the historical setting. The overall composition reflects a working-class environment, possibly from the early to mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts two boys dressed in worn work clothing, standing outdoors. They are likely laborers or workers, as suggested by their attire, which includes overalls. One of the boys wears a cap. The setting appears to be a work site or industrial area, given the presence of scattered logs and what seems to be a bucket beside them. In the background, a vintage car is partially visible, adding to the context of the time period. The photograph is black and white, indicative of an older image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows two young boys in a rural or outdoor setting. One boy is wearing a cap and has a serious expression, while the other boy has a more playful, smiling expression. They appear to be in a setting with some old vehicles or machinery in the background. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white historical photograph that appears to be from the early-to-mid 20th century. It shows two young children wearing work clothes and flat caps, typical of working-class attire from that era. They're wearing what appears to be overalls or work jackets, and their clothes and faces show signs of dirt or grime, suggesting they might be from a working-class or industrial environment. In the background, there appears to be some industrial equipment or vehicles. The image has a documentary-style quality to it, similar to those taken during the Industrial Revolution or Great Depression era to document working conditions and daily life.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black and white photograph of two boys sitting in front of a pile of trash, with a car visible in the background. The boy on the left is wearing a cap and has a bag slung over his shoulder, while the boy on the right is wearing a jacket and has a bag on his back. Both boys appear to be dirty and are looking at the camera with a smile.

In the background, there is a pile of trash, including a car, a wheelbarrow, and other debris. The overall atmosphere of the image suggests that the boys are likely homeless or living in poverty, and are trying to make the best of their situation. The image may have been taken during a time of economic hardship or war, as the boys' clothing and the state of the background suggest a post-apocalyptic or war-torn environment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of two young boys, likely from the 1930s or 1940s, sitting together in front of a pile of junk and debris. The boy on the left wears a newsboy cap and a dark jacket, while the boy on the right has short hair and a dark shirt. In the background, there are old cars, logs, and other discarded items, suggesting that the boys may be living in poverty or scavenging for scraps. The overall atmosphere of the image is one of hardship and resilience, capturing a moment in time when these young boys were forced to adapt to difficult circumstances.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

In a black-and-white photo, two boys are standing close to each other, smiling, and posing for a photo. The boy on the left is wearing a hat and an apron, while the boy on the right is wearing a shirt. Behind them is a bucket, a pile of wood, and a wheelbarrow. In the distance, there are two vehicles parked on the side of the road.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph of two young boys standing in a muddy area. The boy on the left is wearing a hat and a shirt with suspenders, and he is looking at something off-camera. The boy on the right is wearing a shirt and has his arms around the boy on the left. Behind them, there is a wooden cart, a bucket, and a car parked on the road. The image has a vintage look, and it appears to be from the early 20th century.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-28

The image is a black and white photograph featuring two young boys. They are smiling at the camera. The boy on the left is wearing a newsboy cap and a dark, button-up shirt. His face has a sooty or dirty appearance, as if he’s been working in a coal mine. The boy on the right has light-colored hair and a similarly styled shirt. They seem to be standing in a somewhat industrial or utilitarian setting. In the background, a cart, a bucket, and possibly a vehicle or more equipment are visible, hinting at the boys' environment. The overall tone of the photograph is serious but the smiles on the boys' faces soften the impression.

Created by gemini-2.0-flash on 2025-04-28

The image is a black and white photograph of two young boys, likely taken during the Great Depression era. They are positioned in the foreground, slightly angled towards the camera, giving the viewer a close-up perspective.

The boy on the left is wearing a newsboy cap and a dark, buttoned-up shirt with what appear to be suspenders. His face is slightly smudged with dirt, particularly around his mouth and cheeks. He has a faint smile.

The boy on the right has lighter hair and is wearing a simple, dark shirt. He has a more pronounced smile.

Behind the boys, there's a worn-looking wooden cart filled with what appears to be coal. A partially visible bucket and some logs are also in the background.

In the far background, there's an old-fashioned vehicle, possibly a truck or car, with a person visible near it. The overall setting appears to be somewhat impoverished, reflecting the harsh realities of the time period. The image has a grainy texture, typical of photographs from that era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-23

The image is a black-and-white photograph featuring two young boys standing outdoors. Both boys are smiling at the camera, and they appear to be in a rugged, possibly rural or industrial setting.

The boy on the left is wearing a cap, a dark jacket, and overalls. He has a dirty face, which suggests he might have been playing or working in the area. The boy on the right is dressed in a dark shirt and has light-colored hair.

In the background, there are various objects and debris, including a wooden crate, a bucket, and some scattered logs or pieces of wood. There is also a vehicle that looks like an old car or truck, further suggesting the setting might be from an earlier time period. The ground appears to be uneven and covered with dirt and small rocks.

Overall, the image captures a moment of joy and camaraderie between the two boys amidst a rough, outdoor environment.