Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania

Date

1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3107

Human Generated Data

Title

Boys who salvage coal from the slag heaps at Nanty Glo, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3107

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Person 99.2
Face 90.9
Hat 83.2
Clothing 83.2
Apparel 83.2
People 69.5
Outdoors 69.2
Photography 65.6
Photo 65.6
Portrait 65.2
Smile 58.5
Wheel 57.9
Machine 57.9

Clarifai
created on 2023-10-15

people 100
portrait 99.8
child 99.5
boy 98.9
group together 98.4
group 98.2
adult 98
man 97.8
three 97.3
two 97.3
soldier 97.1
war 96.8
son 96.8
uniform 95.9
military 95.8
wear 94.1
documentary 94
monochrome 91.7
one 90.6
retro 89.7

Imagga
created on 2021-12-15

child 55.2
sibling 28.2
portrait 24.6
people 24.5
male 24.4
person 23.8
man 22.8
happy 22.6
love 20.5
adult 20
childhood 18.8
beach 18.5
outdoors 17.9
face 17
kid 16.8
outdoor 16.8
boy 16.5
dad 16.4
summer 16.1
parent 15.9
father 15.7
fun 15.7
smile 15.7
smiling 15.2
family 15.1
happiness 14.9
world 14.8
girls 14.6
youth 14.5
sand 14.2
couple 13.9
vacation 13.9
outside 13.7
hair 13.5
son 13.1
juvenile 13.1
men 12.9
playing 12.8
two 12.7
model 12.4
lifestyle 12.3
mother 12.1
one 11.9
children 11.8
joy 11.7
holiday 11.5
together 11.4
play 11.2
pretty 11.2
black 10.8
leisure 10.8
cute 10.8
little 10.6
fashion 10.5
human 10.5
attractive 10.5
women 10.3
park 9.9
old 9.8
brother 9.4
sky 8.9
lady 8.9
body 8.8
day 8.6
enjoying 8.5
clothing 8.5
casual 8.5
senior 8.4
active 8.1
looking 8
sea 7.8
life 7.7
eyes 7.7
expression 7.7
sport 7.7
hat 7.6
toddler 7.6
hand 7.6
healthy 7.6
cheerful 7.3
sexy 7.2
activity 7.2
grass 7.1

Microsoft
created on 2021-12-15

text 99.5
human face 98.1
clothing 96.8
person 95.6
smile 95.3
outdoor 92.8
black and white 85.9
man 73
posing 48.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-21
Gender Male, 96%
Happy 88.6%
Calm 10.9%
Angry 0.3%
Sad 0.1%
Surprised 0.1%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 2-8
Gender Male, 99.3%
Happy 95.8%
Calm 1.4%
Confused 1.2%
Angry 0.5%
Surprised 0.5%
Sad 0.3%
Fear 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Wheel
Person 99.5%
Person 99.2%
Hat 83.2%
Wheel 57.9%

Categories

Imagga

people portraits 52.4%
paintings art 46.9%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a black and white photo of two boys -100%

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here is a description of the image:

This is a black and white photograph featuring two young boys. The boy on the left is wearing a newsboy cap and overalls. His face is smudged. The boy on the right, standing closer to the camera, is smiling and has short, choppy hair and is wearing a long-sleeved shirt. The background is blurred and features an old-fashioned vehicle and some work-related equipment like a bucket, a wheelbarrow and a pile of coal. The picture has a historical and possibly documentary feel, suggesting it could be from the early 20th century.

Created by gemini-2.0-flash on 2025-05-16

The photograph is a black-and-white portrait of two young boys standing close together. One boy is on the left, wearing a cap and overalls with a shoulder strap visible. His face is slightly dirty, and he has a small smile. The other boy, on the right, has light-colored, tousled hair and wears a shirt or jacket. He also has a slight smile.

In the background, slightly out of focus, there's a dilapidated-looking setting. A wooden cart or structure sits behind the boy on the left, and a bucket is positioned near it. Further back, there is a vehicle with a visible wheel and what appears to be a person sitting inside. The overall tone of the photograph suggests a time period of hardship and poverty.