Human Generated Data

Title

Untitled (children of rehabilitation clients, Maria Plantation, Ozarks, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3165

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (children of rehabilitation clients, Maria Plantation, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3165

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Barefoot 100
Body Part 99.9
Finger 99.9
Hand 99.9
Wood 99.9
Sitting 89.8
Clothing 57.8
Hat 57.8
Floor 56.4
Pants 56.2
Hardwood 55
Plywood 55

Clarifai
created on 2018-05-10

people 100
child 100
son 99.1
sit 98.4
two 98.4
group 97.2
boy 96.8
offspring 96.7
three 96.2
baby 96
portrait 96
sibling 94.8
four 94.4
family 93.2
adult 90.5
wear 88.4
facial expression 87.7
sitting 85.6
man 85.1
recreation 84.1

Imagga
created on 2023-10-05

child 46.9
kin 44
mother 30
parent 28
happy 25.7
family 24.9
people 24.5
portrait 23.9
happiness 22.7
male 21.7
sitting 20.6
kid 20.4
outdoors 20.2
cute 20.1
sibling 20
father 19.9
adult 19.4
fun 18.7
person 18.6
bench 18.4
man 17.5
lifestyle 17.3
daughter 16.8
smiling 16.6
smile 16.4
dad 16
little 15.9
love 15.8
face 15.6
childhood 15.2
casual 14.4
old 13.9
boy 13.9
couple 13.1
cheerful 13
outside 12.8
girls 12.8
joy 12.5
leisure 12.5
park 12.3
togetherness 12.3
summer 12.2
park bench 12.1
outdoor 11.5
husband 11.4
together 11.4
seat 11.1
day 11
children 10.9
baby 10.5
looking 10.4
autumn 9.7
home 9.6
laughing 9.4
youth 9.4
relationship 9.4
two 9.3
adorable 9.2
city 9.1
alone 9.1
black 9
religion 9
one 9
hair 8.7
son 8.6
statue 8.6
wall 8.6
wife 8.5
enjoying 8.5
pretty 8.4
fashion 8.3
handsome 8
women 7.9
eyes 7.7
lonely 7.7
culture 7.7
married 7.7
garden 7.5
relaxation 7.5
wood 7.5
senior 7.5
human 7.5
friendship 7.5
care 7.4
teen 7.3
world 7.3
playing 7.3
brother 7.2
dress 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.2
outdoor 97.7
boy 75.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Calm 40%
Sad 37.2%
Happy 21.3%
Confused 9.4%
Surprised 7%
Fear 6.1%
Angry 2.9%
Disgusted 1.2%

AWS Rekognition

Age 4-10
Gender Male, 99.4%
Calm 95.1%
Surprised 6.3%
Fear 5.9%
Sad 3.7%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Boy
Child
Male

Clarifai

Human face
Clothing
Boy
Human arm
Human nose
Human eye
Human hand
Footwear

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.8%

AWS Rekognition

Boy 99.4%

AWS Rekognition

Boy 98.8%

AWS Rekognition

Child 99.4%

AWS Rekognition

Child 98.8%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 98.8%

Clarifai

Human face 95.3%

Clarifai

Human face 93.1%

Clarifai

Clothing 92%

Clarifai

Boy 83.1%

Clarifai

Human arm 48.3%

Clarifai

Human arm 46.5%

Clarifai

Human arm 45.9%

Clarifai

Human nose 45.3%

Clarifai

Human nose 33.5%

Clarifai

Human eye 39.2%

Clarifai

Human eye 37.5%

Clarifai

Human eye 37.3%

Clarifai

Human hand 38.2%

Clarifai

Footwear 35.3%

Clarifai

Footwear 35%

Clarifai

Footwear 34.5%

Categories

Imagga
created on 2023-10-05

paintings art 97.3%
people portraits 2.5%

Captions

Microsoft
created by unknown on 2018-05-10

a boy sitting on a bench 54.7%
a young boy sitting on a bench 44.9%
a little boy sitting on a bench 41.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a black and white photo of two children

Created by general-english-image-caption-blip-2 on 2025-07-06

two boys sitting on the porch of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts two young children sitting on a wooden porch. One child is barefoot with visibly dirty feet, wearing distressed overalls with a sleeveless shirt underneath. The other child seems to be dressed in striped overalls. The setting appears rustic and simple, with a wooden structure in the background suggesting a rural environment. The mood captures a candid and humble moment.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts two young children sitting on a wooden porch. Both children are wearing overalls, and their clothes appear worn and dirty, suggesting a rural or impoverished setting. The child on the left has their knees drawn up and is using one hand to lean against the side of the porch, while the other child has their legs extended, showing bare feet. The child on the right appears to be holding or playing with an object, possibly a stick or tool, indicating a moment of leisure or play. The backdrop consists of a simple wooden structure, likely part of a building or house. The scene is captured in black and white, suggesting that the photograph may be historical or intended to evoke a certain era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows two young boys sitting on a wooden floor in what appears to be a rustic, outdoor setting. The boys are dressed in simple, worn clothing, suggesting they may be from a lower-income or impoverished background. One boy is sitting with a pensive, almost sad expression, while the other has a more playful, mischievous look on his face. The image conveys a sense of hardship and the challenges faced by children growing up in difficult circumstances.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white historical photograph showing two young children sitting on what appears to be a wooden porch or platform. One child is wearing striped clothing and sitting with their hand near their forehead, while the other is wearing overalls and sitting more casually with bare feet visible. The image has a rustic, rural quality typical of early-to-mid 20th century documentary photography. The children appear to be from a working-class or farming background, given their simple, worn clothing. The composition and lighting create a candid, documentary-style portrait that captures a moment of everyday life from this historical period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts two young boys sitting on a wooden porch, likely taken in the early 20th century. The boy on the left is dressed in a long-sleeved shirt and pants, with his right hand resting on his forehead. The boy on the right wears overalls and a white shirt, holding an object in his hands. Both boys appear to be barefoot and are seated on a wooden porch with a door behind them. The overall atmosphere suggests a rural setting, possibly during a time of economic hardship or poverty.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image depicts two young boys sitting on a wooden porch, with the boy on the left wearing overalls and the boy on the right wearing overalls and a white shirt. The boy on the left has his hand raised to his forehead, while the boy on the right is holding a piece of cloth in his hands.

The background of the image shows the interior of a wooden building, with a dark and dimly lit atmosphere. The overall mood of the image is one of poverty and hardship, as the boys appear to be living in difficult circumstances. The image may have been taken during the Great Depression or another period of economic hardship.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph of two young boys sitting on a wooden porch. The boy on the left is sitting with his legs crossed and his hand on his forehead, looking to the side. The boy on the right is sitting with his legs spread and his feet up on the porch, looking directly at the camera with a slight smile on his face. The boys are wearing overalls, and the boy on the right has a dirt stain on his face. The porch is made of wood, and there is a wooden wall behind them.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image is a black and white photograph of two children sitting on a wooden floor. The children are wearing overalls and are barefoot. The child on the left has his hand on his forehead, while the child on the right is holding a piece of paper. Behind them is a wooden wall. The children appear to be posing for a photograph.

Google Gemini

Created by gemini-2.0-flash on 2025-05-23

This is a vintage black and white photograph depicting two young boys sitting on what appears to be a porch. The boy on the left is seated on the weathered wooden planks. He wears a long-sleeved, striped outfit that seems worn and possibly patched. His posture suggests tiredness or pensive mood, as he shields his eyes with his hand.

The boy on the right is also seated on the wooden porch, but he is wearing overalls over a light-colored shirt. He appears to be holding something in his hands, possibly a piece of straw or twine, and his expression is one of slight amusement or satisfaction. His feet are bare and rest on the wooden surface.

The setting behind the boys appears to be the entrance to a building or home, with a wooden door or wall serving as the backdrop. The overall image conveys a sense of a bygone era, likely reflecting the hardships and simple lives of children in a rural or impoverished setting during the early to mid-20th century. The stark contrast and tones characteristic of black and white photography enhance the emotional impact and timeless quality of the scene.

Created by gemini-2.0-flash-lite on 2025-05-23

Here's a description of the image:

The black and white photograph captures two young boys sitting on a weathered wooden porch. The boy on the left is leaning forward, resting on his hands, and shielding his eyes with his hand. He's wearing a loose, striped button-down shirt and pants. The boy on the right is sitting upright with his legs outstretched, wearing worn overalls over a t-shirt. He is working with something between his hands, possibly a piece of twine or a blade of grass. Both boys have bare feet and appear somewhat dirty. The background consists of wooden planks, suggesting a simple, rural setting. The image exudes a sense of simplicity, hardship, and the everyday life of children in a historical context. The overall impression is one of quiet contemplation and perhaps a hint of the challenges faced by these youngsters.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image depicts two young boys sitting on a wooden porch. Both boys are barefoot and dressed in simple, worn clothing. The boy on the left is wearing a striped shirt and pants, with one hand resting on his head and the other on his knee. He appears to be looking downward, with a somewhat pensive expression. The boy on the right is wearing overalls with a shirt underneath, and he is smiling directly at the camera while holding a small object, possibly a knife, in his hands. The background shows a rustic wooden structure, likely a house or cabin, with a door and window visible. The overall scene suggests a rural setting, possibly from an earlier time period, reflecting a simple, modest lifestyle.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image shows two children sitting on a wooden platform. The child on the left is wearing a long-sleeved, striped shirt and pants, and appears to be barefoot. This child is resting their head on their hand, looking downward with a thoughtful or tired expression. The child on the right is wearing a sleeveless dress with ruffled details and is also barefoot. This child is sitting upright, holding what appears to be a small object in their hands, possibly a stick or a piece of wood. The background consists of wooden planks and a door, suggesting the setting might be a porch or a similar outdoor area. The photograph has a vintage, black-and-white aesthetic, which adds to its historical feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This is a black-and-white photograph depicting two young children sitting on a wooden porch. The child on the left is wearing a long-sleeved shirt and pants, with one hand covering part of their face, possibly shielding their eyes from the sun. The child on the right is wearing a sleeveless dress and appears to be holding a small object. Both children are barefoot, and their clothing appears to be worn and patched. The background consists of wooden walls and a door, suggesting they are sitting on the porch of a wooden house. The overall scene conveys a sense of simplicity and perhaps hardship.