Human Generated Data

Title

Untitled (sharecropper family, Little Rock, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2747

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (sharecropper family, Little Rock, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2747

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 99.3
Person 99.2
Boy 99.2
Child 99.2
Male 99.2
Person 97.7
Baby 97.7
Architecture 97.1
Building 97.1
Hospital 97.1
Clothing 96.9
Shorts 96.9
Furniture 95.3
Face 93.7
Head 93.7
Photography 85.2
Portrait 85.2
Crib 84
Infant Bed 84
Bed 66.7
Chair 57.9
Patient 55

Clarifai
created on 2018-05-10

people 100
group 99.6
child 99
adult 98.3
three 98.2
two 98.1
four 97.3
man 96.8
woman 96.7
offspring 96.5
group together 96.4
family 95.6
sibling 94.6
five 94.4
several 94.2
medical practitioner 93.9
furniture 93.2
son 92.9
administration 91.3
wear 91.3

Imagga
created on 2023-10-06

male 43.1
family 37.4
man 37
happy 32.6
child 32.3
person 32.2
father 31.1
couple 30.5
people 29
adult 26
love 24.5
together 23.7
smiling 23.2
lifestyle 23.1
parent 23
casual 22.9
mother 22.9
kin 21.9
fun 21.7
portrait 20.1
home 19.9
happiness 19.6
senior 18.7
husband 18.1
son 18
smile 17.8
world 17.5
attractive 16.8
boy 16.5
daughter 16.3
sibling 16.3
sitting 16.3
joy 15.9
cheerful 15.4
wife 15.2
togetherness 15.1
dad 15.1
mature 13.9
outdoors 13.4
kid 13.3
two 12.7
married 12.5
leisure 12.5
jeans 12.4
grandfather 12.4
men 12
couch 11.6
patient 11.6
elderly 11.5
indoors 11.4
playing 10.9
parents 10.8
laughing 10.4
youth 10.2
active 10.1
life 10
face 9.9
black 9.6
retirement 9.6
women 9.5
baby 9.5
uniform 9.4
clothing 9.4
innocent 9.4
cute 9.3
old 9.1
childhood 9
lady 8.9
handsome 8.9
group 8.9
body 8.8
retired 8.7
nurse 8.6
outside 8.6
sit 8.5
relationship 8.4
20s 8.2
girls 8.2
children 8.2
day 7.8
hands 7.8
play 7.8
affectionate 7.7
affection 7.7
athlete 7.7
expression 7.7
sofa 7.7
loving 7.6
pair 7.6
enjoy 7.5
dark 7.5
enjoyment 7.5
human 7.5
one 7.5
holding 7.4
room 7.4
sport 7.4
brother 7.4
joyful 7.4
teenager 7.3
planner 7.2
looking 7.2
professional 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 100
black 74.6
posing 48.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-14
Gender Male, 95.9%
Sad 31%
Surprised 27.1%
Confused 22%
Fear 13.9%
Calm 10.6%
Angry 6.3%
Happy 3.3%
Disgusted 2.6%

AWS Rekognition

Age 2-8
Gender Female, 58.9%
Angry 41.8%
Calm 24.5%
Fear 10.8%
Confused 10.6%
Surprised 7.5%
Disgusted 4.7%
Sad 4.4%
Happy 1.1%

AWS Rekognition

Age 25-35
Gender Male, 98.1%
Calm 87.1%
Surprised 8.2%
Fear 6.2%
Confused 4.3%
Sad 3%
Disgusted 0.8%
Happy 0.8%
Angry 0.3%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Boy
Child
Male
Baby
Person 99.3%
Person 99.2%
Person 97.7%
Boy 99.2%
Child 99.2%
Male 99.2%
Baby 97.7%

Categories

Imagga

people portraits 94.6%
paintings art 4.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-28

a photograph of a woman sitting on a chair with two children -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows a seated individual wearing a worn, tattered dress, sitting on a wooden chair. The person is flanked by two young children—one child is unclothed, standing barefoot and leaning against the seated individual, while the other child is standing and dressed in striped overalls. The scene appears to depict a moment of hardship in an outdoor setting, with visible signs of poverty reflected in their clothing and surroundings. The wooden floor and structure in the background suggest a rural environment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a seated woman and two young children. The woman is sitting on a wooden chair, wearing a tattered dress that appears worn and frayed. Her hair is pulled back, and she holds an object in her hands. The child on her left is barefoot and standing, wearing a loose-fitting garment with shorts. The child on her right is similarly dressed in a striped outfit that has a collar, and is also barefoot. The children appear to be close in age, and the setting suggests a modest or impoverished environment, indicated by the worn clothing and simple seating arrangement. The background appears to be a wooden structure, possibly a porch or a deck.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a woman sitting in a chair with two young children standing beside her. The woman, dressed in a worn, white dress, is seated in a wooden chair, holding a small child on her lap. The child on her lap appears to be a toddler, wearing a dirty, white shirt and shorts. The child on the left side of the image, also a toddler, is standing and looking towards the right side of the image. The child on the right side of the image is standing and looking towards the left side of the image. The background of the image shows a wooden wall and floor, with a dark area above the woman's head, suggesting an outdoor setting. The overall atmosphere of the image is one of poverty and hardship, with the woman and children appearing to be living in difficult circumstances.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a woman sitting in a chair with two children standing beside her. The woman has dark skin and short, curly hair. She is wearing a light-colored dress that appears to be torn or ripped, and she is holding a piece of fabric in her hands. The child on the left has dark skin and short, curly hair. They are wearing a light-colored shirt and shorts, and they appear to be looking at something off-camera. The child on the right has dark skin and short, curly hair. They are wearing a light-colored jumpsuit, and they appear to be looking at the woman.

The background of the image is dark, but it appears to be a room or building with a wooden floor. There is a shadow cast by the woman and children, suggesting that the photo was taken indoors. Overall, the image suggests a sense of poverty and hardship, as the woman and children appear to be dressed in tattered clothing and are standing in a dimly lit room.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph depicting three children in a rural setting. The oldest child, a girl, is seated on a wooden chair and appears to be engaged in a conversation with the two younger children, a boy and a girl. The girl on the chair has her hands resting on her lap and is looking towards the boy, who is standing beside her and gesturing with his hands while speaking. The younger girl is standing behind the seated girl, holding onto her dress, and also looking towards the boy. The setting appears to be outdoors, with a wooden structure visible in the background. The photograph has a vintage feel, suggesting it was taken some time ago.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo features a woman and two kids. The woman is sitting on a chair and looking at something. She is holding the hand of the kid on her left, who is standing on the floor. The kid on her right is standing and holding something in his hand. The shadows of the people are cast on the floor. The photo is bordered with a white border.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

Here is a description of the image:

This is a black and white photograph of a young African-American woman and two young children. The woman is sitting in a wooden chair, wearing a simple, light-colored dress or tunic and shorts. She is barefoot and appears to be rolling or handling something in her hands. Her hair is styled in a braided updo.

Next to her, standing on her left, is a young child. The child is wearing a collared shirt and short pants, and the expression on their face appears serious. On the right, standing a bit further away from the woman, is another young child wearing a striped jumpsuit or overalls. This child appears to be pointing or gesturing with one hand.

The setting seems to be outdoors, perhaps on a porch or in front of a simple dwelling. The background is somewhat unclear, but there is some kind of wooden structure or wall behind them. The floor appears to be made of wooden planks. The lighting is even, but the quality of the photo suggests it is an older picture.

Created by gemini-2.0-flash-lite on 2025-05-28

Here is a description of the image:

The image is a black and white photograph showing a Black woman seated on a chair with two young children, likely on a porch or outdoor setting. The woman appears to be resting or perhaps mending something, as her hands are occupied. She is wearing a light-colored, loose-fitting dress. One child is standing beside her, looking off to the side with a somewhat serious expression. The other child stands nearby, wearing what appears to be a striped jumpsuit and pointing their finger. All three are in the sunlight, and the image has a natural, unposed quality, suggesting a captured moment in time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a woman and two children. The woman is seated on a chair, wearing a dress with a ruffled collar and short sleeves. She is holding a small child on her lap, who is wearing a simple dress and appears to be looking downward. The woman has her hands clasped together and is looking off to the side, seemingly lost in thought.

Standing next to the woman is another child, who is slightly older. This child is wearing a striped shirt and pants and appears to be looking at the camera with a somewhat solemn expression. The setting seems to be outdoors, possibly in front of a wooden structure or wall. The overall mood of the photograph is somber and reflective, capturing a moment of quiet interaction between the woman and the children.