Human Generated Data

Title

Untitled (sharecropper family, Little Rock, Arkansas)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3452

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (sharecropper family, Little Rock, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3452

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 99.5
Shorts 99.5
Person 99.4
Person 99.2
Boy 99.2
Child 99.2
Male 99.2
Face 98.2
Head 98.2
Photography 98.2
Portrait 98.2
Person 97.8
Baby 97.8
Furniture 96.1
Wood 88.8
Chair 87.3
Architecture 79
Building 79
Hospital 79
Pants 57.6
Bed 57.3
Footwear 56.9
Shoe 56.9
Plywood 56.6
Crib 56.4
Infant Bed 56.4
Body Part 56.2
Hand 56.2
Dress 55.7
Home Decor 55.2

Clarifai
created on 2018-05-10

people 99.9
child 99.8
group 99.3
three 97.9
four 97.4
offspring 97.2
son 96.6
family 96.2
sibling 95.9
administration 95.7
several 95.7
group together 95.6
five 95.6
two 94.1
wear 92.9
boy 91.3
man 90.7
education 90.7
adult 90.4
furniture 89.8

Imagga
created on 2023-10-05

family 40.9
kin 40.5
male 36.1
child 34.3
happy 33.8
mother 32.7
man 32.3
people 29.6
parent 27.4
lifestyle 26.7
father 26.4
smiling 26
together 25.4
couple 25.3
sibling 25.2
love 25.2
person 25
adult 23.4
husband 22.9
casual 22.9
happiness 22.7
portrait 22
home 21.5
senior 20.6
fun 20.2
daughter 19.4
wife 19
boy 18.3
togetherness 17.9
smile 17.1
son 16.8
outdoors 16.4
grandfather 16.3
joy 15.9
kid 15.1
cheerful 14.6
two 14.4
world 14.3
indoors 14.1
old 13.9
women 13.4
married 13.4
mature 13
face 12.8
dad 12.6
clothing 12.5
elderly 12.4
cute 12.2
sitting 12
men 12
innocent 11.4
attractive 11.2
youth 11.1
girls 10.9
uniform 10.8
leisure 10.8
parents 10.8
nurse 10.7
childhood 10.7
healthy 10.7
retired 10.7
couch 10.6
baby 10.6
jeans 10.5
group 10.5
life 10.4
pair 10.4
patient 10.2
room 10.2
playing 10
children 10
care 9.9
loving 9.5
day 9.4
park 9.1
active 9
affectionate 8.7
affection 8.7
retirement 8.6
play 8.6
enjoying 8.5
sit 8.5
relaxed 8.4
enjoyment 8.4
adorable 8.3
20s 8.2
handsome 8
interior 8
little 7.9
military uniform 7.9
grandmother 7.8
outside 7.7
30s 7.7
expression 7.7
four 7.7
females 7.6
laughing 7.6
human 7.5
relationship 7.5
one 7.5
grandma 7.5
three 7.4
holding 7.4
joyful 7.3
lady 7.3
dress 7.2
black 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.8
posing 85.8
outdoor 85.5
boy 80.9
black 65.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-12
Gender Male, 81.2%
Sad 80.5%
Confused 36.4%
Fear 10%
Angry 8.7%
Surprised 7.5%
Calm 3.9%
Happy 2%
Disgusted 1.7%

AWS Rekognition

Age 23-31
Gender Male, 98.5%
Calm 96.8%
Surprised 7.1%
Fear 5.9%
Sad 2.3%
Confused 0.9%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 2-8
Gender Female, 81.7%
Angry 39.7%
Confused 15.4%
Calm 14.3%
Fear 12.8%
Surprised 7.8%
Sad 6.9%
Disgusted 5%
Happy 1.6%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Boy
Child
Male
Baby
Shoe
Person 99.4%
Person 99.2%
Person 97.8%
Boy 99.2%
Child 99.2%
Male 99.2%
Baby 97.8%
Shoe 56.9%

Categories

Imagga

paintings art 89.6%
people portraits 9.6%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a woman sitting on a chair with two children -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts a seated individual wearing a light-colored, worn dress, sitting on a wooden chair. Two children are present, one on the left dressed in a simple, slightly tattered outfit and clinging to the chair, and the other on the right wearing a striped romper and standing upright. The setting appears to be outdoors, with wooden planks and a rustic structure in the background. The overall atmosphere conveys modest surroundings.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts three individuals: an adult sitting on a chair and two young children standing nearby. The setting appears to be an outdoor porch or wooden deck, judging by the wooden planks beneath their feet. The adult is sitting in a relaxed position, with one child standing very close on their left side, leaning slightly against them. The second child is standing a short distance away from the adult, on the right side of the image. The children are dressed in simple clothing suitable for a warm climate, and the light suggests it is daytime. There is a staircase behind them leading to an entryway, indicating they are on a porch or a similar space.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph depicting a woman sitting on a chair with two young children. The woman, who is the mother, is holding a piece of fabric and appears to be engaged in sewing or mending clothes. She is seated on a wooden chair, and the children are standing next to her on a wooden porch. The boy on the right is holding a piece of food in his hand, possibly a snack or a treat. The girl on the left is sitting on the woman's lap and looking at something. The photograph captures a moment of domestic life, with the mother taking care of her children while also attending to her sewing work. The setting appears to be a simple and humble environment, possibly a rural or working-class household. The overall mood of the image is one of warmth and family togetherness.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white photo shows a woman sitting on a chair with a child in front of her. The woman is wearing a white blouse and is holding a piece of cloth. The child is sitting on the floor and is wearing a white shirt. The child is looking at something on the right side. Behind them is a wooden wall with a door. The photo has a vintage filter.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

The image is a black and white photograph depicting a woman seated in a rocking chair with two young children. The woman is dressed in a loose-fitting, light-colored top and skirt. She appears to be looking downward and has something in her hands. One of the children stands close to the woman, also looking downwards, wearing a tunic and a shirt. The other child stands to the woman's right, wearing a vertically striped jumpsuit. The children's expressions seem to indicate they're possibly listening or observing something. The photograph's setting appears to be an outdoor space, possibly a porch or patio, and the lighting suggests it may be taken during daylight. The overall tone of the image is candid, and the photograph provides a glimpse of everyday life.

Created by gemini-2.0-flash on 2025-05-04

Here is a description of the image:

This black and white photograph features a young woman seated in a rocking chair with two small children nearby. The woman is wearing a loose-fitting, light-colored top and a skirt or shorts, and she appears to be barefoot. She is sitting with her legs crossed and her hands are occupied with something she is holding.

To her left, a toddler stands with a slightly solemn expression. The child is wearing a light-colored shirt with a dark vest or jumper.

To the right of the woman, a slightly older child is standing, facing forward and gesturing with his right hand. He is wearing a striped jumpsuit and seems to be looking towards something or someone outside of the frame.

The background suggests they are on a porch or outdoor area with wooden planks. The lighting is somewhat harsh, creating strong shadows on the surfaces around them. The overall mood is casual and intimate, capturing a moment of everyday life.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting three individuals, likely a mother and her two young children, in what appears to be a modest or impoverished setting. The mother is seated on a wooden chair, wearing a dress and holding a piece of cloth or fabric. She is looking down at the child standing beside her, who is wearing a striped outfit and appears to be reaching out or holding something. The second child, who is younger and wearing a simple dress, is standing close to the mother, leaning against her leg. The background shows a wooden structure, possibly a porch or a simple house, with a plain wooden wall and floor. The overall mood of the image conveys a sense of simplicity and hardship, reflecting a historical context of rural or economically disadvantaged living conditions.