Human Generated Data

Title

Untitled (Mulhall Family, Ozarks, Arkansas)

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1322

Human Generated Data

Title

Untitled (Mulhall Family, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1322

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 95.7
Face 95.5
Outdoors 89.5
Clothing 84
Apparel 84
Baby 78.9
People 77.6
Nature 75.6
Female 74.2
Field 72.2
Portrait 70.4
Photography 70.4
Photo 70.4
Advertisement 65
Grass 62.9
Plant 62.9
Poster 59.6
Smile 59.6
Hat 58.3
Countryside 56.5
Collage 55.5
Dress 55.2

Clarifai
created on 2023-10-15

portrait 99.8
child 99.7
people 99.7
baby 99.6
monochrome 99.4
son 99.2
two 99.1
family 99
offspring 97.1
love 95.7
three 93.4
facial expression 93.3
adult 93.2
affection 93.1
sibling 91.4
sepia 90.7
group 88.2
woman 86.1
park 85.3
girl 84.5

Imagga
created on 2021-12-15

kin 87.7
mother 71.2
parent 60.8
family 41.9
child 41.1
happy 40.8
portrait 36.9
outdoors 34.4
park 33.8
happiness 32.9
together 32.4
love 32.4
people 31.3
smiling 31.1
adult 28.5
daughter 25.8
man 25.6
senior 24.4
father 24.3
male 23.6
couple 23.5
lifestyle 23.2
smile 22.8
sibling 21.4
joy 20.1
person 18.7
fun 18.7
summer 18.7
outdoor 18.4
grass 18.2
outside 18
togetherness 18
childhood 17.9
cute 17.2
day 16.5
two 16.1
kid 16
affection 15.5
cheerful 15.5
laughing 15.1
boy 14.8
husband 14.3
women 14.3
countryside 13.7
face 13.5
leisure 13.3
mature 13
dad 12.8
youth 12.8
girls 12.8
pretty 12.6
garden 12.6
old 12.6
loving 12.4
wife 12.3
relaxed 12.2
healthy 12
son 12
hug 11.6
affectionate 11.6
little 11.5
enjoying 11.4
blond 11.3
relationship 11.3
hair 11.1
camera 11.1
relaxing 10.9
60s 10.8
retired 10.7
horizontal 10.1
baby 9.6
married 9.6
elderly 9.6
grandma 9.5
casual 9.3
adorable 9.2
children 9.1
holding 9.1
aged 9.1
black 9
romance 8.9
romantic 8.9
grandfather 8.9
embracing 8.8
autumn 8.8
two people 8.8
sepia 8.8
sitting 8.6
model 8.6
attractive 8.4
field 8.4
fashion 8.3
human 8.3
playing 8.2
vacation 8.2
meadow 8.1
group 8.1
having fun 7.9
seniors 7.9
sixties 7.9
50s 7.8
parenthood 7.8
sister 7.8
hugging 7.8
mom 7.8
eyes 7.8
retirement 7.7
walking 7.6
females 7.6
friendship 7.5
rest 7.4
joyful 7.4
lady 7.3
active 7.2
pensioner 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

outdoor 99.4
human face 99.4
person 99
grass 98.9
baby 98.5
smile 97.5
clothing 95.7
toddler 95.7
text 94.3
child 87
boy 66.9
picture frame 7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-44
Gender Female, 98.5%
Happy 30.2%
Sad 18.4%
Calm 14.4%
Confused 10.4%
Fear 10.2%
Angry 9%
Disgusted 5.7%
Surprised 1.7%

AWS Rekognition

Age 0-3
Gender Male, 72.9%
Sad 88%
Calm 7.5%
Angry 2.7%
Confused 0.6%
Fear 0.4%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 95.7%

Categories

Imagga

people portraits 53.3%
paintings art 37.8%
pets animals 8.6%

Captions

Microsoft
created by unknown on 2021-12-15

a person holding a baby 85.3%
a little girl posing for a photo 85.2%
a little girl posing for a picture 85.1%

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a woman holding a teddy bear in a field -100%

Google Gemini

Created by gemini-2.0-flash on 2025-05-02

The black and white photo shows a mature woman holding a child and a doll. The woman stands facing the camera but looking to the right, with a slight smile on her face. She has her hair swept back, and is wearing a button-down dress with a ruffled collar. In her arms, she holds a young child, who looks solemnly ahead. In front of the child is a doll; it is somewhat worn, with a cracked or damaged face.

The setting appears to be outdoors, with foliage visible in the background. To the left of the woman, there is what looks like a dark, worn bag on the ground. The overall impression is one of poverty and hardship, and the wear on the doll adds to the somber mood.

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

The image is a black and white photograph of a woman holding a young child and a doll. The woman, with a slightly weathered appearance, is looking to the side and smiling. The child, who appears to be a toddler, is gazing directly at the camera with a serious expression. They are both being held in the woman's arms and the woman's arms look tired. The doll, old and damaged, is positioned between the child and the woman, with the woman’s arms supporting the doll. The background is out of focus but appears to be a field or natural setting. The photograph's composition and subject matter evoke a sense of hardship and resilience, suggesting the image may be related to historical themes like the Great Depression or a similar period of adversity. The quality of the black and white image, and the style of the photograph suggest a historical photo.