Human Generated Data

Title

Untitled (Bethune Street, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2877

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Bethune Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2877

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Person 99.7
Adult 99.7
Female 99.7
Woman 99.7
Person 99.4
Accessories 98.9
Bag 98.9
Handbag 98.9
Lady 91.2
Blouse 88.2
Clothing 88.2
Footwear 88
Shoe 88
Shoe 84.4
Animal 81.1
Pet 81.1
Shoe 80.5
Cat 78.7
Mammal 78.7
Canine 78.3
Shoe 71.8
Dog 56.8
Puppy 56.8
Sitting 56.6
Glasses 56.5
Reading 56.3
Dress 56.3
Bench 55.9
Furniture 55.9
Electronics 55.7
Mobile Phone 55.7
Phone 55.7
Kitten 55.5
Purse 55.4
Poodle 55.3

Clarifai
created on 2018-05-10

people 100
adult 99.7
one 99.1
portrait 98.7
two 98.2
wear 97.8
woman 96.5
furniture 93.9
leader 93.7
sit 93.2
seat 92.9
music 92.4
group 90.8
actress 90.5
administration 90.1
facial expression 88.9
actor 87.6
man 85.5
easy chair 84.9
child 84.6

Imagga
created on 2023-10-06

person 26.4
people 25.6
attractive 21
happy 20.7
man 20.1
adult 20
portrait 18.8
fashion 17.3
lady 17
musical instrument 16.6
lifestyle 15.9
holding 15.7
smile 15.7
male 15.6
dress 15.3
women 14.2
pretty 14
sexy 13.6
couple 13.1
accordion 12.9
face 12.1
cute 11.5
kin 11.1
happiness 11
model 10.9
keyboard instrument 10.7
look 10.5
world 10.4
style 10.4
party 10.3
love 10.3
expression 10.2
black 10.2
wind instrument 9.9
cheerful 9.7
human 9.7
chain mail 9.7
costume 9.7
home 9.6
hair 9.5
child 9.5
luxury 9.4
culture 9.4
holiday 9.3
mother 9.3
musician 9.2
blond 9.2
head 9.2
romantic 8.9
smiling 8.7
two 8.5
leisure 8.3
fun 8.2
one 8.2
looking 8
body 8
business 7.9
colorful 7.9
body armor 7.7
modern 7.7
youth 7.7
joy 7.5
clothes 7.5
traditional 7.5
makeup 7.3
indoor 7.3
girls 7.3
dance 7.3
sensuality 7.3
group 7.2
celebration 7.2
parent 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.5
outdoor 88.5
old 72

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 53-61
Gender Female, 94%
Calm 97.3%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.5%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 54-64
Gender Male, 96%
Happy 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.2%
Disgusted 0%
Confused 0%
Angry 0%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 76
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Female
Woman
Shoe
Glasses
Mobile Phone
Person 99.7%
Person 99.4%
Adult 99.7%
Female 99.7%
Woman 99.7%
Shoe 88%
Shoe 84.4%
Shoe 80.5%
Shoe 71.8%
Glasses 56.5%
Mobile Phone 55.7%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a woman sitting on a bench with a dog -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts two individuals seated on a step, wearing patterned dresses. One is holding a small, fluffy white dog on their lap, while the other appears to have their hands clasped. Both are wearing practical, flat shoes, and the scene has a vintage, black-and-white aesthetic.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts two individuals sitting side by side outside on what appears to be a step or ledge. Both are wearing patterned dresses, and they each have their hands clasped. The individual on the right is holding a small, fluffy white dog on their lap. The setting appears to be outdoors with a plain black or dark background. They are wearing similar footwear, and the person on the right has a bandage on their leg. The overall tone of the image suggests it could be an older photograph due to the black-and-white color scheme.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows two elderly women sitting together on a bench. They appear to be friends or family members, as they are seated close together and one of the women is holding a small dog. Both women are wearing floral patterned dresses and the woman on the right is wearing glasses. The background is blurry, suggesting the focus is on the two women and their interaction.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a vintage black and white photograph showing two older women sitting together on what looks like a porch or step. They're both wearing similar patterned dresses with a floral or polka dot print. One of the women is wearing glasses. They appear to be holding or petting a white cat in their laps. The image has the characteristic style and quality of photographs from perhaps the 1930s or 1940s. The casual, relaxed pose and setting suggests this might be a candid moment captured of daily life from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts two elderly women sitting on a bench, with one of them holding a small white dog. The woman on the left is wearing a long dress with a floral pattern and has her hands clasped together in front of her. The woman on the right is also wearing a floral dress and has a white apron over it. She is holding the small white dog in her lap, which appears to be a Bichon Frise or a similar breed. The background of the image is dark, but it appears to be a room or a hallway with a wall behind the women. The overall atmosphere of the image suggests that the women are enjoying each other's company and the presence of the dog adds a sense of warmth and companionship to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This black-and-white photograph depicts two elderly women sitting on a bench, with one of them holding a small dog. The woman on the left is dressed in a patterned dress and shoes, while the woman on the right wears a dark floral dress, an apron, and shoes. She cradles the small white dog in her lap.

The background of the image appears to be a dark wall or doorway, suggesting that the photograph was taken outdoors. The overall atmosphere of the image is one of quiet contemplation, with the two women seemingly lost in thought as they sit together on the bench.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of two elderly women sitting on a bench. The woman on the left has her hands clasped together in front of her. She is wearing a floral dress with a round neckline and a small necklace. The woman on the right is holding a white dog in her lap and is wearing glasses, a floral dress, and a white apron. She is looking directly at the camera.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows two elderly women sitting on the concrete steps of a building. They are wearing dresses with floral patterns. The woman on the left is holding her hands together, while the woman on the right is holding a dog. The woman on the right is wearing eyeglasses. Behind them is a glass window with a black frame, which is slightly open. The photo has a vintage look, suggesting that it was taken a long time ago.

Google Gemini

Created by gemini-2.0-flash on 2025-05-24

In a black and white photograph, two women are seated on a step in front of a dark backdrop. The woman on the left is dressed in a light-colored dress with a small, repetitive pattern, and has her hands clasped together in her lap. She wears dark shoes and has a modest, slightly furrowed expression.

To the right, the other woman sits with a small, fluffy white dog cradled in her lap. She is wearing glasses, a dress with a darker pattern, and an apron. One leg is extended slightly, revealing a light-colored stocking or sock. Her shoes are also dark. She appears to be holding the dog securely. The background is a dark, blurry wall or hedge, providing a stark contrast to the figures in the foreground.

Created by gemini-2.0-flash-lite on 2025-05-24

The image is a black and white photograph of two elderly women seated next to each other. The woman on the left is wearing a dress with a pattern and has her hands clasped. The woman on the right is wearing a floral pattern dress and is holding a small, white dog. She is also wearing glasses. They are both sitting on what appears to be a step or ledge, possibly outside. The lighting is soft, and the overall mood is calm and intimate.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph featuring two elderly women sitting on a bench.

The woman on the left is wearing a patterned dress with a floral or geometric design. She has short, wavy hair and is holding something in her hands, possibly a small object or piece of paper. Her expression appears to be neutral or slightly contemplative.

The woman on the right is dressed in a darker, patterned dress and is holding a small, fluffy white dog in her lap. She is also wearing glasses and has a more pronounced expression, possibly smiling or speaking. She has a cloth or paper bag hanging from her shoulder.

The background is dark and indistinct, possibly a wall or a shadowed area, which helps to focus attention on the two women. The setting appears to be outdoors, likely in a public place such as a park or a street. The overall mood of the photograph is calm and reflective, capturing a moment of everyday life.