Human Generated Data

Title

Untitled (Bethune Street, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2940

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Bethune Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2940

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 99.8
Shorts 99.8
Face 99.2
Head 99.2
Photography 99.2
Portrait 99.2
Pants 99
Door 96.2
Machine 95.1
Footwear 91.5
City 80.6
Road 80.6
Street 80.6
Urban 80.6
Transportation 70.7
Vehicle 70.7
Sitting 56.9
Furniture 56.6
Reading 56.1
Tricycle 56
Spoke 55.7
Blouse 55.4
Wagon 55.3
Jeans 55.1

Clarifai
created on 2018-05-10

people 100
adult 98.9
two 98.7
group 97.6
administration 97.5
man 96.2
three 95.5
child 94.9
woman 94.5
vehicle 94.5
furniture 93.5
leader 93.3
group together 92.3
sit 92
home 91.4
seat 88.8
wear 87.2
canine 87
actor 85.9
one 85.5

Imagga
created on 2023-10-05

kin 33.1
people 29
man 28.9
adult 26.6
portrait 24.6
happy 24.4
happiness 23.5
male 22.8
person 22.7
child 22.3
couple 21.8
lifestyle 21.7
love 20.5
world 19.9
family 19.6
mother 17.3
home 16.7
outdoors 14.9
boy 14.8
attractive 14.7
together 14
youth 13.6
fashion 13.6
casual 13.6
smile 13.5
outdoor 13
sexy 12.8
father 12.7
dress 12.6
smiling 12.3
sitting 12
women 11.9
two 11.9
parent 11.7
relationship 11.2
fun 11.2
pretty 11.2
teenager 10.9
model 10.9
joy 10.9
leisure 10.8
daughter 10.8
one 10.5
day 10.2
teen 10.1
alone 10
face 9.9
outside 9.4
wall 9.4
sibling 9
summer 9
cheerful 8.9
lady 8.9
romantic 8.9
interior 8.8
body 8.8
husband 8.6
men 8.6
son 8.6
pair 8.5
room 8.5
enjoy 8.5
dad 8.4
old 8.4
house 8.4
building 8.3
20s 8.2
new 8.1
clothing 8.1
romance 8
hair 7.9
bride 7.7
married 7.7
wife 7.6
relax 7.6
city 7.5
life 7.4
mature 7.4
park 7.4
guy 7.3
sensuality 7.3
black 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.8
sitting 98.8
person 94.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-14
Gender Female, 97.4%
Happy 94.2%
Surprised 6.4%
Fear 6%
Sad 2.8%
Calm 2%
Confused 0.8%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 6-12
Gender Female, 97.1%
Sad 100%
Calm 15.1%
Surprised 6.5%
Fear 6%
Angry 1.2%
Confused 0.9%
Happy 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Boy
Child
Male
Person
Wheel
Shoe

Clarifai

Footwear
Boy
Cart
Wheel
Human face
Door
Clothing
Human hair
Human arm
Human leg
Window

AWS Rekognition

Boy 99.4%

AWS Rekognition

Boy 99.2%

AWS Rekognition

Child 99.4%

AWS Rekognition

Child 99.2%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 99.2%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.2%

AWS Rekognition

Wheel 95.1%

AWS Rekognition

Wheel 94.7%

AWS Rekognition

Wheel 77.1%

AWS Rekognition

Shoe 91.5%

AWS Rekognition

Shoe 76.8%

Clarifai

Footwear 95.1%

Clarifai

Footwear 92.6%

Clarifai

Footwear 84.8%

Clarifai

Footwear 50.3%

Clarifai

Boy 91.3%

Clarifai

Boy 73.9%

Clarifai

Cart 81.5%

Clarifai

Wheel 67.4%

Clarifai

Wheel 53.8%

Clarifai

Wheel 53.8%

Clarifai

Human face 64.4%

Clarifai

Human face 60.2%

Clarifai

Door 52.1%

Clarifai

Clothing 44.7%

Clarifai

Human hair 40.7%

Clarifai

Human hair 35.8%

Clarifai

Human arm 37.6%

Clarifai

Human arm 36.2%

Clarifai

Human arm 33.4%

Clarifai

Human leg 35.3%

Clarifai

Human leg 35.1%

Clarifai

Human leg 35%

Clarifai

Window 33.9%

Categories

Imagga
created on 2023-10-05

people portraits 89.6%
paintings art 6.7%
interior objects 1.7%
pets animals 1.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man and a boy sitting on a bench

Created by general-english-image-caption-blip-2 on 2025-07-05

two boys sitting on the steps of a building with a cart

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This image features two children sitting on a stone step outside of a building with large wooden doors. The child on the left wears light clothing with shorts and shoes, while the child on the right wears a striped vest, shirt, and knee-high socks. To the right of the children is a small, vintage-looking pushcart with wheels and a fabric compartment, in which another child's curly hair is visible. The background includes wooden and brick textures. The scene appears to evoke a nostalgic, everyday moment.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a vintage scene featuring two young boys sitting on the stone step of a large, dark wooden door. One boy is wearing a light-colored shirt with shorts and socks, while the other is dressed in a striped vest over a short-sleeved shirt, plus shorts and long socks. They are engaged in conversation or interaction. Next to them sits a vintage baby carriage, equipped with large spoked wheels and containing a doll. The background includes part of a brick wall and wooden door frame, contributing to the classic and nostalgic feel of the setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image shows two young boys sitting on the steps of a wooden door. They appear to be from a different time period, based on their clothing and the old-fashioned style of the door and surroundings. One boy is sitting on the steps, while the other is sitting next to him. There is also a small wagon or cart visible in the background. The overall scene conveys a sense of a simpler, more casual time.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This is a vintage black and white photograph showing two young boys sitting on what appears to be a front stoop or steps in front of a large wooden door. They are casually dressed - one in a light-colored shirt and shorts, the other in a striped shirt and longer pants. In the corner of the image, there appears to be an old-style baby carriage or pram with wheels. The setting seems urban, with a brick wall visible to the side. The image has the informal, candid quality typical of mid-20th century street photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image depicts two young boys sitting on a stoop, with one of them pushing a cart. The boy on the left is wearing a white shirt and shorts, while the boy on the right is wearing a striped shirt and pants. The boy on the right is also wearing a vest and has his legs crossed, with his right leg resting on the other boy's lap. The boy on the left is looking at the boy on the right, who is looking down at the cart.

The cart is made of wood and has a metal frame. It appears to be an old-fashioned cart, possibly used for carrying goods or supplies. The background of the image shows a brick wall and a wooden door, which suggests that the scene is taking place in a residential area or a small business district.

Overall, the image captures a moment of everyday life in a quiet neighborhood or town, with the two boys engaged in a casual conversation or activity. The image conveys a sense of simplicity and tranquility, with the boys' relaxed poses and the peaceful surroundings creating a sense of calm.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image is a black-and-white photograph of two young boys sitting on the steps of a building, accompanied by a baby in a stroller. The boy on the left wears a white shirt and shorts, while the boy on the right sports a striped shirt and pants. The baby in the stroller is partially visible, with only their head and upper body visible.

The background features a dark wooden door with a window at the top, surrounded by a brick wall. The overall atmosphere of the image suggests a casual, everyday scene, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of two young boys sitting on a concrete step in front of a building. The boy on the left is wearing a white shirt and shorts, while the boy on the right is wearing a white shirt and pants. The boy on the right has a bandage on his leg, and there is a baby in a stroller behind him. The building has a wooden door with a glass window and a brick wall.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white photo shows two children sitting on a wooden step outside a house. The boy on the right is wearing a striped polo shirt, shorts, and shoes, while the boy on the left is wearing a white polo shirt, shorts, and shoes. They are both looking at something on the right side. A stroller with wheels is placed on the right side of the boy on the right.

Google Gemini

Created by gemini-2.0-flash on 2025-05-30

In a grayscale, medium shot, two boys are sitting in front of a door and stroller, one wearing shorts and one wearing long socks. A little boy sits on the stoop of the door wearing a collared short-sleeved shirt, shorts, and socks with leather dress shoes. His hands rest on his thighs. Beside him to his right sits a larger boy with a similar haircut, but he wears a striped collared shirt with an outer vest, shorts, long socks, and leather slip-on shoes. The boys appear to be talking to each other as they look on. To the right of the larger boy is an old-fashioned-looking stroller with a baby inside. The stroller and baby are partly obscured by the boy in the stripes. In the background is a large ornate dark-colored door and some brick and wooden panels.

Created by gemini-2.0-flash-lite on 2025-05-30

Here's a description of the image:

The image is a black and white photograph of two young boys sitting on the steps of a building. The boy on the left is younger and wearing a short-sleeved shirt, shorts, socks, and shoes. He is looking at the other boy with a serious expression. The older boy is sitting next to him, wearing a striped shirt, plaid shorts, long socks, and shoes. He has a slightly concerned look on his face. Next to them is a small baby carriage. The background includes a large, dark wooden door and a section of brick wall. The photo has a vintage feel, suggesting it was taken a long time ago.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting two young boys sitting on a stoop in front of a large, wooden door. The boys appear to be in a casual, relaxed pose. The boy on the left is wearing a light-colored shirt and shorts, and his legs are crossed. The boy on the right is wearing a striped shirt, shorts, and knee-high socks. He is sitting with his legs extended and crossed at the ankles, and he is holding a baseball glove in his lap. Next to the boys is a small, wooden wheelbarrow. The setting appears to be an urban environment, likely from an earlier time period, as suggested by the clothing and the style of the door and stoop. The overall mood of the image is nostalgic and candid, capturing a moment of childhood leisure.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

This black and white photograph captures a moment featuring two young boys sitting on the steps in front of a large, dark wooden door. The boy on the left is wearing a short-sleeved shirt and shorts, with one leg crossed over the other, and he appears to be facing the boy on the right. The boy on the right is wearing a sleeveless vest over a short-sleeved shirt and patterned shorts, and he is sitting with his legs straight. Between them is a small, vintage-style baby carriage with a wooden frame and wheels. The setting includes a brick wall to the right of the door and part of the door's structure is visible. The overall atmosphere of the image suggests a casual, everyday scene, possibly from a past era given the clothing and the style of the baby carriage.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This black-and-white photograph captures a candid and nostalgic moment featuring two young boys sitting on the step of a wooden door, likely from an earlier era. The boy on the left is wearing a light shirt and shorts, while the boy on the right is dressed in a patterned vest and long pants, holding a large object that appears to be a cast or a rolled-up material. Both boys are wearing shoes, and their expressions suggest they are engaged in conversation or play. To the right of the boys, there is a small cart or wagon that looks like it could be used for carrying items, with some objects placed on top. The scene is set against a rustic backdrop with a wooden door and a brick wall, adding to the vintage feel of the image.