Human Generated Data

Title

Untitled (Marked Tree, Arkansas?)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1157

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Marked Tree, Arkansas?)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1157

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Photography 97.2
Face 96.6
Head 96.6
Footwear 87.6
Body Part 87.6
Finger 87.6
Hand 87.6
Portrait 81.7
Architecture 57.7
Building 57.7
Outdoors 57.7
Shelter 57.7
Sun Hat 57.5
Cap 56.4
Transportation 55.6
Vehicle 55.6
Canopy 55.5

Clarifai
created on 2018-05-11

people 100
two 99.5
child 99.3
group 98.9
one 98.8
adult 98.7
group together 97.6
three 95.1
boy 94.2
four 93.6
wear 93.5
home 93.3
man 93.2
woman 92.1
several 90.7
veil 89.8
vehicle 89.5
war 89.4
many 88.6
offspring 88.2

Imagga
created on 2023-10-05

child 24.8
device 21.7
man 17.5
musical instrument 16.9
male 16.5
ventilator 15.9
adult 15.5
building 15
happiness 14.1
accordion 13.9
person 13.9
happy 13.8
outside 13.7
love 13.4
people 12.8
old 12.5
smiling 12.3
keyboard instrument 11.7
outdoors 11.2
vehicle 10.7
smile 10.7
wall 10.5
portrait 10.3
structure 9.7
couple 9.6
sitting 9.4
wind instrument 9.4
house 9.2
vintage 9.1
fun 9
architecture 8.8
together 8.8
lifestyle 8.7
casual 8.5
outdoor 8.4
joy 8.3
alone 8.2
dress 8.1
family 8
looking 8
kid 8
face 7.8
hut 7.7
pretty 7.7
attractive 7.7
swing 7.7
cute 7.2
hair 7.1
parent 7
car 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 97.2
person 93.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 10-18
Gender Female, 99.8%
Sad 99.9%
Calm 20.1%
Surprised 6.4%
Fear 6.1%
Confused 1%
Happy 0.4%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 25-35
Gender Male, 88.7%
Sad 99.9%
Calm 10%
Surprised 7.3%
Fear 6.5%
Disgusted 2.6%
Confused 2.1%
Angry 1%
Happy 0.9%

AWS Rekognition

Age 28-38
Gender Female, 53.7%
Sad 100%
Surprised 6.3%
Fear 6%
Disgusted 1.2%
Calm 0.6%
Confused 0.3%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 95.3%
Calm 94.1%
Surprised 6.5%
Fear 5.9%
Sad 2.8%
Angry 2.1%
Confused 0.8%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 56.1%
Sad 49.4%
Happy 9.9%
Surprised 6.9%
Fear 6.1%
Disgusted 2.3%
Angry 1.8%
Confused 1.6%

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Baby
Hat
Shoe

Clarifai

Human face
Clothing
Footwear
Man
Human head
Human nose
Window
Human arm
Human eye
House
Human leg
Human mouth

AWS Rekognition

Adult 99.3%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 98.1%

AWS Rekognition

Adult 94.1%

AWS Rekognition

Male 99.3%

AWS Rekognition

Male 98.8%

AWS Rekognition

Male 98.1%

AWS Rekognition

Male 94.1%

AWS Rekognition

Man 99.3%

AWS Rekognition

Man 98.8%

AWS Rekognition

Man 98.1%

AWS Rekognition

Man 94.1%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 94.1%

AWS Rekognition

Baby 99%

AWS Rekognition

Hat 91.3%

AWS Rekognition

Shoe 87.6%

AWS Rekognition

Shoe 80.2%

AWS Rekognition

Shoe 70%

AWS Rekognition

Shoe 60.4%

Clarifai

Human face 91.3%

Clarifai

Human face 80.7%

Clarifai

Human face 73%

Clarifai

Human face 62.4%

Clarifai

Human face 43.3%

Clarifai

Clothing 75%

Clarifai

Clothing 41.4%

Clarifai

Footwear 70.7%

Clarifai

Footwear 58.8%

Clarifai

Footwear 56.5%

Clarifai

Footwear 55.8%

Clarifai

Footwear 52.7%

Clarifai

Footwear 45%

Clarifai

Footwear 43.8%

Clarifai

Footwear 43.3%

Clarifai

Footwear 41.2%

Clarifai

Man 68.4%

Clarifai

Man 63.1%

Clarifai

Man 43.1%

Clarifai

Human head 64.6%

Clarifai

Human head 46.5%

Clarifai

Human head 37.2%

Clarifai

Human nose 43.2%

Clarifai

Window 42.6%

Clarifai

Human arm 41.6%

Clarifai

Human arm 36.1%

Clarifai

Human eye 41.5%

Clarifai

House 40.7%

Clarifai

Human leg 34.9%

Clarifai

Human mouth 34.1%

Categories

Imagga
created on 2023-10-05

pets animals 72.3%
paintings art 13.4%
streetview architecture 11.1%
people portraits 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a woman in a hat and coat is talking on the phone

Created by general-english-image-caption-blip-2 on 2025-07-05

a young boy in a hat and coat standing in front of a store

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts a street scene near the entrance of a building with a sign that partially reads “Office of...” above the door. The building has double wooden doors and an awning, likely belonging to a business or office. Several people are gathered under the awning, including a man sitting on the ground and others standing and conversing near the storefront window, which has writing displayed on the glass. The atmosphere suggests a casual setting, possibly in a small town or community. The architecture appears to be older, with brick walls and wooden frames.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts a street scene in front of a building with an awning. There are people gathered on the sidewalk; one person is leaning against the brick wall next to the doorway, and another individual is sitting on the ground. The doors of the building have a vintage look, with a wooden frame and glass panels. The window of the building displays handwritten signs, possibly listing prices or special offers. The setting appears to be a small town or neighborhood area.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph depicting a street scene in what seems to be a small town or city. In the foreground, there is a young boy sitting on the ground, wearing a hat and looking directly at the camera. Behind him, there are several adults standing or sitting near the entrance of a building with a sign that says "Office". The building has large windows and an awning overhead. The overall scene conveys a sense of everyday life and activity in this urban setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from several decades ago, showing a street scene with a storefront. There's a striped awning over the entrance and what looks like an "OFFICE" sign visible at the top left. In the foreground, there's a young person wearing a fedora-style hat and what appears to be a coat or jacket. In the background, a few people can be seen standing and sitting near the building's entrance. The image has the grainy, documentary-style quality typical of mid-20th century street photography.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a group of people gathered outside a building with an awning. The scene appears to be set in the early 20th century, possibly during the Great Depression.

Key Elements:

  • A young boy wearing a hat and holding boxing gloves stands prominently in the foreground.
  • Behind him, several adults are seated or standing near the entrance of a building with an awning.
  • The building's facade features a sign that reads "Office of" but the rest of the text is obscured.
  • A chalkboard on the wall displays illegible writing, possibly advertising services or products.
  • The overall atmosphere suggests a sense of community and gathering, with the people appearing to be engaged in conversation or waiting for something.

Historical Context:

  • The style of clothing and the architecture of the building suggest that the photograph was taken in the early 20th century, likely during the 1930s.
  • The presence of a boxing glove-wearing boy and the informal gathering of people outside the building may indicate that the community is coming together to support a local event or activity.

Conclusion:

The image provides a glimpse into the daily lives of people during a significant period in American history. The photograph captures a moment of community and camaraderie, highlighting the importance of social connections and shared experiences during times of hardship.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a young boy wearing a hat and coat, sitting on a bench outside a building with a sign that reads "Office of" and a storefront with a sign that reads "Canning Holes." The boy is holding a stuffed animal and looking at the camera. In the background, there are several people standing around, including a woman and a man. The overall atmosphere of the image suggests a quiet, everyday scene from the past.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The black-and-white image depicts a street scene from the past. A boy is posing for a photo in front of a store. He is wearing a hat and boxing gloves, and he is looking forward with a serious expression. Behind him, another boy is sitting on the pavement, and three men are standing near the store. The store has glass doors and a canopy.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The black-and-white image shows a young boy wearing a hat and gloves, posing for a photograph with a boxing stance. He is standing on the sidewalk in front of a store with a sign that reads "Office of." The store has glass doors and windows, and a canopy awning covers the entrance. Behind the boy, there are two men sitting on the sidewalk, one wearing a suit and tie and the other in casual attire.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

The image is a vintage black and white photograph that captures a street scene, likely from the mid-20th century. In the foreground, a young boy wearing a fedora hat stands close to the camera, appearing to be holding two light-colored objects, possibly fruits like apples or oranges.

Behind him is the storefront of a business. The doors are framed by worn wooden beams, and there's a sign at the top that reads "OFFICE OF..." The rest of the sign is cut off from view. An awning extends from the building, shading a portion of the sidewalk. Under the awning, several men are standing or sitting. Some appear to be leaning against the brick exterior of the building. There's a menu or price list posted on the wall next to the entrance.

The overall scene is somewhat reminiscent of small-town America from a bygone era, with its weathered storefront and everyday street activity.

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Impression:
The photograph is a vintage, black and white street scene. It appears to be from the mid-20th century, based on the clothing and the overall style.

Foreground:

  • A young boy is positioned prominently in the foreground. He's wearing a fedora hat and has something wrapped in his hands, possibly boxing gloves. He looks directly at the camera with a focused expression.

Midground:

  • A building facade with a storefront can be seen. The storefront has glass windows and doors.
  • A striped awning shades a section of the sidewalk.
  • A group of men stand and sit along the sidewalk in front of a shop, seemingly taking a break or waiting.
  • One man is sitting on a step, with his head resting in his hand.
  • The men are wearing outfits that fit the time period.

Background:

  • The background is somewhat dark.

Overall:
The image suggests a moment captured in a community. The boy in the foreground creates a point of focus.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image is a black-and-white photograph that captures a street scene from what appears to be the mid-20th century. The focal point of the image is a young boy wearing a hat and holding a baseball glove. He is standing in front of a storefront with a large glass window and a partially visible sign that reads "OFFICE OF."

In the background, there are several people engaged in different activities. A man is sitting on the sidewalk, leaning against the brick wall of the building. He appears to be looking down or possibly reading something. Further back, a woman and a child are walking along the sidewalk, and a man in a light-colored shirt and dark pants is standing near a parked car, smoking a cigarette.

The storefront has an awning, and there is a chalkboard or sign with handwritten text, though the details are not clearly legible. The overall atmosphere of the image suggests a casual, everyday moment in a small town or urban neighborhood.

Qwen

No captions written

Text analysis

Amazon

OFFICE
OFFICE O
O
ARELES
ANE
FOR
the