Human Generated Data

Title

Untitled (Jersey Homesteads, New Jersey)

Date

1939

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3584

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3584

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Photography 96.3
Transportation 95.5
Vehicle 95.5
Face 94.5
Head 94.5
Portrait 94.5
Cap 89.5
People 85.7
Outdoors 62.2
Baseball Cap 57.6
Undershirt 57
City 55.6
Road 55.6
Street 55.6
Urban 55.6
Accessories 55.5
Sunglasses 55.5
Body Part 55.5
Finger 55.5
Hand 55.5
Plant 55.4
Potted Plant 55.4
T-Shirt 55.4
Back 55.2
Bonnet 55.2
Architecture 55.1
Building 55.1
Shelter 55.1

Clarifai
created on 2018-05-10

people 99.6
child 98.3
group 97
woman 96.8
adult 95.8
man 93.9
boy 92.5
group together 88.4
room 86.6
monochrome 85.6
several 84.6
portrait 84.1
education 83.5
furniture 82.5
indoors 82.2
two 82.2
family 81.5
music 81.3
wear 80.5
many 80.1

Imagga
created on 2023-10-06

man 43.8
male 37.8
group 34.6
people 34.6
business 32.2
meeting 31.1
person 30.7
businessman 30
office 29.2
adult 24.9
classroom 24.3
team 24.2
men 24
happy 23.2
couple 22.6
table 21.8
sitting 21.5
indoors 21.1
teacher 20.7
corporate 20.6
businesspeople 19.9
businesswoman 19.1
smiling 18.8
room 18.4
women 18.2
desk 18.1
suit 18.1
communication 17.6
teamwork 17.6
colleagues 17.5
lifestyle 17.3
happiness 16.4
education 16.4
executive 16.4
cheerful 16.2
work 15.8
smile 15.7
looking 15.2
together 14.9
indoor 14.6
friends 14.1
love 13.4
professional 12.8
color 12.8
conference 12.7
discussion 12.6
student 12.4
school 12.4
to 12.4
holding 12.4
talking 12.3
presentation 12.1
black 12.1
home 12
drinking 11.5
adults 11.3
laptop 11.3
mature 11.1
board 10.9
chair 10.7
job 10.6
corporation 10.6
jacket 10.6
computer 10.5
college 10.4
learning 10.3
coworkers 9.8
modern 9.8
family 9.8
40s 9.7
working 9.7
partners 9.7
speaker 9.7
career 9.5
enjoyment 9.4
senior 9.4
relationship 9.4
casual 9.3
two 9.3
horizontal 9.2
drink 9.2
20s 9.2
restaurant 9.1
handsome 8.9
technology 8.9
child 8.8
businessmen 8.8
mid adult 8.7
class 8.7
world 8.7
day 8.6
workplace 8.6
gesture 8.6
females 8.5
portrait 8.4
study 8.4
wine 8.3
musical instrument 8.3
successful 8.2
fun 8.2
confident 8.2
debate 7.9
explaining 7.9
students 7.8
glass 7.8
attractive 7.7
four 7.7
kin 7.6
togetherness 7.5
friendship 7.5
silhouette 7.4
manager 7.4
document 7.4
coffee 7.4
camera 7.4
children 7.3
worker 7.3
cup 7.2
celebration 7.2
articulator 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.4
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Calm 86.7%
Surprised 11.2%
Fear 5.9%
Sad 2.2%
Happy 1.9%
Angry 1.6%
Disgusted 1.2%
Confused 0.7%

AWS Rekognition

Age 23-31
Gender Female, 97.9%
Happy 49.8%
Calm 23.2%
Fear 18.9%
Surprised 6.7%
Sad 4%
Angry 0.8%
Confused 0.6%
Disgusted 0.6%

AWS Rekognition

Age 23-33
Gender Male, 100%
Sad 59.9%
Calm 49.2%
Angry 10.2%
Surprised 6.7%
Fear 6.2%
Confused 3.7%
Disgusted 3%
Happy 2.8%

AWS Rekognition

Age 21-29
Gender Male, 97.8%
Calm 95.9%
Surprised 6.7%
Fear 6%
Sad 2.9%
Happy 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 96.2%
Sad 100%
Surprised 6.4%
Fear 6.4%
Angry 1.8%
Confused 1.8%
Calm 1.4%
Disgusted 0.8%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 58.6%
Sad 99.9%
Calm 21.7%
Surprised 6.4%
Fear 6.1%
Angry 1.7%
Confused 0.9%
Disgusted 0.4%
Happy 0.3%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Baby
Car
Hat

Clarifai

Man
Human face
Clothing
Woman
Tree
Car
Human arm
Human hair
Hat
House

AWS Rekognition

Adult 99.7%

AWS Rekognition

Adult 98.1%

AWS Rekognition

Adult 98.1%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Female 99.7%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 95.4%

AWS Rekognition

Person 91.3%

AWS Rekognition

Person 89%

AWS Rekognition

Person 67.1%

AWS Rekognition

Woman 99.7%

AWS Rekognition

Male 98.1%

AWS Rekognition

Male 98.1%

AWS Rekognition

Male 97.9%

AWS Rekognition

Man 98.1%

AWS Rekognition

Man 98.1%

AWS Rekognition

Man 97.9%

AWS Rekognition

Baby 97.3%

AWS Rekognition

Car 95.5%

AWS Rekognition

Hat 92.9%

AWS Rekognition

Hat 55.9%

Clarifai

Man 90.3%

Clarifai

Man 88.2%

Clarifai

Man 39.3%

Clarifai

Human face 90.2%

Clarifai

Human face 88.2%

Clarifai

Human face 81.7%

Clarifai

Human face 72%

Clarifai

Human face 71.2%

Clarifai

Human face 66.8%

Clarifai

Human face 33.8%

Clarifai

Clothing 89.3%

Clarifai

Clothing 86.7%

Clarifai

Clothing 72%

Clarifai

Clothing 69.5%

Clarifai

Clothing 51%

Clarifai

Clothing 50.2%

Clarifai

Clothing 45.5%

Clarifai

Clothing 41%

Clarifai

Clothing 39%

Clarifai

Clothing 35.5%

Clarifai

Woman 79.4%

Clarifai

Woman 78.3%

Clarifai

Tree 71.1%

Clarifai

Tree 38%

Clarifai

Car 53.3%

Clarifai

Human arm 45.9%

Clarifai

Human hair 41.6%

Clarifai

Human hair 41.3%

Clarifai

Hat 39.1%

Clarifai

House 38.4%

Categories

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people standing around a truck

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of people standing outside

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This black-and-white photograph depicts a group of individuals standing outdoors in what appears to be a rural or small-town setting. On the left side of the image, there is a vintage automobile parked near a house with trees providing shade. The individuals are gathered near a wooden, slatted wall, some wearing hats, tank tops, patterned dresses, and shirts, suggesting a warm day. The scene conveys a moment of interaction or congregation, possibly related to daily activities or social events.

Created by gpt-4o-2024-08-06 on 2025-06-11

The black and white image shows a group of people gathered outside near a building with vertically aligned wooden siding. The individuals are dressed in what appears to be mid-20th-century attire. Many are wearing hats, including wide-brimmed straw hats and caps. In the background, there is a vintage car parked on a tree-lined street, and a house with visible windows and siding can be seen beyond the car. The scene gives off a feeling of a casual outdoor meeting or gathering on a warm day.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a group of people, primarily African American, standing together in an outdoor setting. They appear to be engaged in conversation or some kind of gathering. In the background, there is a wooden structure or building and a car parked on the street. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a black and white historical photograph showing a group of people gathered outside what looks like a wooden building. Several individuals are wearing summer clothing appropriate for warm weather, including sleeveless tops and hats - notably some straw hats and a flat cap. In the background, you can see part of a house and what appears to be a vintage car from possibly the 1940s or 1950s. The image has the characteristic grainy quality of mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of a group of people standing in front of a building. The group consists of both children and adults, with some wearing hats. They are all facing to the right side of the image.

In the background, there is a car parked on the street, and a tree can be seen on the left side of the image. The overall atmosphere suggests that the photo was taken during the daytime, possibly in a residential area.

The image appears to be an old photograph, likely taken in the mid-20th century. The style and quality of the image are consistent with photographs from this time period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image depicts a group of people gathered outside a building, with a car visible in the background. The individuals are dressed in casual attire, with some wearing hats and others holding papers or objects.

  • Group of People
    • The group consists of approximately 7-8 individuals.
    • They are standing in front of a building, possibly a house or a store.
    • The people are dressed in casual clothing, including hats and dresses.
    • Some individuals are holding papers or objects, while others appear to be engaged in conversation.
  • Building
    • The building is made of wood and has a vertical siding.
    • It appears to be a single-story structure.
    • The building is likely a residential or commercial property.
  • Car
    • A car is parked in the background, near the building.
    • The car is dark-colored and appears to be an older model.
    • It is unclear whether the car is being used or is simply parked.
  • Background
    • The background of the image shows trees and other foliage.
    • There are also buildings visible in the distance, although they are not clearly defined.
    • The overall atmosphere of the image suggests a quiet, rural setting.

In summary, the image depicts a group of people gathered outside a building, with a car parked in the background. The individuals are dressed in casual attire and appear to be engaged in conversation or activity. The building is made of wood and has a vertical siding, and the car is dark-colored and appears to be an older model. The background of the image shows trees and other foliage, as well as buildings in the distance. Overall, the image suggests a quiet, rural setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph of a group of people standing in front of a building. The building has a wooden wall with vertical stripes. The people in the image are dressed in casual clothing, and some of them are wearing hats. One person in the group is holding a piece of paper and appears to be reading it. In the background, there is a car parked in front of a house with a tree in front of it.

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black-and-white image shows a group of people standing near a wooden wall. Some of them are wearing hats, and some are wearing sleeveless shirts. One of them is holding a piece of paper. Behind them, there is a house with a car parked in front of it. The house is surrounded by trees. The image has a white border.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Certainly! Here's a description of the image:

Overall Impression:

The photograph is a black and white snapshot capturing a group of people, likely in a rural setting, at a time in the past. The image has a slightly grainy texture, which suggests it's an older photograph.

Key Features:

  • The Group: The focus is on a group of people, with several individuals clearly visible and others partially obscured. They appear to be of African descent.
  • Clothing: The clothing suggests a period of the mid-20th century. Some individuals are wearing hats (straw hats, fedoras, newsboy caps) and casual attire like shirts and dresses.
  • Setting: There's a glimpse of what appears to be a wooden structure (possibly a building) and a house in the background. The presence of a vintage car adds to the sense of a historical context.

Possible Context:

Based on the clothing, setting, and the people depicted, it's likely this photograph was taken in the United States during the mid-20th century, possibly during the era of segregation.

Let me know if you want a more detailed description of any aspect!

Created by gemini-2.0-flash on 2025-05-05

The black and white image features a group of people standing near a building. On the left side of the frame, there are several individuals wearing hats. In the background, a car is parked in front of a house surrounded by trees. The right side of the frame is dominated by a building with vertical lines. The people in the foreground appear to be engaged in conversation or waiting for something. The overall composition of the image suggests a candid moment captured in time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

This black-and-white photograph depicts a group of people gathered outdoors, possibly in a residential or community setting. The group consists of several individuals, including men, women, and children, who appear to be engaged in conversation or an activity.

Here are some detailed observations:

  1. Setting: The background includes a wooden fence and a house with a tree in front of it. There are also a few cars parked on the street, suggesting that the scene is set in a neighborhood.

  2. People:

    • There are at least six people visible in the photograph.
    • The individuals are dressed in what appears to be casual or work attire, typical of the mid-20th century.
    • One woman is wearing a floral dress and a wide-brimmed hat, while another woman is holding a piece of paper or a booklet.
    • The men are wearing hats, with one man in a light-colored shirt and another in a striped shirt.
    • The children seem to be engaged with the adults, with one child looking at the paper held by the woman.
  3. Activity: The group appears to be focused on something, possibly discussing or sharing information. The woman holding the paper might be reading or explaining something to the others.

  4. Time Period: The style of clothing, the cars, and the overall quality of the photograph suggest it was taken in the mid-20th century, possibly around the 1950s or 1960s.

The image captures a moment of community interaction, possibly a casual gathering or a more formal meeting within the neighborhood.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This image is a black-and-white photograph depicting a group of individuals, seemingly from a historical context, gathered outside. The setting appears to be in front of a wooden building, with a second-story structure visible to the left. There are several vintage cars parked nearby, indicating the photo may be from an earlier era. The individuals are dressed in clothing styles that suggest a mid-20th-century setting. The group includes both men and women. Some individuals are wearing hats, and one person in the foreground appears to be holding a document or piece of paper, possibly a ballot or flyer, as they interact with others in the group. The overall atmosphere seems to convey a moment of community or civic engagement, possibly related to a voting event or a public gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph captures a group of people standing outside a wooden building, possibly a polling station or a community center. The individuals, dressed in a mix of casual and formal attire, are wearing hats and some are holding papers. In the background, there are trees and a parked car, suggesting an outdoor setting. The overall scene appears to depict a moment from a bygone era, possibly related to a significant event such as voting or community gathering. The expressions and body language of the people suggest a sense of purpose and engagement.