Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Dining out-doors.

Date

c. 1912

People

Artist: Wolfson, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.159.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Dining out-doors.

People

Artist: Wolfson, American

Date

c. 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.159.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 97.9
Restaurant 97.1
Cafeteria 87.1
Furniture 69.4
Cafe 66.5
People 64.6
Porch 60.1
Indoors 58.2
Room 58.2
Art 57.8
Food 55.9
Food Court 55.9

Clarifai
created on 2019-06-05

people 100
group 99.6
adult 98.9
furniture 98.5
many 98.3
man 97.7
woman 96.9
room 96.4
group together 96
administration 94.3
leader 93.8
several 91.6
sit 91.1
child 90.3
military 90.2
chair 90.2
war 89.3
seat 86.6
wear 86.6
watercraft 83

Imagga
created on 2019-06-05

barbershop 69.4
shop 54.3
mercantile establishment 42.3
room 33
indoors 30.7
man 30.2
salon 29.5
home 28.7
place of business 28.4
people 27.9
male 22.7
smiling 22.4
interior 22.1
sitting 20.6
person 20
chair 19.8
table 19.3
adult 18.3
classroom 18.1
lifestyle 18.1
hairdresser 17.9
indoor 17.3
happy 16.9
couple 16.5
happiness 15.7
office 15.1
women 15
work 14.9
modern 14.7
men 14.6
computer 14.5
house 14.2
establishment 14.2
desk 12.7
meeting 12.2
business 12.1
smile 11.4
love 11
team 10.7
working 10.6
cheerful 10.6
together 10.5
group 10.5
laptop 10.2
inside 10.1
glass 10.1
occupation 10.1
relaxation 10
two people 9.7
portrait 9.7
color 9.5
togetherness 9.4
hospital 9.4
two 9.3
communication 9.2
window 9.2
holding 9.1
family 8.9
professional 8.9
20 24 years 8.9
businessman 8.8
furniture 8.8
chairs 8.8
life 8.8
couch 8.7
comfortable 8.6
talking 8.6
teacher 8.6
child 8.5
enjoyment 8.4
mature 8.4
teamwork 8.3
executive 8.3
kitchen 8.2
day 7.8
casual clothing 7.8
education 7.8
full length 7.8
corporate 7.7
college 7.6
living 7.6
adults 7.6
relationship 7.5
design 7.3
alone 7.3
businesswoman 7.3
board 7.2
romantic 7.1
architecture 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

person 98.3
clothing 98.1
wall 95.9
woman 89
man 85
old 65.1

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Sad 46.2%
Angry 49.9%
Confused 45.3%
Happy 47.5%
Disgusted 45.5%
Surprised 45.4%
Calm 45.2%

AWS Rekognition

Age 10-15
Gender Female, 54.8%
Happy 55%
Sad 45%
Disgusted 45%
Angry 45%
Surprised 45%
Calm 45%
Confused 45%

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Disgusted 45.1%
Sad 52.9%
Calm 45.3%
Confused 45.1%
Happy 45.1%
Surprised 45.1%
Angry 46.4%

AWS Rekognition

Age 15-25
Gender Female, 54.8%
Sad 54.8%
Angry 45.1%
Calm 45%
Confused 45.1%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 19-36
Gender Male, 53.4%
Sad 45.1%
Calm 54.4%
Happy 45.1%
Surprised 45.1%
Angry 45.1%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Happy 46.3%
Angry 46.7%
Calm 45.2%
Sad 45.9%
Surprised 45.5%
Confused 45.6%
Disgusted 49.7%

AWS Rekognition

Age 29-45
Gender Female, 52%
Confused 45.5%
Happy 46.1%
Sad 45.6%
Disgusted 45.9%
Angry 46%
Calm 50.3%
Surprised 45.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Sad 50.3%
Angry 49.5%
Disgusted 49.5%
Happy 49.6%

AWS Rekognition

Age 49-69
Gender Female, 50.3%
Happy 49.5%
Sad 50.5%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Surprised 46.2%
Sad 46%
Disgusted 46%
Happy 48.4%
Confused 45.3%
Calm 46.7%
Angry 46.4%

AWS Rekognition

Age 16-27
Gender Male, 50.3%
Calm 49.6%
Sad 49.6%
Surprised 49.5%
Angry 50.2%
Happy 49.5%
Confused 49.5%
Disgusted 49.6%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Chair
Painting

Clarifai

Table
Clothing
Person
Human face
Woman
Tree
Human hair

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 97%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 96.3%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 95.5%

AWS Rekognition

Person 87.1%

AWS Rekognition

Person 86.3%

AWS Rekognition

Person 85.3%

AWS Rekognition

Person 80.6%

AWS Rekognition

Person 59.2%

AWS Rekognition

Chair 69.4%

AWS Rekognition

Painting 57.8%

Clarifai

Table 77.5%

Clarifai

Table 67.2%

Clarifai

Table 45.5%

Clarifai

Table 44.1%

Clarifai

Clothing 74%

Clarifai

Clothing 73.9%

Clarifai

Clothing 73.6%

Clarifai

Clothing 72.4%

Clarifai

Clothing 72.3%

Clarifai

Clothing 71.3%

Clarifai

Clothing 64.4%

Clarifai

Clothing 62.6%

Clarifai

Clothing 58.5%

Clarifai

Clothing 48%

Clarifai

Clothing 46%

Clarifai

Clothing 45.2%

Clarifai

Clothing 44.5%

Clarifai

Clothing 41.2%

Clarifai

Clothing 38.1%

Clarifai

Clothing 37.5%

Clarifai

Person 63.7%

Clarifai

Human face 62.4%

Clarifai

Human face 58.1%

Clarifai

Human face 57.9%

Clarifai

Human face 50%

Clarifai

Human face 40.6%

Clarifai

Human face 40.5%

Clarifai

Human face 39.3%

Clarifai

Human face 38.6%

Clarifai

Woman 55.8%

Clarifai

Woman 40.1%

Clarifai

Tree 46%

Clarifai

Human hair 36.8%

Clarifai

Human hair 35.6%

Categories

Imagga
created on 2019-06-05

interior objects 79.4%
people portraits 15%
food drinks 3.2%
events parties 1.1%

Captions

Microsoft
created by unknown on 2019-06-05

an old photo of a person 77.5%
old photo of a person 74.3%
a group of people in a room 74.2%

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-04

a group of people sitting at a table eating

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people sitting at a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a group of individuals enjoying an outdoor dining experience on a covered porch. The tables are neatly arranged with tablecloths, and floral centerpieces add a decorative touch. The porch has wooden chairs and is adjacent to a building with visible windows and architectural details. In the background, there is a view of trees and another structure, contributing to a serene and pleasant atmosphere. A sign on the wall reads "Training Department Girls' School." The photograph evokes a sense of community and casual elegance.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of people gathered around tables on a covered outdoor porch or veranda. The setting is from an earlier time period, as indicated by the clothing style and the black-and-white tone of the photograph. The tables are adorned with tablecloths and decorative centerpieces, suggesting a formal or semi-formal dining occasion. The porch is partially enclosed with wooden beams and windows, and a building can be seen in the background. A sign is visible on the wall behind the tables, and potted plants or floral arrangements decorate the area, contributing to a pleasant and welcoming atmosphere. The caption below the image reads "Dining out-doors."

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a group of people dining outdoors on a porch or veranda. There are several tables set with tablecloths and dishes, and a large group of women are seated around the tables, engaged in conversation and enjoying their meal. The setting appears to be a rustic, wooden structure with a covered porch. The image has a sepia tone, indicating it is an older photograph, likely from the early to mid-20th century. The caption below the image reads "Dining out-doors."

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a historical black and white photograph labeled "Dining out-doors" showing what appears to be a covered porch or veranda being used as a dining area. There are several people seated around tables covered with white tablecloths. The diners are wearing light-colored clothing, typical of early 20th century fashion. There appears to be a decorative sign on the wall and some floral centerpieces on the tables. The setting looks quite formal with proper table settings. Through the open side of the porch, you can see part of a building exterior. The image has a sepia tone quality typical of photographs from this era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a vintage black-and-white photograph of a group of people dining outdoors. The scene is set on a covered porch, with a long table in the center, adorned with white tablecloths and chairs. The table is filled with an assortment of food and drinks, and the people are dressed in casual attire, suggesting a relaxed and informal gathering.

In the background, a house and a tree can be seen, adding to the serene atmosphere of the scene. The overall mood of the image is one of warmth and conviviality, capturing a moment of social connection and community.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image depicts a vintage photograph of a group of young girls seated at tables, engaged in dining outdoors. The scene is set on a covered porch or patio, with the girls dressed in white uniforms and seated around several tables adorned with tablecloths, plates, and silverware. The atmosphere appears to be one of camaraderie and enjoyment, as the girls are smiling and chatting with each other.

In the background, a building with windows and a sign can be seen, although the details are not clearly visible. The overall setting suggests a summer camp or boarding school, where the girls are gathered for a meal or social event. The image conveys a sense of warmth and friendship among the young girls, who are enjoying each other's company in a relaxed and informal setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

An old black and white photo shows a group of women sitting at a table on the porch of a house. They are dressed in white clothes and some are wearing hats. The table is covered with a white cloth and has a flower vase, a bowl, and a cup on it. There is a sign on the wall that reads "Dining out-doors." The house has a porch with pillars and a window.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The image is a monochromatic photograph of a group of people dining outdoors. The scene is set on a porch with a wooden floor and a railing. The tables are covered with white tablecloths, and each table has a vase of flowers in the center. The people are seated in chairs around the tables, and some are standing, possibly serving or attending to the diners. The image has a vintage filter, giving it an old-fashioned look.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-06

Here's a description of the image:

Overall Impression: The photograph captures a vintage scene of a group of people dining outdoors. It has a sepia tone, suggesting it was taken a long time ago.

Setting:

  • The scene appears to be on a covered porch or patio. There are large, white pillars and a roof, creating an open-air dining space.
  • The porch overlooks a building and grounds, possibly a residential or institutional setting, hinting at a summer camp or boarding school.
  • The image has a warm, light and airy feel.

People:

  • There is a group of young women, likely the main subjects of the photograph. They are seated around tables set with white tablecloths, plates, and silverware.
  • Some are in white dresses or tops, possibly uniforms or attire appropriate for the setting.
  • There seems to be some people serving food, which gives the impression of a special occasion, such as a meal at a camp or institutional dining.

Details:

  • Flowers are arranged on the tables, adding a touch of elegance.
  • The photo includes a sign hanging on the wall that is too blurry to read in this resolution, suggesting an institutional element.
  • The caption "Dining out-doors" clarifies the photograph's subject.

Overall Atmosphere: The image evokes a sense of nostalgia and community. It appears to be a pleasant gathering, captured from an historical moment.

Created by gemini-2.0-flash on 2025-05-06

Here is a description of the image:

The image is a sepia-toned photograph labeled "Dining out-doors." It features a group of girls or young women seated at tables set up on what appears to be a covered porch or veranda. The tables are draped with white tablecloths, and each place setting includes dishes and some form of floral centerpiece.

The girls are dressed in a variety of outfits, some wearing what looks like uniform-style dresses with neckties, while others are in lighter-colored clothing. A woman in the background is carrying a tray, suggesting she is serving the meal.

Behind the group of diners, there's a sign on the wall that reads "National Assistance for Children." To the right of the sign, there is what appears to be a menorah.

The veranda is surrounded by columns and windows, offering a view of a building and greenery outside. The image has a vintage, possibly historical feel to it. A small strip of greenery at the bottom of the photo provides some foreground detail.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a group of people dining outdoors in a formal setting. The scene appears to be from an earlier era, likely the early 20th century, judging by the attire and overall ambiance.

Here are the key details:

  1. Setting: The dining area is situated on what seems to be a covered porch or veranda. There are large windows and open doors, allowing for an open-air experience while still being somewhat enclosed.

  2. Tables and Decor: There are two long tables covered with white tablecloths, each adorned with floral centerpieces. The tables are set with plates, cutlery, and glasses, indicating a formal meal.

  3. People: The diners are dressed in formal attire. The women are wearing dresses and hats, typical of the fashion of the time. The men are in suits and ties. The group appears to be enjoying a meal together, possibly at a social event or gathering.

  4. Background: Through the windows, a building and some greenery are visible, suggesting the location might be in a residential or institutional setting with a garden or yard.

  5. Signage: On the wall to the right, there is a sign that reads "Jewish Working Girls' Vacation Society." This suggests that the gathering could be related to a social or charitable organization.

  6. Caption: The image is captioned "Dining out-doors," indicating the nature of the scene.

Overall, the image captures a moment of social dining in a historical context, highlighting the formal attire and setting of the time.

Qwen

Text analysis

Amazon

Dining
Dining out-doors.
out-doors.
GILI
AmIbadt

Google

CHILE Dining out-doors.
CHILE
Dining
out-doors.