Human Generated Data

Title

Untitled (Hong Kong)

Date

March 3, 1960-March 13, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4418.4

Human Generated Data

Title

Untitled (Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4418.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Indoors 100
Restaurant 100
Architecture 100
Building 100
Dining Room 100
Dining Table 100
Furniture 100
Room 100
Table 100
Cafeteria 100
Cafe 100
Wedding 98.9
Home Decor 94.5
Linen 94.5
Face 87
Head 87
Plant 81.7
Potted Plant 81.7
Flower 80.3
Flower Arrangement 80.3
Living Room 79.6
Accessories 67.8
Couch 57.7
Food 57.6
Food Court 57.6
Tablecloth 57.6
Flower Bouquet 57.6
Sitting 56.5
Meal 56.4
Interior Design 56.3
Back 55.8
Body Part 55.8

Clarifai
created on 2018-05-09

people 99.7
adult 98.1
woman 97.3
group 97.2
wedding 96.5
man 95.9
several 92.6
family 91.6
two 91.3
ceremony 90.2
four 89.6
group together 89.6
wear 89.1
child 86.9
bride 86.6
sit 86.6
furniture 86.3
five 85.1
groom 84.8
leader 83.1

Imagga
created on 2023-10-06

room 28.5
man 26.2
people 24
table 22.3
person 21.4
chair 21.3
indoors 19.3
indoor 19.2
interior 18.6
home 18.3
male 17.8
musical instrument 17.7
restaurant 17.2
sitting 17.2
adult 16.1
computer 15.6
business 15.2
laptop 14.9
office 14.3
teacher 13.2
work 13
communication 12.6
desk 12.4
living 12.3
furniture 12.2
professional 11.7
businessman 11.5
together 11.4
meeting 11.3
group 11.3
modern 11.2
house 10.9
happy 10.6
couple 10.5
window 10.4
women 10.3
happiness 10.2
smiling 10.1
inside 10.1
holiday 10
wind instrument 9.9
executive 9.9
couch 9.7
technology 9.6
building 9.6
love 9.5
men 9.4
elegant 9.4
decoration 9.4
lifestyle 9.4
keyboard instrument 9.2
vintage 9.1
portrait 9.1
cheerful 8.9
family 8.9
talking 8.6
two 8.5
holding 8.3
accordion 8.2
suit 8.1
team 8.1
light 8
job 8
working 8
worker 7.8
education 7.8
old 7.7
educator 7.7
style 7.4
teamwork 7.4
occupation 7.3
businesswoman 7.3
dress 7.2
stringed instrument 7.2
smile 7.1

Google
created on 2018-05-09

Microsoft
created on 2018-05-09

indoor 88

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 37-45
Gender Male, 97.8%
Sad 52.9%
Calm 31.9%
Happy 21.1%
Surprised 9.4%
Fear 6.6%
Angry 5.5%
Disgusted 5%
Confused 2%

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Male
Man
Chair
Glasses

Clarifai

Clothing
Man
Table
Woman
Human face
Chair
Human hair
Plant
Tree
Human arm
Window
Human head
Flower

AWS Rekognition

Adult 98.9%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Bride 98.9%

AWS Rekognition

Female 98.9%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 96.5%

AWS Rekognition

Woman 98.9%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 98.5%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 98.5%

AWS Rekognition

Chair 84.9%

AWS Rekognition

Glasses 67.8%

Clarifai

Clothing 93.5%

Clarifai

Clothing 78.2%

Clarifai

Man 91.1%

Clarifai

Man 50.8%

Clarifai

Table 86.2%

Clarifai

Table 65.4%

Clarifai

Table 34.2%

Clarifai

Woman 83.2%

Clarifai

Human face 68.7%

Clarifai

Human face 55.2%

Clarifai

Human face 55.1%

Clarifai

Chair 52.2%

Clarifai

Chair 35%

Clarifai

Human hair 45.4%

Clarifai

Human hair 41.3%

Clarifai

Plant 43.4%

Clarifai

Plant 41.4%

Clarifai

Plant 37.6%

Clarifai

Tree 42.1%

Clarifai

Human arm 41.4%

Clarifai

Window 39.5%

Clarifai

Human head 35.4%

Clarifai

Flower 34.9%

Categories

Imagga
created on 2023-10-06

interior objects 97.6%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man and woman sitting at a table

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of people sitting at tables

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This appears to be a black-and-white negative image depicting people seated at tables in an outdoor dining area. There are at least four individuals visible, including two prominently in the foreground—a man wearing a suit and tie, who is drinking from a glass, and a woman wearing a patterned sleeveless top. The background features lush greenery, plants, and architectural elements, including a curved archway and glass-paned doors. On the wall, there is a framed abstract artwork or decorative element. The scene suggests a relaxed social setting, possibly at a restaurant or cafe. The negative format creates a reversal of light and dark tones, distorting the usual appearance.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image appears to be a black and white photo negative showing a group of people seated at tables in what looks like an outdoor or semi-outdoor dining area. In the foreground, a man and a woman are sitting at a table with a black tablecloth. The man is drinking from a glass, while the woman, wearing glasses and a patterned sleeveless top, looks on. There are bottles and condiment containers on the table.

In the background, more people are seated around tables. The setting is surrounded by potted plants and there is natural foliage visible, indicating a garden or patio environment. On the wall behind the main subjects, there is an abstract piece of art depicted in negative form, and a doorway or window can be seen letting light into the scene.

The overall atmosphere suggests a casual dining or social gathering experience.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of people gathered around a table in what appears to be a dining or social setting. The scene is captured in black and white, giving it a vintage feel. The background includes tropical plants and a framed artwork on the wall, suggesting a warm, indoor environment. The people at the table seem to be engaged in conversation, with some holding drinks. The overall atmosphere conveys a sense of casual gathering or social interaction.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing what appears to be a restaurant or dining area. Several people are seated at tables covered with white tablecloths. There are decorative palm plants visible in the background and a simple abstract artwork mounted on the wall. The setting appears to be from a mid-20th century time period, as suggested by the furniture style and overall ambiance. Glass bottles, possibly beverages, can be seen on one of the tables. The chairs appear to be white and have a distinctive vintage design. The image has a casual, relaxed dining atmosphere typical of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a group of people sitting at tables in a room with plants and a painting on the wall.

  • The room has a high ceiling and is well-lit, suggesting it may be a restaurant or cafe.
  • There are several tables with chairs around them, and people are seated at some of the tables.
  • The people are all dressed in casual clothing, and some of them are holding cups or glasses.
  • In the background, there are several plants and a painting on the wall.
  • The overall atmosphere of the image appears to be relaxed and social, with people enjoying each other's company in a comfortable setting.

The image suggests that the people in the room are enjoying a meal or a drink together, and the relaxed atmosphere and casual clothing suggest that it may be a social gathering or a casual outing.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a black-and-white photograph of a restaurant or dining area, featuring several individuals seated at tables. The scene is set against a backdrop of potted plants and a wall adorned with a piece of artwork.

In the foreground, a woman wearing a dress with a floral pattern sits at a table, facing another individual who is not fully visible. To her left, a man sits at a separate table, dressed in a suit jacket and holding a glass to his mouth. Behind him, another person is seated, although their features are not clearly discernible.

The atmosphere of the image suggests a formal or semi-formal dining setting, possibly during the evening hours given the presence of tablecloths and the attire of the individuals. The overall mood appears to be one of relaxation and socialization, as the people in the image seem to be engaged in conversation or enjoying their meals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph featuring a group of people sitting at tables in an outdoor setting. The tables are covered with tablecloths, and there are plants and trees in the background. The man in the center is wearing a suit and tie and is holding a glass. The woman on the right is wearing glasses and a floral dress. The image has a watermark in the bottom right corner that reads "P1970.4418.0004."

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of a group of people sitting in a restaurant. The photograph is taken from a low angle, capturing the people's heads and shoulders. The group is seated around a table with a tablecloth, and there are bottles and other items on the table. The background features a wall with a square-shaped cutout, possibly a window or a decorative element. The restaurant has a tropical or exotic theme, with palm trees and other tropical plants in the background. The people in the photograph appear to be engaged in conversation, with some of them smiling and others looking down. The image has a vintage feel, possibly taken in the mid-20th century.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-02

Here is a description of the image:

This black and white photograph appears to capture a moment of casual dining. The scene unfolds in what seems to be an outdoor dining space, possibly a veranda or patio. Several figures are seated at tables, engaging in conversation or consuming a meal.

In the foreground, a man is captured in the act of drinking from a glass, his face illuminated by the light. Adjacent to him, a woman is seen, possibly conversing with the man. A table is set before them, adorned with a tablecloth and a few items.

The background reveals other individuals seated, some with their backs to the camera. The space is embellished with plants and foliage, including a window or doorway that provides glimpses of an exterior landscape.

On one of the walls, a abstract-looking artwork is displayed, adding a touch of decorative flair to the ambiance. The negative-like quality of the image creates an effect, which enhances the textural details and silhouettes of the scene.

Created by gemini-2.0-flash on 2025-06-02

Here is a description of the image:

The black and white photograph shows a gathering of people, seemingly at a meal, in what appears to be an open-air restaurant or a veranda. The image appears to be a negative.

In the foreground, a woman is seated with her back to the viewer, wearing a sleeveless dress with a floral pattern. Next to her, a man in a suit and tie is drinking from a glass, his face partially obscured by the glass.

Further back, there's another person seated at a table, with their back facing the camera. To the left, another individual can be seen wearing a hat or turban.

The setting is decorated with potted plants, including what appear to be palm trees. A stylized square artwork hangs on a wall in the background. A window and tree can be seen in the distance.

A copyright notice is visible at the bottom, crediting the President and Fellows of Harvard College (Harvard University Art Museums), along with a catalog number.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a group of people seated at a table, seemingly engaged in a formal or semi-formal gathering. The setting appears to be outdoors or in a well-lit indoor space with large windows, as suggested by the presence of natural light and visible plants in the background.

Key details include:

  1. People: There are several individuals seated around the table. The attendees appear to be older adults, dressed in what looks like formal or semi-formal attire. One person in the foreground is wearing a patterned blouse, while others are dressed in suits and dresses.

  2. Table and Seating: The table is covered with a tablecloth and set with various items, including bottles, glasses, and possibly ashtrays. The chairs are a mix of styles, including wooden and upholstered chairs.

  3. Background: The background features large potted plants and possibly a painted backdrop, giving the scene a somewhat staged appearance. There is also a rectangular, abstract artwork or decoration on the wall.

  4. Lighting: The lighting suggests it is daytime, with natural light illuminating the scene.

  5. Atmosphere: The overall atmosphere appears to be calm and composed, indicative of a meeting, luncheon, or social event.

The photograph is credited to the President and Fellows of Harvard College, part of the Harvard University Art Museums, suggesting it might be part of an archival or historical collection.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a social gathering or event, possibly in a formal or semi-formal setting. The setting appears to be indoors, with a group of individuals seated at tables covered with tablecloths. Some of the tables have drinks and possibly bottles, suggesting a meal or a reception. There are potted plants and decorative elements, including a wall-mounted piece of art that looks like a stylized bone shape. The individuals are dressed in formal or semi-formal attire, and the overall atmosphere suggests a professional or academic event, as indicated by the caption which credits the President and Fellows of Harvard College and the Harvard University Art Museums.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph captures a social gathering in what appears to be a formal or semi-formal setting, possibly a restaurant or private event. The scene is bright and airy, with natural light streaming in, and there are elements of outdoor plants and decor visible, suggesting a setting that blends indoor and outdoor spaces.

The main focus is on two seated individuals in the foreground, a man and a woman. The man, wearing glasses and a suit with a tie, is captured mid-action, possibly drinking or gesturing with a glass. The woman, wearing glasses and a dress, is turned towards him, seemingly engaged in conversation. A table between them holds bottles, glasses, and other items, indicating a dining or refreshment context.

In the background, there are other seated individuals, partially visible, adding to the sense of a social gathering. The overall mood appears relaxed and informal, with people engaged in conversation and enjoying their time together. The image is attributed to the President and Fellows of Harvard College (Harvard University Art Museums), suggesting it may have historical or cultural significance.

Text analysis

Amazon

and
Art
College
Fellows
(Harvard
Museums)
of
Harvard
University
President
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4418.0004
©

Google

President and Fellows of Harvard College (Harvard University Art Museums) P1970.4418.0004
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4418.0004