Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

Date

March 15, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4501.3

Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 15, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4501.3

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Dress 100
Fashion 100
Formal Wear 100
Gown 100
Walking 99
Suit 96.1
Robe 85.1
Outdoors 82
Bag 75.6
Head 62.9
Kimono 57.7
Accessories 57.6
Handbag 57.6
People 57.3
Coat 57.2
Architecture 57
Building 57
Shelter 57
City 56.2
Adult 56.1
Bridegroom 56.1
Male 56.1
Man 56.1
Wedding 56.1
House 55.8
Housing 55.8
Villa 55.8
Road 55.7

Clarifai
created on 2018-05-10

people 99.6
adult 96
group 95.4
group together 95.2
child 94.5
wear 94.4
monochrome 93.8
man 91.6
many 90.9
woman 90.4
education 86.6
room 85.6
indoors 82.7
administration 80.2
outfit 80
family 79.8
school 78
furniture 77.7
war 76.9
music 75.4

Imagga
created on 2023-10-07

people 24.5
man 19.5
city 16.6
weight 16.5
sports equipment 15.6
person 15.3
silhouette 14.9
male 14.9
building 14.2
business 14
black 13.2
urban 13.1
sport 13
group 12.9
dumbbell 12.6
athlete 11.8
equipment 11.6
crowd 10.6
world 10.4
men 10.3
barbell 9.8
success 9.6
run 9.6
boy 9.6
women 9.5
dark 9.2
happy 8.8
adult 8.7
lifestyle 8.7
architecture 8.6
motion 8.6
walking 8.5
modern 8.4
leisure 8.3
ball 8.3
competition 8.2
fitness 8.1
player 8.1
light 8
businessman 7.9
active 7.9
day 7.8
clothing 7.8
travel 7.7
life 7.7
move 7.7
shop 7.6
field 7.5
sign 7.5
outdoors 7.5
action 7.4
symbol 7.4
street 7.4
transportation 7.2
team 7.2
night 7.1
happiness 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

group 59.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 18-26
Gender Male, 87.8%
Calm 92.2%
Fear 6.7%
Surprised 6.3%
Sad 3.7%
Happy 1%
Angry 0.5%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 59.1%
Calm 88.8%
Surprised 6.3%
Fear 5.9%
Happy 5%
Sad 3.7%
Confused 1.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 21-29
Gender Female, 55.7%
Sad 62%
Confused 21%
Disgusted 14.9%
Calm 14.3%
Angry 11.2%
Surprised 8.3%
Fear 6.6%
Happy 3.2%

AWS Rekognition

Age 22-30
Gender Female, 54.3%
Happy 60.2%
Calm 30.2%
Surprised 6.6%
Fear 6%
Sad 4.6%
Angry 1.7%
Confused 0.9%
Disgusted 0.4%

AWS Rekognition

Age 13-21
Gender Male, 99.4%
Sad 99.6%
Calm 30.9%
Fear 6.5%
Surprised 6.5%
Confused 1.1%
Disgusted 0.6%
Happy 0.4%
Angry 0.2%

Feature analysis

Amazon

Person

Clarifai

Clothing
Person
Building
Footwear

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 97%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 93.8%

AWS Rekognition

Person 89.6%

AWS Rekognition

Person 81.9%

AWS Rekognition

Person 70.2%

AWS Rekognition

Person 64.5%

Clarifai

Clothing 74.1%

Clarifai

Clothing 68.9%

Clarifai

Clothing 64.1%

Clarifai

Clothing 62.1%

Clarifai

Clothing 55.5%

Clarifai

Clothing 48%

Clarifai

Person 61.7%

Clarifai

Person 59.2%

Clarifai

Person 58.4%

Clarifai

Person 56.4%

Clarifai

Person 54%

Clarifai

Person 53.1%

Clarifai

Person 46.8%

Clarifai

Person 45.6%

Clarifai

Person 44%

Clarifai

Person 37%

Clarifai

Person 35.5%

Clarifai

Person 33.2%

Clarifai

Building 55.9%

Clarifai

Building 42.1%

Clarifai

Footwear 54.6%

Clarifai

Footwear 52.8%

Clarifai

Footwear 52.6%

Clarifai

Footwear 50.7%

Clarifai

Footwear 47.9%

Clarifai

Footwear 47.1%

Clarifai

Footwear 45.5%

Clarifai

Footwear 44.5%

Clarifai

Footwear 42.3%

Clarifai

Footwear 42.1%

Clarifai

Footwear 42.1%

Clarifai

Footwear 37.8%

Clarifai

Footwear 37.2%

Clarifai

Footwear 36.9%

Clarifai

Footwear 36.7%

Clarifai

Footwear 33.1%

Categories

Imagga
created on 2023-10-07

paintings art 70.5%
streetview architecture 26%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-21

a photograph of a group of people standing in front of a building

Created by general-english-image-caption-blip-2 on 2025-07-05

a group of people standing outside of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image appears to be a photographic negative, featuring a group of people gathered outdoors in front of a large architectural structure. The building has traditional features, such as tiled roofs and stone walls, suggesting it may be a historical site or a structure inspired by East Asian architecture. The individuals are dressed in various garments, including robes and patterned clothing, and some appear to be conversing or engaged in an activity. The negative effect causes the colors and tones to be inverted, creating an eerie, monochromatic appearance where light areas are dark, and dark areas are light.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image appears to be a black and white negative of a group of people standing in front of a large stone wall and traditional building, possibly a gate or entrance. The people are wearing traditional clothing, which might be kimonos or similar garb, indicative of a formal or ceremonial event. The architecture suggests an East Asian style, likely Japanese, given the tiled sloping roofs and wooden structures. The individuals are arranged in a somewhat informal gathering, possibly discussing or waiting for an event to commence. The scene has a historic or cultural atmosphere, perhaps depicting visitors or participants at a historical site or cultural ceremony.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to depict a group of people gathered outside of a traditional-style building, possibly in an Asian or East Asian setting. The people are wearing a variety of traditional and modern clothing, suggesting a mix of cultural influences. The building itself has an ornate, architectural style with intricate details and patterns. The overall scene has a sense of formality and ceremony, though the specific context is not entirely clear from the image alone. The black and white format gives the image a timeless, historical quality.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-13

The black and white image shows a group of people, likely monks or religious figures, standing outside a traditional Japanese building at night. The building has a tiled roof and wooden beams characteristic of Japanese architecture. The people are wearing long robes and appear to be gathered for some kind of ceremony or event, as they are standing in an organized formation. The lighting suggests it is evening or nighttime, creating an atmospheric scene with the illuminated building in the background and the robed figures in the foreground.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white photograph that appears to be from a historical collection at Harvard University. The image shows a group of people standing in what appears to be a courtyard or outdoor space with traditional Japanese or East Asian architectural elements visible, including distinctive roof lines and stone walls. The people in the image are wearing traditional Japanese-style clothing or robes, and they appear to be arranged in an informal line or gathering. The architectural setting includes a white-walled structure with ornate details and a large stone wall in the background. The lighting and composition create strong contrasts between light and dark areas in the photograph. According to the image credit, this photograph is from the collection of the President and Fellows of Harvard College at the Harvard University Art Museums.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of people standing in front of a building, likely a museum or gallery. The individuals are dressed in attire that appears to be from the 19th century, with some wearing long coats and others in more formal attire.

  • Group of People
    • The group consists of approximately 20 individuals.
    • They are standing in a semi-circle formation.
    • Some are facing each other, while others are looking towards the building.
  • Building
    • The building is constructed from stone or brick.
    • It has a large entrance with a doorway.
    • There are several windows visible on the building.
  • Atmosphere
    • The atmosphere suggests a formal event or gathering.
    • The people appear to be engaged in conversation or discussion.
    • The overall mood is one of sophistication and refinement.

In summary, the image captures a moment of social interaction in front of a historic building, evoking a sense of elegance and culture.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of people gathered in front of a building. The individuals are dressed in traditional Japanese attire, with some wearing kimonos and others in more modern clothing. They appear to be engaged in conversation or observing something within the building.

In the background, the building features a tiled roof and a large stone wall. The overall atmosphere suggests a cultural or historical event, possibly related to Japanese heritage or tradition. The image may have been taken at a museum, cultural center, or other location where such events are typically held.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people standing in front of a building. The building has a traditional architectural design with a roof and pillars. The people are wearing white robes and hats, and some of them are holding sticks. The photograph has a watermark with the text "P1970.4501.0003" and the copyright symbol. The image appears to be taken during the day, as there is light coming from the right side of the building.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people gathered in front of a traditional building. The people are dressed in white robes and are standing in a semicircle, facing the building. The building has a large entrance with a stone wall on the right side. The entrance is framed by two pillars and has a large window above it. The image has a watermark in the bottom left corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-26

Here's a description of the image:

Overall Impression:

The image is a high-contrast, black and white negative photograph depicting a group of people gathered in front of a Japanese-style building or structure. The scene has an architectural focus, with the building itself being prominent.

Key Elements:

  • Architecture: The photograph's composition heavily features the building. It appears to have traditional Japanese architectural elements, such as a tiled roof, a large gate or entrance, and possibly stone walls. The details of the structure are highlighted by the negative effect.
  • People: A group of people are congregated in front of the building. They seem to be dressed in a variety of clothing, with some appearing to wear traditional attire. Their presence suggests a tour, a gathering, or some form of event taking place at the location.
  • Atmosphere: The atmosphere is calm and slightly formal, considering the setting and the way the individuals have dressed. The dark and bright tones create a dramatic feel.

Composition and Style:

  • Negative Effect: The image is a photographic negative. This has inverted the light and dark tones.
  • Framing: The framing focuses on a combination of architecture and figures, capturing the event from a medium distance.

In summary, the photo captures a scene of people gathering near a distinctive building that is likely of cultural or historical importance.

Created by gemini-2.0-flash on 2025-05-26

Certainly! Here's a description of the image:

The image is a black and white photograph that has been inverted, making bright areas appear dark and vice versa. In the foreground, there's a group of people gathered in what looks like a garden or grassy area.

In the background, there's a building with what appears to be a grand entrance. The architectural style seems Japanese, featuring a tiled roof, pillars, and possibly a gate. The building is flanked by what appear to be stone walls or structures, also indicative of Japanese castle or temple architecture.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph depicting a group of people standing outside a traditional Japanese building. The structure appears to be a temple or shrine, identifiable by its architectural style, which includes a tiled roof and ornate wooden elements. The people are dressed in traditional Japanese attire, including kimonos and hakama, which suggests a ceremonial or formal event.

The group is arranged in a semi-circle, facing towards the entrance of the building, which is elevated and accessible by a set of stairs. Some individuals are holding objects, possibly fans or small bags. The setting appears to be nighttime or in low light conditions, as indicated by the lighting and shadows in the photograph. The overall scene conveys a sense of solemnity and tradition.

The image is credited to the President and Fellows of Harvard College, specifically the Harvard University Art Museums, indicating that it is part of their collection. The photograph has a reference number, P1970.4501.0003, which can be used for further identification or research.

Qwen

No captions written

Text analysis

Amazon

and
Art
College
Fellows
(Harvard
Museums)
of
University
Harvard
© President and Fellows of Harvard College (Harvard University Art Museums)
President
P1970.4501.0003
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4501.0003
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4501.0003