Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

Date

March 15, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4501.4

Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 15, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4501.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Fashion 100
Clothing 100
Dress 100
Formal Wear 100
Gown 100
Robe 96.6
People 91.1
Architecture 89.8
Building 89.8
Prayer 89.8
Shrine 89.8
Temple 89.8
Walking 84.9
Footwear 78.6
Monastery 74.1
Outdoors 73.7
Overcoat 71.6
Face 70.1
Head 70.1
Accessories 62
Bag 62
Monk 61.9
Photography 57.1
Suit 56.8
Kimono 56.4
Nature 56.3
Garden 55.1
Graduation 55.1
Plant 55
Tree 55

Clarifai
created on 2018-05-10

people 99.8
group 97.9
group together 97.2
adult 96.5
child 95.6
man 94.5
many 94.2
woman 92.7
monochrome 91.4
wear 89.4
street 89.1
family 82.9
recreation 82.5
war 82.1
boy 82.1
administration 78.9
military 78.3
crowd 78.2
several 76.7
education 76

Imagga
created on 2023-10-06

brass 26.7
wind instrument 25.9
trombone 25
musical instrument 20.5
world 19.1
person 17
people 16.2
man 15.4
travel 14.8
park 14
adult 13.2
statue 12.6
bride 12.5
dress 11.7
summer 11.6
male 11.3
couple 11.3
stone 11
wedding 11
outdoors 11
color 10.6
life 10.5
two 10.2
architecture 10.1
old 9.7
sport 9.7
portrait 9.7
fountain 9.6
black 9.6
women 9.5
walking 9.5
love 9.5
happiness 9.4
water 9.3
monument 9.3
silhouette 9.1
protection 9.1
tourism 9.1
religion 9
group 8.9
groom 8.9
scene 8.6
sculpture 8.6
men 8.6
historical 8.5
pedestrian 8.4
outdoor 8.4
spectator 8.2
industrial 8.2
crutch 8
mask 8
weapon 7.6
dark 7.5
city 7.5
clothing 7.4
art 7.4
danger 7.3
dirty 7.2
suit 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.9
person 91.3
group 66.3
sport 65.8
people 62.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Female, 56.9%
Calm 98.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.7%
Happy 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Female, 90.4%
Sad 100%
Calm 10.2%
Surprised 6.4%
Fear 6.1%
Angry 1.1%
Confused 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.3%
Calm 94.9%
Surprised 6.4%
Fear 6%
Sad 3%
Angry 1.1%
Disgusted 0.4%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 50.1%
Calm 86.6%
Surprised 7.1%
Fear 6.2%
Sad 4.2%
Angry 3.5%
Disgusted 1.7%
Happy 0.7%
Confused 0.4%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 47-53
Gender Male, 86.3%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 95.1%
Calm 97.6%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 26-36
Gender Female, 91.8%
Calm 94.7%
Surprised 6.4%
Fear 6%
Sad 3.6%
Confused 0.5%
Angry 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 36-44
Gender Male, 97.9%
Calm 99%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0%

Feature analysis

Amazon

Adult
Male
Man
Person
Female
Woman
Coat
Shoe
Handbag

Clarifai

Tree
Clothing
Man
Footwear
Poster

AWS Rekognition

Adult 99%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 98.4%

AWS Rekognition

Adult 98.4%

AWS Rekognition

Male 99%

AWS Rekognition

Male 98.8%

AWS Rekognition

Male 98.4%

AWS Rekognition

Man 99%

AWS Rekognition

Man 98.8%

AWS Rekognition

Man 98.4%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 96%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 94.4%

AWS Rekognition

Person 91.6%

AWS Rekognition

Person 75.9%

AWS Rekognition

Person 69.7%

AWS Rekognition

Person 68.9%

AWS Rekognition

Person 67.8%

AWS Rekognition

Female 98.4%

AWS Rekognition

Woman 98.4%

AWS Rekognition

Coat 88.6%

AWS Rekognition

Shoe 78.6%

AWS Rekognition

Shoe 59.3%

AWS Rekognition

Shoe 55.6%

AWS Rekognition

Handbag 62%

Clarifai

Tree 87%

Clarifai

Tree 83%

Clarifai

Tree 77.7%

Clarifai

Tree 74.2%

Clarifai

Tree 68.9%

Clarifai

Tree 55.3%

Clarifai

Tree 51.2%

Clarifai

Tree 50.7%

Clarifai

Tree 33.5%

Clarifai

Clothing 86.7%

Clarifai

Clothing 84.7%

Clarifai

Clothing 80.9%

Clarifai

Clothing 65.3%

Clarifai

Clothing 62%

Clarifai

Clothing 61.1%

Clarifai

Clothing 58.6%

Clarifai

Clothing 55.9%

Clarifai

Clothing 49.4%

Clarifai

Clothing 47.5%

Clarifai

Clothing 47.3%

Clarifai

Clothing 44.2%

Clarifai

Clothing 39.3%

Clarifai

Clothing 37.1%

Clarifai

Clothing 33.5%

Clarifai

Man 77.5%

Clarifai

Man 67.5%

Clarifai

Man 66.2%

Clarifai

Man 64.6%

Clarifai

Man 62.6%

Clarifai

Man 57.2%

Clarifai

Man 56.7%

Clarifai

Man 36.9%

Clarifai

Footwear 53.2%

Clarifai

Footwear 51.7%

Clarifai

Footwear 51.3%

Clarifai

Footwear 43.5%

Clarifai

Footwear 42.9%

Clarifai

Footwear 41%

Clarifai

Footwear 40.7%

Clarifai

Footwear 40.7%

Clarifai

Footwear 40.5%

Clarifai

Footwear 40.4%

Clarifai

Footwear 39.6%

Clarifai

Footwear 38.9%

Clarifai

Footwear 37.9%

Clarifai

Footwear 37.9%

Clarifai

Footwear 36.5%

Clarifai

Poster 36.1%

Categories

Imagga
created on 2023-10-06

paintings art 81.2%
nature landscape 15.9%
streetview architecture 1.6%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of people standing in line at night

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of people in robes walking in front of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a group of individuals dressed in traditional Japanese attire, walking together outdoors. The scene has an inverted color scheme, resembling a photographic negative. They appear to be moving along a path in a landscaped setting with trees and a traditional Japanese building visible in the background. Some of the individuals are wearing robes and layered garments suggestive of formal or ceremonial clothing. The setting evokes a tranquil and historically rich environment.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a group of people, likely monks, wearing traditional Japanese robes and clothing. The setting appears to be outdoors, with individuals walking together in a procession. The background includes trees with sparse branches and an architectural structure consistent with traditional Japanese style, such as a temple or shrine building. The image is a black and white negative, which creates a unique visual effect where light areas appear dark and vice versa.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image appears to depict a group of people gathered in an outdoor setting, possibly in a religious or ceremonial context. The individuals are wearing traditional robes or garments, and the scene is captured in a black and white photograph. The background includes trees, buildings, and other architectural elements that suggest a temple or religious site. The overall composition and the formal attire of the individuals convey a sense of solemnity and ritual.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This black and white photograph shows a group of Buddhist monks walking in a line outdoors. They are wearing traditional monastic robes, some in dark colors and others in light colors. The setting appears to be in East Asia, with traditional architecture visible in the background along with trees. The monks are walking across what looks like an open field or courtyard area. The image has a serene, ceremonial quality to it, and according to the credit line, it's from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image depicts a group of elderly individuals, likely in their 60s or 70s, walking in a line. They are dressed in traditional Japanese attire, including kimonos and hakama, which are long, wide pants tied at the waist. The men wear dark-colored jackets over their kimonos, while the women wear lighter-colored kimonos. Some of them carry small bags or purses.

The group is walking on a paved path, possibly in a park or garden, surrounded by trees and buildings. The atmosphere appears to be one of celebration or ceremony, as the individuals seem to be participating in a procession or parade. The image suggests that the group may be part of a cultural or religious event, possibly a traditional Japanese festival or ceremony.

The image is in black and white, which adds to its nostalgic and timeless quality. The overall mood of the image is one of dignity and respect, as the elderly individuals move with purpose and grace. The image conveys a sense of tradition and cultural heritage, highlighting the importance of preserving and celebrating the customs and practices of Japan's past.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image depicts a group of individuals walking in a line, with the majority dressed in traditional Japanese attire. The group is comprised of 13 people, with 12 of them wearing traditional clothing and one person dressed in a long coat. The individuals are walking on a path, with trees and buildings visible in the background.

In the foreground, the group is the main focus, with the individuals' clothing and facial expressions being prominent. The traditional Japanese attire worn by most of the group adds a cultural element to the image.

In the middle ground, the path that the group is walking on is visible, as well as the trees and buildings in the background. The path appears to be made of gravel or dirt, and the trees are bare, suggesting that the image was taken during the winter months.

In the background, the buildings and trees provide a sense of context and setting for the image. The buildings appear to be traditional Japanese architecture, with tiled roofs and wooden structures. The trees are bare, but they add a sense of depth and texture to the image.

Overall, the composition of the image is simple yet effective, with the group of individuals being the main focus. The use of traditional Japanese attire and the bare trees in the background adds a cultural and seasonal element to the image.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The black-and-white photo features a group of people walking on the ground, probably in a park. They are wearing white robes, and some of them are wearing hats. They are walking in a line, and they seem to be going somewhere. Behind them are trees, and on the right side is a building. In the distance, there are more trees and a bridge.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image shows a group of people standing in a line, possibly for a photograph. They are all dressed in white robes and hats, and some of them are carrying bags. The background features trees and a building with a roof, possibly a temple or a shrine. The image has a black-and-white filter, giving it a vintage or historical feel. The watermark in the bottom left corner indicates that it is copyrighted by the President and Fellows of Harvard College (Harvard University Art Museums).

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

Overall Impression: The image is a black and white negative, giving it a unique visual quality. It appears to depict a group of people, possibly monks or individuals in traditional attire, walking along a path in what seems to be a temple or garden setting.

People:

  • There are many figures in the image, primarily dressed in what looks like traditional robes or kimonos.
  • They seem to be of various ages.
  • Their expressions are mostly neutral, suggesting a sense of purpose.

Setting:

  • The background includes large trees, suggesting a park-like or garden environment.
  • In the distance, there's a building that resembles a traditional Japanese temple or pagoda.
  • The lighting appears to be natural, but the negative effect reverses the light and shadow.

Atmosphere:

  • The overall mood is peaceful and serene.
  • The composition and the direction of the figures moving towards the distance create a sense of movement and journey.
  • The effect of the negative film adds a touch of mystery and age.

Created by gemini-2.0-flash on 2025-05-22

Here is a description of the image:

The image shows a group of people in the foreground, seemingly in a line or procession. They are wearing a mix of what appears to be traditional and formal clothing. Behind them are trees and a building with what looks like traditional Asian architecture. The image has been inverted, giving it a surreal and ghostly effect, where dark areas appear light and vice versa. This inversion may be intentional to create an artistic effect or it could be due to the original image being a negative. The scene has a solemn or ceremonial atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The black-and-white photograph depicts a group of people walking outdoors, likely in a serene, natural setting. The group consists of both men and women, dressed in a mix of traditional and modern clothing. Some individuals are wearing robes or shawls, suggesting a cultural or religious significance to the attire. The background features trees, shrubbery, and traditional architecture, indicating that the scene might be taking place in an area with historical or cultural importance, possibly a temple or a shrine. The overall atmosphere appears calm and contemplative, with the individuals seemingly engaged in a peaceful procession or gathering. The image is credited to the President and Fellows of Harvard College, indicating it may be part of a historical or cultural collection from Harvard University Art Museums.

Qwen

No captions written

Text analysis

Amazon

College
and
Art
(Harvard
Fellows
Museums)
of
University
Harvard
© President and Fellows of Harvard College (Harvard University Art Museums)
President
P1970.4501.0004
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4501.0004
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4501.0004