Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

Date

March 15, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5477

Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 15, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5477

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 99.9
Clothing 95.2
Coat 95.2
Architecture 95
Building 95
Housing 95
Formal Wear 93.7
Fashion 88
House 85.4
Monastery 76.9
Plant 74.5
Tree 74.5
Dress 72.4
Outdoors 69.6
Gown 65.8
Suit 57.4
Overcoat 57.1
Shelter 56.9
Graduation 56.8
Villa 56.6
Walking 56.1
Garden 56
Nature 56
Prayer 55.5
Shrine 55.5
Temple 55.5

Clarifai
created on 2018-05-10

people 99.9
group together 99.2
adult 97.3
man 96.3
street 96
administration 95.5
monochrome 95.2
two 94.8
child 94.6
group 93.9
war 90.7
home 90.4
wear 89.2
three 89.2
leader 88.6
uniform 88.2
military 87.9
many 86.9
several 86.4
chair 86.1

Imagga
created on 2023-10-05

swing 100
mechanical device 100
plaything 100
mechanism 83.1
snow 69.5
winter 54.5
cold 44.8
landscape 30.5
season 28.9
forest 27.9
tree 27.7
trees 24.9
weather 24.8
park 23.1
snowy 22.4
ice 19.4
outdoor 19.1
outdoors 18.8
frozen 18.2
frost 16.3
scenery 16.2
man 16.1
freeze 15.6
wood 15
mountain 14.2
woods 13.4
seasonal 13.1
scene 13
sport 12.6
recreation 12.6
old 12.5
country 12.3
scenic 12.3
sky 12.1
city 11.6
rural 11.5
couple 11.3
travel 11.3
people 11.2
snowing 10.8
male 10.7
storm 10.6
fun 10.5
walk 10.5
path 10.4
outside 10.3
covered 9.7
adult 9.1
road 9
vacation 9
river 8.9
day 8.6
person 8.6
walking 8.5
bench 8.5
street 8.3
countryside 8.2
child 8.2
happy 8.2
activity 8.1
cool 8
ski 8
building 7.9
grass 7.9
chilly 7.9
frosty 7.8
trail 7.8
lonely 7.7
garden 7.5
peaceful 7.3
exercise 7.3
active 7.2
family 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.7
tree 99.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-22
Gender Female, 86.7%
Happy 31.3%
Fear 18.1%
Surprised 17%
Sad 16.8%
Calm 13.1%
Confused 4.1%
Angry 2.4%
Disgusted 1.7%

AWS Rekognition

Age 21-29
Gender Male, 99.5%
Angry 72%
Disgusted 7.8%
Sad 7.2%
Surprised 6.9%
Fear 6.7%
Confused 3.6%
Happy 2.4%
Calm 2%

AWS Rekognition

Age 11-19
Gender Male, 84.2%
Calm 39.5%
Fear 15.3%
Happy 12.8%
Angry 9.4%
Disgusted 9.1%
Surprised 8.4%
Sad 7.1%
Confused 1%

AWS Rekognition

Age 22-30
Gender Male, 92.4%
Calm 81.2%
Sad 8.8%
Surprised 6.8%
Fear 6.2%
Happy 2.2%
Confused 2%
Angry 1.3%
Disgusted 1%

Feature analysis

Amazon

Person

Clarifai

Tree
Clothing
Person
Footwear
Man

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.1%

Clarifai

Tree 96.4%

Clarifai

Tree 71%

Clarifai

Tree 62.3%

Clarifai

Tree 56.9%

Clarifai

Tree 52.3%

Clarifai

Tree 51.3%

Clarifai

Tree 47.2%

Clarifai

Tree 44.3%

Clarifai

Tree 40.2%

Clarifai

Clothing 67.3%

Clarifai

Clothing 58.7%

Clarifai

Person 52.1%

Clarifai

Footwear 50.9%

Clarifai

Footwear 50.3%

Clarifai

Footwear 47.7%

Clarifai

Footwear 45.7%

Clarifai

Footwear 40.2%

Clarifai

Footwear 39%

Clarifai

Man 41.3%

Categories

Imagga
created on 2023-10-05

streetview architecture 55.7%
nature landscape 38.5%
beaches seaside 4.8%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a group of people standing around a park

Created by general-english-image-caption-blip-2 on 2025-07-06

two women in traditional clothing standing in front of a gate

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This is a black-and-white photograph that appears to depict an outdoor scene, possibly in Japan based on architectural features and signage. Three women are walking together on a gravel path, dressed in formal attire—blazers, skirts, and dress shoes—with one carrying a small bag or purse. They seem to be engaged in conversation or sharing a moment together. In the background to the left, there is a traditional-style gate with a tiled roof, which hints at a possible temple or historical site. To the right, there is a bamboo fence, trees, and a sign written in Japanese. Part of another individual dressed in light-colored clothing is visible at the far right of the image. The overall setting gives a serene impression, with the trees adding a touch of nature and balance.

Created by gpt-4o-2024-08-06 on 2025-06-13

The black and white image depicts three women walking side by side on a gravel path. They are dressed in similar attire, wearing dark skirts and jackets, and appear to be engaged in conversation as they walk. The background features a traditional gate structure, highly reminiscent of Japanese architecture, with ornate curved roof details. Behind the women, there is a fence with trees visible above it. There is a sign attached to the fence, which has some writing on it. To the far right of the image, there is a partial view of another person's leg, suggesting more people are around. The setting seems to be in an outdoor area, possibly a park or a historical site.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting a scene in what seems to be a traditional Japanese setting. In the foreground, there are three people walking together, dressed in what looks like formal attire. In the background, there are several traditional Japanese-style buildings and structures, surrounded by lush greenery and trees. The overall atmosphere of the image conveys a sense of tranquility and cultural heritage.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be taken in Japan, likely at a temple or shrine grounds. In the image, three people wearing dark dresses or skirts are walking together across what appears to be a gravel or dirt courtyard. On the left side of the image, there's a traditional Japanese architectural structure with distinctive roof tiles and design. There are trees in the background, and what looks like a fence or barrier with a sign mounted on it to the right. The style of dress and the quality of the photograph suggests this was taken sometime in the mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black and white photograph of three women walking in a courtyard, possibly in Japan. The women are dressed in traditional Japanese clothing, with the two women in the foreground wearing kimonos and the woman in the background wearing a modern dress. They appear to be walking towards the left side of the image, with their heads turned towards each other as if they are engaged in conversation.

In the background, there is a large tree and a building with a tiled roof. The courtyard is surrounded by a low wall, and there are several other people visible in the background, including a man in a white shirt and black pants standing near the entrance to the courtyard.

Overall, the image suggests that the women are visiting a traditional Japanese garden or temple, and are enjoying a leisurely stroll through the courtyard. The image has a nostalgic feel to it, and the black and white photography adds to the sense of timelessness and elegance.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a black and white photograph of three women walking in a gravel courtyard. The women are wearing dark-colored dresses and jackets, with the woman on the right holding a book or paper in her left hand. They are walking towards the left side of the image.

In the background, there is a large tree with a sign on the right side of the image. The sign appears to be written in Japanese characters. On the left side of the image, there is a large gate with a tiled roof. The gate is open, and it appears to lead to another area of the courtyard.

The overall atmosphere of the image suggests that it was taken in a formal or ceremonial setting, possibly at a school or university. The women's attire and the presence of the gate and sign suggest a sense of tradition and formality.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The black-and-white photo shows four people, three women and one man, standing in front of a building. They are all wearing black dresses, and one of the women is wearing a white shirt. They are standing in front of a wooden fence with a sign on it. Behind them is a building with a roof and a gate. There are trees and plants in the area.

Created by amazon.nova-pro-v1:0 on 2025-06-10

A black-and-white photo shows three women walking on a gravel surface, possibly in a park. They are wearing skirts, blouses, and shoes. One of them is carrying a handbag. Behind them, there is a wooden fence with a signboard attached to it. There are also trees and a gate in the distance. The photo has a white border on the sides.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

Here is a description of the image:

Captured in a vintage, black-and-white aesthetic, the image showcases three Japanese women in uniform, walking in a garden. The women are dressed in what appears to be matching school uniforms, complete with dark jackets, skirts, and possibly socks and shoes, evoking a sense of uniformity and cultural attire.

The backdrop features a traditional Japanese gate on the left, hinting at a temple or shrine, complemented by lush trees and shrubbery behind them, which add a touch of nature to the scene. A white wall or fence with a small signboard is visible behind the women on the right, possibly displaying a set of instructions in Japanese.

The photograph is filled with contrasts: the dark uniforms against the light-colored path, the man in a white coat, and the natural greenery juxtaposed with the architectural elements. The overall composition of the image, with the women in motion and the classic Japanese setting, creates a timeless and culturally rich moment.

Created by gemini-2.0-flash-lite on 2025-06-03

Here's a description of the image:

Overall Impression:

The photograph is a black and white image with a vintage feel. It appears to be taken in an outdoor, possibly historical, setting.

Main Elements:

  • Three Women: The primary focus is on three women dressed in what appears to be school uniforms, walking side-by-side from left to right in the image.
  • Architecture: To the left of the women, there's a traditional Japanese-style gate or entrance, possibly leading to a temple or a similar structure. The gate has a distinctive roof.
  • Environment: The foreground is a large, open area covered in small gravel or stones. In the background, there are trees and a fence, and a sign can be seen.

Details and Atmosphere:

  • Black and White: The monochrome palette emphasizes the age of the photo and gives it a classic aesthetic.
  • Framing: The composition is well-balanced. The women are positioned in a way that suggests they're moving towards something.
  • Context: The scene evokes a sense of calm and history. It might have been taken at a tourist location.

Possible Interpretations:

The photo could be a snapshot of a school trip, a day out, or a moment captured in time. The lack of further information leaves room for interpretation and invites the viewer to imagine the story behind the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The black-and-white photograph depicts a group of three people standing in what appears to be a traditional Japanese setting. The individuals are dressed in traditional attire, likely kimonos, and are standing close to one another, seemingly engaged in conversation. The background features a traditional Japanese building with a tiled roof and wooden structure, surrounded by trees and a well-maintained gravel pathway. To the right, there is a sign with Japanese characters on it, and a wooden fence can be seen further in the background. The overall scene suggests a serene and culturally rich environment, possibly a temple or shrine grounds.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a scene with three individuals standing in a spacious, open area that appears to be a park or a similar outdoor setting. The ground is covered with gravel or sand, and there are trees and wooden structures in the background, including a gate and a signpost. The individuals are dressed in what seems to be traditional attire, possibly indicating a cultural or historical context. The overall atmosphere is calm and serene, with the individuals appearing to be engaged in a quiet activity or conversation. The architecture in the background suggests a setting that might be significant or culturally important, possibly a historical site or a temple grounds.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph showing a group of three women walking together in what appears to be a serene, open area with gravel or packed earth underfoot. They are dressed in matching uniforms, likely indicating they are students from a school, as the outfits resemble traditional school attire. Their outfits include knee-length skirts, blouses, and possibly sweaters or jackets. They seem to be engaged in conversation as they walk.

In the background, there is a traditional Japanese torii gate, suggesting that this location may be near or within a shrine or temple complex. The torii is made of wood and has a classic design with a curved top. Behind the torii, there is dense foliage, including tall trees and bushes, adding to the serene atmosphere. To the right of the women, there is a wooden fence and a sign, although the text on the sign is not legible in the image. The overall setting appears peaceful and traditional, with a mix of natural and man-made elements. The photograph has a nostalgic feel, possibly dating back to a time when black-and-white photography was more common.

Text analysis

Amazon

AI
AL
AL BOTHERS
BOTHERS