Human Generated Data

Title

Ellora, The Mosque of Aurungzebe at Rosa

Date

c. 1869

People

Artist: Colin Murray, British, English 1840-1884

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.49

Human Generated Data

Title

Ellora, The Mosque of Aurungzebe at Rosa

People

Artist: Colin Murray, British, English 1840-1884

Date

c. 1869

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.49

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Dome 100
Architecture 100
Building 100
Human 98.8
Mosque 95.3
Art 84.5
Arch 71.4
Arched 71.4
City 59.5
Town 59.5
Urban 59.5
Spire 55
Tower 55
Steeple 55

Clarifai
created on 2023-10-26

architecture 99
building 98
people 97.6
art 96.9
tower 94.8
religion 94.8
street 94.7
travel 94.6
city 94.3
arch 93.4
group 92.9
no person 92.7
castle 90.7
grave 90.4
monument 90.3
old 88.2
church 88
sky 86.8
temple 86
bridge 85.7

Imagga
created on 2022-01-22

mosque 100
place of worship 100
building 100
structure 71.8
architecture 57
religion 50.3
church 48.2
dome 36.9
old 33.5
travel 33.2
history 30.5
tower 29.6
cathedral 29.3
sky 27.5
tourism 26.5
monument 26.2
monastery 24.3
landmark 23.5
religious 23.5
cross 22.7
culture 22.3
historical 21.7
temple 20
ancient 19.9
orthodox 19.6
historic 19.3
tourist 17.3
famous 16.8
exterior 16.6
place 15.9
traditional 15.8
city 15.8
town 15.8
faith 15.3
stone 15.2
god 14.4
minaret 13.7
prayer 12.6
holy 12.5
religious residence 11.7
arch 11.7
gold 11.5
bridge 11.5
cupola 10.8
palace 10.8
river 10.7
worship 10.7
east 10.3
residence 10.3
domes 9.9
vacation 9.8
night 9.8
marble 9.7
golden 9.5
wall 9.4
destination 9.4
sacred 8.8
column 8.7
medieval 8.7
attraction 8.6
clouds 8.5
facade 8.3
style 8.2
chapel 7.9
praying 7.8
art 7.8
bell 7.7
castle 7.7
architectural 7.7
spirituality 7.7
house 7.7
statue 7.6
cityscape 7.6
buildings 7.6
symbol 7.4
water 7.4
roof 7.4
square 7.3

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

sky 94.7
text 92.6
building 89.2
old 83.5
white 82.8
black and white 68
black 67.5
place of worship 56.5
mosque 41
stone 18

Color Analysis

Feature analysis

Amazon

Person
Painting

Clarifai

Building
Tree
Clothing
Person
Window

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 93%

AWS Rekognition

Person 86.6%

AWS Rekognition

Person 86.4%

AWS Rekognition

Person 70.2%

AWS Rekognition

Person 66.1%

AWS Rekognition

Person 64.6%

AWS Rekognition

Person 54.9%

AWS Rekognition

Person 50.7%

AWS Rekognition

Painting 84.5%

Clarifai

Building 97.6%

Clarifai

Building 87.5%

Clarifai

Tree 67.4%

Clarifai

Clothing 55.9%

Clarifai

Clothing 45.3%

Clarifai

Clothing 34.9%

Clarifai

Clothing 33.6%

Clarifai

Person 38.2%

Clarifai

Person 35.3%

Clarifai

Window 37.4%

Categories

Imagga
created on 2022-01-22

streetview architecture 99.3%

Captions

Microsoft
created by unknown on 2022-01-22

a vintage photo of an old building 92.8%
a vintage photo of an old church 89.5%
a vintage photo of a church 89.4%

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

a view of the courtyard.

Salesforce

Created by general-english-image-caption-blip on 2025-05-21

a photograph of a group of people standing around a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image depicts a historical architectural site, likely a courtyard within a mosque or palace, showcasing intricate Indo-Islamic design elements. The main building on the right features an elegant row of arched openings supported by columns, topped by a dome with ornamental details. Two ornate tall pillars (or minarets) flank the structure in the background. The walls and arches on the left exhibit stucco or plasterwork, emphasizing traditional craftsmanship.

In the foreground, several people are gathered, sitting or standing in groups, adding a human element to the scene. Appearing dressed in traditional attire, they seem to interact or observe their surroundings. The courtyard itself is paved, with visible features such as steps and low structures. The lighting casts a mix of shadows and highlights, suggesting a bright midday setting. The photo is in sepia tones, giving it a vintage or historic look.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts an old photograph of a historical architectural site, which appears to be a courtyard and mosque with traditional Islamic architecture. The structure prominently features arches along a corridor with a large dome in the background, indicating it might be a part of a mosque or a palace. The architectural details include ornate pillars and decorative elements typical of Islamic design. There are several people, including men and women in traditional attire, gathered and seated near the entrance and along the edges of the courtyard. The shadows suggest it's either early morning or late afternoon, as they are long and casting towards the center of the image. The setting conveys an air of historic significance and cultural richness.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to depict an ornate, historic architectural structure, likely a mosque or other religious building. The structure features intricate arched doorways, domes, and decorative elements characteristic of Islamic architectural styles. In the foreground, there are several people sitting and standing, suggesting this is a public or communal space. The overall scene conveys a sense of history and cultural heritage.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a historical black and white photograph showing the interior courtyard of what appears to be a mosque or religious building in Islamic architectural style. The structure features characteristic elements like pointed arches, a white dome, and ornate minarets. The architecture shows both Gothic and Islamic influences, with detailed stonework and a series of arched colonnade walkways.

The courtyard appears to be a gathering space, with several people sitting in the shaded areas along the walls and a few figures standing in the open courtyard. The building's white-washed walls and stone flooring are typical of Indo-Islamic architecture, and the composition captures the interplay of light and shadow across the architectural elements.

The photograph appears to be from the colonial period in India, likely late 19th or early 20th century, given the photographic style and quality. It provides a valuable historical record of both the architectural details and the daily use of this religious space.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a courtyard with a large building on the left and a row of arches on the right. The building has a dome-shaped roof and a tall tower with a pointed top. The courtyard is paved with stone and has several people sitting and standing around it. The sky is overcast.

The image appears to be an old photograph, possibly from the early 20th century. It shows a traditional Indian courtyard with a mix of architectural styles, including Islamic and Hindu influences. The presence of people in the courtyard suggests that it may be a public space or a gathering place for the community.

Overall, the image provides a glimpse into the architectural and cultural heritage of India during the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a large, open courtyard with a white building in the background. The courtyard is surrounded by a low wall with arches, and there are several people standing or sitting around the area. In the foreground, there is a large, ornate building with a dome on top, which appears to be a mosque or other religious structure. The sky above is overcast, giving the scene a somber and contemplative atmosphere. Overall, the image suggests a sense of tranquility and reverence, and may be intended to evoke feelings of spirituality or cultural heritage.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of a courtyard of a mosque. The mosque is large and has a dome on top, with several arched windows and doors. The courtyard is surrounded by a series of arches, and there are several people sitting on the ground in the foreground. In the distance, there is a large tree and a building with a dome on top. The image has a vintage look, suggesting that it was taken many years ago.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a vintage black-and-white photograph of an architectural structure, likely a mosque. The mosque features a dome-shaped roof, a tall tower, and a series of arched windows. The structure is surrounded by a courtyard with a paved floor. There are people sitting on the steps of the mosque, and some are standing in front of it. The image has a vintage look, with a slightly faded and grainy texture.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

The image shows a courtyard scene, likely in a historical or religious setting, given the architectural style. The photo is in sepia tone, suggesting it is an older photograph.

In the foreground and to the left, we see a portion of a building. The architecture features arched doorways and windows, and decorative molding along the roofline. The building casts a long shadow across the courtyard.

A group of people are gathered near the base of the building, some seated and others standing. The figures in the group are dressed in clothing that seems traditional, possibly indicating that this is a historical image.

In the background, there is a building with a white dome. There are also some visible minarets on the corners of the building. An arcade runs along the front of the building, with arched openings supported by columns. A large tree can be seen behind the building.

The courtyard itself appears to be paved, with some stones or other architectural elements scattered around.

Created by gemini-2.0-flash-lite on 2025-05-17

This is a sepia-toned photograph of a large, white-washed mosque or religious complex. The architecture is ornate, with arched doorways, domes, and minarets. The photo appears to be taken on a bright day, as shadows are cast across the courtyard. A group of people, dressed in traditional clothing, are gathered in the courtyard. Some are seated, while others are standing and appearing to converse. The scene is serene and suggestive of a place of worship or community gathering.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts an old, sepia-toned photograph of a historical architectural site, likely a mosque or a similar religious building. The structure showcases traditional Islamic architectural elements, including arched doorways and windows, as well as a large dome with a finial on top. The building appears to be made of stone or plaster, with intricate designs and patterns adorning the walls and arches.

In the foreground, there is a courtyard where several people are gathered. Some individuals are sitting on the ground, while others are standing or walking. The people are dressed in traditional attire, suggesting that the photograph was taken in a historical period. The overall atmosphere of the image conveys a sense of daily life and community within the premises of this religious or cultural site. The sky above is clear, indicating a sunny day, which casts shadows and highlights the architectural details of the building.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-30

This is a black-and-white photograph depicting a courtyard scene, likely from a historical or colonial-era setting. The architecture features ornate elements such as domes, arches, and minarets, which are reminiscent of Mughal or Islamic design styles. The courtyard is open and expansive, with a large central dome surrounded by a gallery with multiple arches. There are several people in the courtyard, some standing and some sitting on the steps of the gallery. The individuals are dressed in what appears to be traditional attire, suggesting the photo was taken in a region with cultural influences from the Indian subcontinent. The overall setting and the style of the photograph suggest it could be from the late 19th or early 20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-30

This is a historic black-and-white photograph of an architectural scene featuring a courtyard of a grand building, likely a mosque or a mausoleum with Islamic architectural influences. The architecture includes intricate arches, domes, and minarets. The central dome is prominent with a finial on top, surrounded by smaller domes and minarets on either side. The building has multiple arched openings and decorative moldings. In the foreground, several people are seated on the steps and in the courtyard, dressed in traditional attire. The scene appears to be bustling with activity, and the photograph captures the essence of the cultural and historical significance of the location. The style of the photograph suggests it was taken in the late 19th or early 20th century.