Human Generated Data

Title

Industrial Problems, Coöperation: Italy. Milan. Coöperative Stores: Coöperative Societies, Italy: Unione Cooperativa, Milano.: New Palace bought and converted to commercial uses. Offices, library, committee-rooms on top floor.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2116.2

Human Generated Data

Title

Industrial Problems, Coöperation: Italy. Milan. Coöperative Stores: Coöperative Societies, Italy: Unione Cooperativa, Milano.: New Palace bought and converted to commercial uses. Offices, library, committee-rooms on top floor.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2116.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Advertisement 99.3
Drawing 97.4
Human 97.4
Art 97.4
Sketch 91.3
Text 67.4
Building 66.2
Steeple 63.3
Architecture 63.3
Tower 63.3
Spire 63.3
Housing 63.1
Urban 62

Clarifai
created on 2019-06-06

art 97.2
architecture 96.9
building 96
old 94.8
vintage 94.5
retro 93.8
travel 93.3
print 92.6
ancient 92.5
no person 92.3
city 89.9
antique 86.9
illustration 86.9
outdoors 84.7
landmark 82.7
administration 82.6
tourism 82.5
historic 82.1
house 81.9
monument 81.6

Imagga
created on 2019-06-06

palace 100
building 74.9
residence 67.7
architecture 64.5
house 50.4
landmark 37.1
dwelling 36.4
travel 36
city 31.7
tourism 31.4
ancient 31.2
facade 30.9
history 30.5
structure 30.1
historic 29.4
monument 26.2
old 25.8
famous 23.3
culture 22.3
sky 21.7
treasury 21.6
historical 20.7
tourist 19.1
stone 18.7
exterior 18.5
depository 17.7
tower 16.1
town 15.8
housing 15.4
temple 15.3
castle 14.6
fortress 14.1
place 14
facility 13.8
square 13.6
column 12.7
royal 12.6
scenic 12.3
roman 12.3
vintage 11.6
night 11.6
university 11.2
church 11.1
vacation 10.7
architectural 10.6
attraction 10.5
classical 10.5
urban 10.5
wall 10.4
cityscape 10.4
water 10
art 9.8
statue 9.7
marble 9.7
artistic 9.6
england 9.5
capital 9.5
brick 9.4
flag 9.4
cathedral 9.2
outdoors 9
columns 8.8
dome 8.8
antique 8.8
saint 8.7
medieval 8.6
construction 8.6
aged 8.2
scenery 8.1
religion 8.1
amphitheater 7.9
parliament 7.9
arch 7.8
government 7.8
king 7.8
museum 7.8
heritage 7.7
old fashioned 7.6
buildings 7.6
destination 7.5
landscape 7.5
street 7.4
national 7.3
river 7.1

Google
created on 2019-06-06

Text 90.8
Architecture 76.3
Building 73.5
History 72.6
Font 68.6
Collection 65.4
Paper product 65.2
Facade 59.4
Paper 57
Illustration 54.5

Microsoft
created on 2019-06-06

old 83.3
building 60.7

Color Analysis

Feature analysis

Amazon

Poster
Person

Clarifai

Building

AWS Rekognition

Poster 99.3%

AWS Rekognition

Person 91.2%

AWS Rekognition

Person 88.4%

AWS Rekognition

Person 85.2%

AWS Rekognition

Person 76%

AWS Rekognition

Person 69.1%

AWS Rekognition

Person 68.9%

AWS Rekognition

Person 65.7%

Clarifai

Building 97.9%

Clarifai

Building 35.5%

Categories

Imagga
created on 2019-06-06

streetview architecture 99.3%

Captions

Microsoft
created by unknown on 2019-06-06

a close up of an old building 75.7%
a close up of a building 75.6%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

an old postcard of a building with a large sign

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a picture of a building with a lot of people standing around it

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image is a sepia-toned photograph of a large, classical-style building with three stories. The architecture features symmetrical designs, multiple arched windows on all levels, and a central entrance with columns. The building appears expansive and prominent, suggesting its previous significance as a "New Palace." People can be seen scattered in front of the structure, providing a sense of scale and activity. Below the image, there is a caption: "New Palace bought and converted to commercial uses. Offices, library, committee-rooms on top floor," indicating that the building has been repurposed for practical purposes rather than its original intent.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a sepia-toned photograph of a large, ornate building with a classical architectural style. The building appears to be three stories tall and has a symmetrical facade with evenly spaced windows and decorative elements. There are several people walking or standing in front of the building, suggesting it is a populated area. Below the image is a typed note that reads: "New Palace bought and converted to commercial uses. Offices, library, committee rooms on top floor." This text provides context about the building's current function as a commercial space with various facilities on its top floor.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a large, multi-story building with an ornate facade. The building appears to be a palace or government building, with numerous arched windows and decorative architectural elements. There are people visible in the foreground, suggesting this is a public or commercial space. The caption below the image indicates that this "New Palace" was purchased and converted for commercial uses, including offices, a library, and committee rooms on the top floor.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a historical black and white photograph showing the New Palace building after it was converted for commercial use. The architecture features a grand three-story structure with repetitive arched windows and classical design elements typical of 19th century institutional buildings. The facade shows a symmetrical arrangement with rows of windows on each floor and what appears to be a ground floor with larger openings, likely for shops or businesses. Some people can be seen as small figures on the street level. According to the caption, the top floor contained offices, a library, and committee rooms after its conversion. The building has an imposing presence and represents a good example of how historic palatial buildings were adapted for modern commercial purposes.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image depicts a vintage photograph of a large, multi-story building with a flat roof and numerous windows. The building appears to be constructed from stone or brick, featuring arched doorways and windows on the ground floor. People are visible in front of the building, suggesting it may have been a public or commercial space.

Below the photograph, a typed caption reads: "New Palace bought and converted to commercial uses. Offices, library, committee-rooms on top floor." This caption provides context for the building's history and purpose.

The image is presented on a gray background, which helps to highlight the details of the photograph and caption. Overall, the image offers a glimpse into the past, showcasing a historic building that has been repurposed for commercial use.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image is a sepia-toned photograph of a large building with a caption below it. The building has three stories, with many windows and archways. People are standing in front of the building, and the sky above is light-colored.

The caption reads: "New Palace bought and converted to commercial uses. Offices, library, committee-rooms on top floor."

The image appears to be an old photograph of a building that has been converted from a palace to commercial use. The building's architecture suggests it may have been built in the 19th or early 20th century. The caption provides information about the building's history and its current use.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The image is a vintage photograph of a large building with multiple windows and a flat roof. The building has a symmetrical design, with a central entrance and a series of arched windows on each floor. The photograph is mounted on a gray background, and there is a label at the bottom of the image that reads "New Palace bought and converted to commercial uses. Offices, library, committee rooms on top floor." The image has a sepia tone, which gives it a vintage look.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image depicts a historical photograph of a grand building, likely a palace, with a sepia tone that gives it an antique appearance. The building has a symmetrical design with multiple arched windows and doors, showcasing classical architectural elements. The facade features a series of columns and pediments, indicating its classical style. The text overlay on the image reads, "New Palace bought and converted to commercial uses. Offices, library, committee rooms on top floor." This suggests that the building has been repurposed for modern commercial use, housing offices, a library, and committee rooms. The photograph also shows a few people walking around the building, suggesting it is a public area with some activity.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

The image is an old sepia-toned photograph depicting a large, multi-story building. It appears to be a palace that has been repurposed for commercial use. The building has a classical architectural style, with numerous windows and a symmetrical facade. There are people milling around in front of the building, suggesting an urban setting.

Below the photograph, there is a white rectangle with text printed on it. The text provides information about the building, stating that it was the "New Palace" and was converted to commercial uses. The text specifies that offices, a library, and committee rooms are located on the top floor.

Created by gemini-2.0-flash on 2025-05-02

Here's a description of the image:

The image shows a black and white photograph of a large, ornate building. The building has three floors, each with a row of arched windows. There are columns and detailed trim work along the facade. People can be seen walking in front of the building on the ground level.

Below the photograph is a typewritten caption that reads: "New Palace bought and converted to commercial uses. Offices, library, committee rooms on top floor."

The photograph and caption are affixed to a gray card or paper backing. The overall impression is that of an archival or historical document.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image depicts a historical building, labeled as the "New Palace," which has been repurposed for commercial uses. The architectural style is classical, featuring a symmetrical facade with multiple stories. The building has a series of uniformly spaced windows and arched doorways on the ground floor, suggesting a design typical of public or governmental buildings.

The accompanying text provides additional context: "New Palace bought and converted to commercial uses. Offices, library, committee-rooms on top floor." This indicates that the building was originally a palace but has been adapted to serve various commercial functions. Specifically, it now houses offices, a library, and committee rooms, with the committee rooms located on the top floor.

The illustration shows several people walking in front of the building, giving a sense of scale and activity. The overall appearance is formal and grand, reflecting its original purpose as a palace.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image shows an old black-and-white photograph of a large, multi-story building with a symmetrical design. The structure appears to be a palace or a grand building, characterized by its numerous windows and arched doorways on the ground floor. The upper floors have a series of evenly spaced windows, and the roofline is flat. In front of the building, there is a spacious area with some people and a few horses, suggesting that the photo might have been taken in the late 19th or early 20th century. The sidewalk in front of the building is visible with a few pedestrians. The image has a vintage feel, and the text below the photograph indicates that the building was "bought and converted to commercial uses," with "offices, library, committee rooms on top floor."

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This is a sepia-toned photograph of a large, multi-story building with classical architectural features, such as arched windows and doors, decorative molding, and a flat roof. The building appears to be a significant structure, possibly a palace or government building, given its grand design and size.

In the foreground, there are several people standing and walking along the sidewalk in front of the building. The scene suggests a bustling urban environment.

Below the photograph, there is a caption that reads: "New Palace bought and converted to commercial uses. Offices, library, committee rooms on top floor." This indicates that the building has been repurposed for various commercial and administrative functions.

Text analysis

Amazon

cial
bought
converted
library,
commer
to
rooms
New
New Palace bought and converted to commer
Palace
floor.
and
commi
rooms on top floor.
offices,
cial uses. offices, library, commi ttee-
uses.
top
on
ttee-
n
n Ll
Ll

Google

New Palace bought and converted to commer- cial uses. Offices, library, committee- rooms on top floor.
New
Palace
bought
and
converted
to
commer-
cial
uses.
Offices,
library,
committee-
rooms
on
top
floor.