Human Generated Data

Title

Untitled (Hong Kong or Japan)

Date

March 3, 1960-April 22, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5496

Human Generated Data

Title

Untitled (Hong Kong or Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-April 22, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5496

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clarifai
created on 2018-05-10

expression 98.9
building 98.3
scaffolding 98.1
architecture 97.1
city 96.2
construction 95.8
urban 95.5
modern 93.6
no person 93.4
industry 93.3
office 93.1
business 92.2
technology 91.8
steel 89.5
blueprint 89
concrete 88.7
window 87.4
people 86
glass items 83.6
crane 82.5

Imagga
created on 2023-10-06

billboard 75.8
structure 70.2
signboard 63
building 36
sketch 31.2
construction 29.1
architecture 25.3
urban 24.5
drawing 24.4
sky 23.6
tower 23.3
city 22.5
wire 22.2
steel 21.4
power 21
electricity 20.8
industry 20.5
industrial 20
electric 19.7
shopping cart 18.1
line 18
cable 17.6
station 17.5
high 17.3
metal 16.9
representation 15.8
greenhouse 15.6
wheeled vehicle 15.1
handcart 14.5
modern 14
electrical 13.4
wall 12.9
voltage 12.7
technology 12.6
glass 12.5
house 11.7
energy 10.9
skyscraper 10.7
travel 10.6
new 10.5
business 10.3
winter 10.2
window 10.1
cables 9.8
skyline 9.5
iron 9.3
street 9.2
outdoor 9.2
frame 9.2
equipment 9.1
road 9
landscape 8.9
river 8.9
supply 8.7
scene 8.7
snow 8.6
development 8.6
transport 8.2
lines 8.1
light 8
night 8
district 7.8
downtown 7.7
concrete 7.7
engineering 7.6
container 7.6
outdoors 7.5
silhouette 7.5
town 7.4
design 7.3
reflection 7.3
weather 7.2
transportation 7.2
interior 7.1
day 7.1
train 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 90.5

Color Analysis

Feature analysis

Amazon

Building

Clarifai

Tree
Building
Window

AWS Rekognition

Building 100%

Clarifai

Tree 95.9%

Clarifai

Tree 85.1%

Clarifai

Tree 55.5%

Clarifai

Tree 47.3%

Clarifai

Building 80.5%

Clarifai

Building 44.6%

Clarifai

Building 43.2%

Clarifai

Window 60.5%

Clarifai

Window 57.7%

Clarifai

Window 55.2%

Clarifai

Window 50.3%

Clarifai

Window 46%

Clarifai

Window 43.2%

Clarifai

Window 36.4%

Clarifai

Window 36.4%

Categories

Imagga
created on 2023-10-06

streetview architecture 85.7%
paintings art 13.4%

Captions

Microsoft
created by unknown on 2018-05-10

a large white building 83.5%
a large white building in the background 81.6%
a tall building 81.5%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a building with scaffiction of scaffolding on the side of the

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of a building under construction

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This black-and-white photograph depicts a building under construction surrounded by extensive scaffolding. The scaffolding, composed of a grid-like network of metal or wooden supports, envelops the structure, suggesting large-scale construction or renovation work. The building itself appears to have multiple stories, with visible windows and architectural details partially obscured by the scaffolding. In the foreground, there is a smaller building, possibly a temporary facility or an office related to the construction site, featuring rectangular windows and a flat roof. A streetlamp and leafless trees can be seen nearby, suggesting the photo was taken in a colder season. The overall image captures the industrial and developmental look of the construction process.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a construction site where a large building is under construction. The building is surrounded by extensive scaffolding structures, which indicates ongoing work. The scaffolding is made up of a network of metal bars forming a grid-like support system. In the foreground, there is a smaller building, likely a temporary structure related to the construction activities. This smaller building has a flat roof and several small windows. There are a few trees visible around the site, and a streetlight is present near the smaller building. The overall scene feels like an urban environment where construction is actively taking place. The photograph is in black and white, highlighting the contrast between the solid structures and the open frameworks of the scaffolding.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a large construction site with a complex scaffolding structure covering a building. The scaffolding appears to be made of metal beams and supports, creating a dense grid-like pattern across the entire structure. In the foreground, there is a smaller, single-story building visible. The overall scene has a black and white, industrial aesthetic, suggesting this is an older photograph capturing the construction process.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This black and white image shows a building under construction or renovation, with extensive scaffolding covering most of the structure. The scaffolding creates a complex geometric pattern of horizontal and vertical metal bars that dominates the upper portion of the image. Below the scaffolding, there appears to be a white or light-colored section of the building that's more complete or existing structure. The image has an industrial, architectural quality to it, showing the raw process of construction work. The contrast between the dense metal framework of the scaffolding and the solid building beneath creates an interesting visual composition.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black and white photograph of a large building under construction, with scaffolding covering the exterior.

The building is likely a commercial or industrial structure, given its size and the presence of scaffolding. The scaffolding is made of metal and consists of multiple levels of platforms and ladders, allowing workers to access different areas of the building. The building itself appears to be a large, rectangular structure with a flat roof.

In the foreground, there is a smaller building or structure that appears to be a separate entity from the main building. It has a flat roof and a single story, with several windows and a door. A tree is visible in front of the smaller building, adding some greenery to the otherwise industrial scene.

The background of the image shows a clear sky, suggesting that the photo was taken on a sunny day. Overall, the image provides a glimpse into the construction process of a large building, highlighting the complexity and scale of the project.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a large scaffolding structure, likely under construction. The scaffolding is made up of numerous metal beams and poles, arranged in a grid-like pattern to form a sturdy framework. It appears to be several stories high, with multiple levels of scaffolding visible.

In the foreground, there is a small building or shed with a flat roof, which seems to be connected to the scaffolding. The building has a few windows and a door, but it's difficult to make out any details due to the low resolution of the image.

To the left of the building, there are some trees visible, which suggests that the location may be in a rural or suburban area. The overall atmosphere of the image is one of construction and development, with the scaffolding dominating the scene and the building in the foreground appearing to be a supporting structure.

It's worth noting that the image is quite old-fashioned, with a grainy texture and a sepia tone that gives it a nostalgic feel. This could suggest that the image was taken many years ago, perhaps during a time when construction techniques were different from those used today. Overall, the image provides a fascinating glimpse into the past, offering a unique perspective on the construction process and the tools and techniques used during that era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph showing a construction site. The site is surrounded by scaffolding, which is made up of metal bars and beams. The scaffolding is very tall and extends up to the top of the building, which is under construction. There is a small tree in the foreground, and a streetlight is visible on the left side of the image. The building under construction appears to be a large structure with many windows.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a construction site. The construction site is surrounded by a large metal scaffolding, which is supported by steel beams and columns. The scaffolding appears to be in the process of being constructed, as some of the beams and columns are still being installed. The scaffolding is surrounded by a fence, which is made of metal bars and is supported by wooden posts. There are also some trees and a street light in the foreground of the image.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

Here's a description of the image:

The image is a black and white photograph capturing a scene of construction or renovation. A large, multi-story building is almost entirely obscured by a complex scaffolding structure. The scaffolding is a dense network of horizontal and vertical beams, creating a gridded effect against the building behind it.

In the foreground, a single-story building stands with a minimalist design. It has a flat roof and a row of windows. The building is elevated slightly, supported by what appear to be concrete or wooden pillars. A bare tree stands to the side of this building, its branches reaching upward.

The contrast between the solid building and the intricate scaffolding, along with the bare tree, suggests a transitional moment, possibly of urban change or development. The overall composition is somewhat industrial and evokes a sense of density and complexity.

Created by gemini-2.0-flash-lite on 2025-06-03

Here's a description of the image:

The photograph captures a large-scale construction scene, presented in black and white, likely from an older era. The focal point is a massive scaffolding structure that envelops a building, indicating ongoing renovation or construction. The scaffolding is a dense grid of horizontal and vertical beams, reaching up and across the building's facade, dwarfing everything around it.

In the foreground, a small, low-rise building sits to the left. It features a simple design with a flat roof, supported by stilts or posts. Several windows are visible, and a small tree is placed in front of the building. A lamp post stands nearby. To the right of the foreground building, other structures are barely visible. The composition gives a sense of scale and emphasizes the enormity of the scaffolding and the project it supports.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a large building under construction, heavily covered with scaffolding. The scaffolding appears to be extensive, covering the entire facade of the building, indicating a significant amount of work being done, possibly involving the exterior walls or structural elements.

In the foreground, there are some smaller structures, including a small building with a sloped roof, possibly a temporary office or storage facility for the construction site. There are also some trees and lamp posts visible, suggesting that the construction site is in an urban or semi-urban area.

The image is in black and white, which might suggest it is an older photograph. The overall scene conveys a sense of a large-scale construction project in progress.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image appears to depict a construction site. The foreground shows a small, single-story building with a flat roof and some windows, partially obscured by a dense structure of scaffolding. The scaffolding is extensive and complex, with a grid-like pattern that covers a significant portion of the building behind it, suggesting that the construction of a larger structure is underway. The scaffolding is made of metal and includes ladders, platforms, and supporting poles. The overall scene is in black and white, giving it a historical or documentary feel. The surrounding area includes some trees and a few other structures, indicating an urban or suburban setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white image shows a building under construction or renovation, covered with extensive scaffolding. The scaffolding is made up of metal poles and crossbars, creating a dense grid-like structure that covers the entire facade of the building. In the foreground, there is a smaller, two-story building with a sign on the left side. The building appears to be older and has a more traditional architectural style compared to the modern scaffolding. There are also a few leafless trees in front of the building. The sky is visible in the background, but the image is mostly focused on the construction site.

Text analysis

Amazon

PREPA