Advancing Urban Renewal: An Automated Approach to Generating Historical Arcade Facades with Stable Diffusion Models

Zheyuan Kuang,Jiaxin Zhang,Yiying Huang,Yunqin Li

2023-11-20

Abstract:Urban renewal and transformation processes necessitate the preservation of the historical urban fabric, particularly in districts known for their architectural and historical significance. These regions, with their diverse architectural styles, have traditionally required extensive preliminary research, often leading to subjective results. However, the advent of machine learning models has opened up new avenues for generating building facade images. Despite this, creating high-quality images for historical district renovations remains challenging, due to the complexity and diversity inherent in such districts. In response to these challenges, our study introduces a new methodology for automatically generating images of historical arcade facades, utilizing Stable Diffusion models conditioned on textual descriptions. By classifying and tagging a variety of arcade styles, we have constructed several realistic arcade facade image datasets. We trained multiple low-rank adaptation (LoRA) models to control the stylistic aspects of the generated images, supplemented by ControlNet models for improved precision and authenticity. Our approach has demonstrated high levels of precision, authenticity, and diversity in the generated images, showing promising potential for real-world urban renewal projects. This new methodology offers a more efficient and accurate alternative to conventional design processes in urban renewal, bypassing issues of unconvincing image details, lack of precision, and limited stylistic variety. Future research could focus on integrating this two-dimensional image generation with three-dimensional modeling techniques, providing a more comprehensive solution for renovating architectural facades in historical districts.

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

The paper attempts to address the problem of how to efficiently and accurately generate facade images of historical buildings, particularly arcade buildings, during urban renewal and renovation processes. Traditional methods face numerous challenges when dealing with such projects, including insufficient detail precision and limited style diversity. These issues lead to repetitive work and subjective results in the design process. To solve these problems, the authors propose a new method that utilizes the Stable Diffusion model combined with text descriptions to automatically generate high-quality facade images of historical buildings. This method can improve the accuracy, realism, and diversity of the generated images, thereby providing more efficient and accurate design tools for urban renewal projects.

Specifically, the study aims to:
1. **Improve the quality of generated images**: By using the Stable Diffusion model, ensure that the generated building facade images have high resolution, rich details, and conform to historical styles.
2. **Enhance style diversity**: By training multiple Low-Rank Adaptation (LoRA) models, control the style features of the generated images, and increase style diversity.
3. **Increase controllability**: Introduce the ControlNet model to make the generated images more in line with design requirements, improving the controllability and accuracy of the images.
4. **Optimize the design process**: Provide architects with an efficient tool to reduce repetitive work in the design process and accelerate the design cycle.

In summary, the goal of this study is to provide a new, more efficient design method for urban renewal and historical building preservation through advanced machine learning techniques.