Procedural modeling of urban environments for digital games development

Pedro Brandão Silva,António Coelho

DOI: https://doi.org/10.1145/1971630.1971667

2010-01-01

Abstract:This paper describes a procedural modeling methodology for urban environments, capable of reproducing real-world structures based on geographical information, operating on a spatial database engine, with applications in the field of digital gaming.

What problem does this paper attempt to address?

Procedural Modeling of Urban Zone by Optimization

Liying Wang,Wei Hua,Hujun Bao

DOI: https://doi.org/10.1002/cav.229

IF: 1.01

2008-01-01

Computer Animation and Virtual Worlds

Abstract:Procedural modeling technology may be applied for constructing a large-scale urban scene. Most of the previous studies have exploited a grammar-based modeling method to generate models. Nevertheless, we formulate the urban planning as a constrained layout optimization problem, propose an algorithm to solve the problem, and procedurally generate models of the urban zone. It produces an extensive urban virtual environment for computer games and simulations at low cost. We optimize a cost function to distribute buildings and roads subject to some urban planning constraints. We employ particle swarm optimization and two-step path planning to find the optimal solution, which is further interpreted as the 2D blueprint of the urban zone. During the optimization, we adopt the spatial pattern tree structure to reduce the combinational search space greatly. 3D city models in large scale are then assembled according to the 2D blueprints. Experimental results prove that our method can efficiently produce the virtual urban scene similar to that designed by urban planners. Copyright © 2008 John Wiley & Sons, Ltd.
Improving Procedural Modeling with Semantics in Digital Architectural Heritage.

Liu Yong,Zhang Mingmin,Jiang Yunliang,Zhao Haiying

DOI: https://doi.org/10.1016/j.cag.2012.01.003

IF: 1.821

2012-01-01

Computers & Graphics

Abstract:We first introduce three challenges in the procedural modeling of digital architectural heritages and then present a general framework, which integrates several machine intelligence and semantic techniques, e.g., the ontology design approach, pattern mining, auto-annotating and rule reduction, to improve the procedural methods in architectural modeling. Several evaluations and experiments are also presented. The experimental results illustrate the improvements following our approach.
Procedural urban environments for FPS games

Jan Kruse,Ricardo Sosa,Andy M. Connor

DOI: https://doi.org/10.1145/2843043.2843479

2016-04-20

Abstract:This paper presents a novel approach to procedural generation of urban maps for First Person Shooter (FPS) games. A multi-agent evolutionary system is employed to place streets, buildings and other items inside the Unity3D game engine, resulting in playable video game levels. A computational agent is trained using machine learning techniques to capture the intent of the game designer as part of the multi-agent system, and to enable a semi-automated aesthetic selection for the underlying genetic algorithm.

Artificial Intelligence,Human-Computer Interaction,Neural and Evolutionary Computing
Procedural Planetary Multi-resolution Terrain Generation for Games

Ricardo B. D. d'Oliveira,Antonio L. Apolinário,Antonio L. Apolinário Jr

DOI: https://doi.org/10.48550/arXiv.1803.04612

2018-03-13

Graphics

Abstract:Terrains are the main part of an electronic game. To reduce human effort on game development, procedural techniques are used to generate synthetic terrains. However rendering a terrain is not a trivial task. Their rendering techniques must be optimal for gaming. Specially planetary terrains, which must account for precision and scale conversion. Multi-resolution models are best fit to planetary terrains. An observer can change his point of view without noticing any decrease in visual quality. There are several proposals regarding real-time terrain rendering with multi-resolution models, and there are game engines capable of generating large scale terrains with fixed resolution. However for the best of our knowledge, it was noticed that there are no techniques which combine both aspects. In this paper we present a new technique capable of generating large-scale multi-resolution terrains, whichcan be rendered and viewed at different scales. Rendering large scale models with high definition and low scale areas with finer details added with the aid of procedural content generation.
Procedural Modeling Of Residential Zone Subject To Urban Planning Constraints

Liying Wang,Wei Hua,Hujun Bao

DOI: https://doi.org/10.1007/978-3-540-74873-1_19

2007-01-01

Abstract:Besides spatial elements, their spatial configuration is an important factor affecting urban image. In practice of urban planning, good designers do thoroughly consider goals of urban design and constraints of urban planning. In this paper taking the layout problems of a residential zone as background, a framework of procedural modeling and a constrained layout optimization approach is presented to simulate the design procedure of human. The approach represents design goals as cost function subject to planning constraints. We can obtain the design plan by minimizing the objective function. During optimization, we adopt heuristic algorithm to get solutions efficiently for elements layout. Experiments show this approach is able to achieve similar design of residential zone to human work, by using less human resources.
Procedural Urban Forestry

Till Niese,Sören Pirk,Matthias Albrecht,Bedrich Benes,Oliver Deussen

DOI: https://doi.org/10.48550/arXiv.2008.05567

2020-08-14

Abstract:The placement of vegetation plays a central role in the realism of virtual scenes. We introduce procedural placement models (PPMs) for vegetation in urban layouts. PPMs are environmentally sensitive to city geometry and allow identifying plausible plant positions based on structural and functional zones in an urban layout. PPMs can either be directly used by defining their parameters or can be learned from satellite images and land register data. Together with approaches for generating buildings and trees, this allows us to populate urban landscapes with complex 3D vegetation. The effectiveness of our framework is shown through examples of large-scale city scenes and close-ups of individually grown tree models; we also validate it by a perceptual user study.

Graphics,Computer Vision and Pattern Recognition,Machine Learning
3D-GIS Parametric Modelling for Virtual Urban Simulation Using CityEngine

Ibrahim M. Badwi,Hisham M. Ellaithy,Hidi E. Youssef

DOI: https://doi.org/10.1080/19475683.2022.2037019

2022-03-03

Annals of GIS

Abstract:Modelling and visualization of three-dimensional (3D) models for cities is a great challenge for computer software and graphics. Recently, 3D city modelling has grown due to advances in applications accompanying the information technology revolution. 3D Geographic Information Systems (3D-GIS) have evolved enormously due to the availability of large-scale 3D modelling techniques. These technologies have become very important in representing large cities and conducting various analyses in the city's virtual environment to support urban decision-making. CityEngine is one of the most recent 3D-GIS modelling applications. CityEngine can be described as parametric modelling using Procedural Modelling (PM) to create 3D urban elements through macros and routines. This paper highlights the importance of 3D Procedural Modelling (PM) of cities in the GIS environment using ESRI CityEngine and presents a parametric concept for designing urban spaces. This issue has been addressed in three respects. First, discuss the concept and strength of parametric design. Second, the concept of procedural modelling and its power to generate complex 3D models using a set of rules is discussed. Finally, CityEngine was evaluated through a real-world case study of a neighbourhood in the new city of Beni-Suef, Egypt. The results confirm the effectiveness of CityEngine as a 3D-GIS modelling software that generates dynamic 3D models from 2D spatial data. While the results are promising, it is important to investigate more complex cases. The CityEngine modelling approach enables comprehensive urban analyses such as sequence vision, façade studies, urban fabric and character, and statistical operations based on attribute database.
Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussians

Yixuan Li,Xingjian Ran,Linning Xu,Tao Lu,Mulin Yu,Zhenzhi Wang,Yuanbo Xiangli,Dahua Lin,Bo Dai

2024-12-11

Abstract:Buildings are primary components of cities, often featuring repeated elements such as windows and doors. Traditional 3D building asset creation is labor-intensive and requires specialized skills to develop design rules. Recent generative models for building creation often overlook these patterns, leading to low visual fidelity and limited scalability. Drawing inspiration from procedural modeling techniques used in the gaming and visual effects industry, our method, Proc-GS, integrates procedural code into the 3D Gaussian Splatting (3D-GS) framework, leveraging their advantages in high-fidelity rendering and efficient asset management from both worlds. By manipulating procedural code, we can streamline this process and generate an infinite variety of buildings. This integration significantly reduces model size by utilizing shared foundational assets, enabling scalable generation with precise control over building assembly. We showcase the potential for expansive cityscape generation while maintaining high rendering fidelity and precise control on both real and synthetic cases.

Computer Vision and Pattern Recognition
Procedural Crowd Generation for Semantically Augmented Virtual Cities

O. Rogla,N. Pelechano,G. Patow

DOI: https://doi.org/10.48550/arXiv.1811.10036

2018-11-25

Abstract:Authoring realistic behaviors to populate a large virtual city can be a cumbersome, time-consuming and error-prone task. Believable crowds require the effort of storytellers and programming experts working together for long periods of time. In this work, we present a new framework to allow users to generate populated environments in an easier and faster way, by relying on the use of procedural techniques. Our framework consists of the procedural generation of semantically-augmented virtual cities to drive the procedural generation and simulation of crowds. The main novelty lies in the generation of agendas for each individual inhabitant (alone or as part of a family) by using a rule-based grammar that combines city semantics with the autonomous persons' characteristics. Real-world data can be used to accommodate the generation of a virtual population, thus enabling the recreation of more realistic scenarios. Users can author a new population or city by editing rule files with the flexibility of re-using, combining or extending the rules of previous populations. The results show how logical and consistent behaviors can be easily generated for a large crowd providing a good starting point to bring virtual cities to life.

Graphics
On procedural urban digital twin generation and visualization of large scale data

Sanjay Somanath,Vasilis Naserentin,Orfeas Eleftheriou,Daniel Sjölie,Beata Stahre Wästberg,Anders Logg

DOI: https://doi.org/10.48550/arXiv.2305.02242

2023-05-03

Graphics

Abstract:The desired outcome for urban digital twins is an automatically generated detailed 3D model of a building from aerial imagery, footprints, LiDAR, or a fusion of these. Such 3D models have applications in architecture, civil engineering, urban planning, construction, real estate, GIS, and many others. Further, the visualization of large-scale data in conjunction with the generated 3D models is often a recurring and resource-intensive task. However, a completely automated end-to-end workflow is complex, requiring many steps to achieve a high-quality visualization. Methods for building reconstruction approaches have come a long way from previously manual approaches to semi-automatic or automatic approaches. The next step after reconstructing buildings is visualizing the buildings and their context. Advances in real-time rendering using game engines have enabled the extension of building reconstruction methods to procedurally generated context generation. This paper aims to complement existing methods of 3D building generation. First, we present a literature review covering different options for procedurally generated context generation and visualization methods in-depth, focusing on workflows and data pipelines. Next, we present a semi-automated workflow that extends the building reconstruction pipeline to include procedural context generation (terrain and vegetation) using Unreal Engine and, finally, the integration of various types of large-scale urban analysis data for visualization. We conclude with a series of challenges faced in achieving such pipelines and the limitations of the current approach. The steps for a complete, end-to-end solution involve developing robust systems for building detection, rooftop recognition, and geometry generation and importing and visualizing data in the same 3D environment.
Guided Proceduralization: Optimizing Geometry Processing and Grammar Extraction for Architectural Models

Ilke Demir,Daniel G. Aliaga

DOI: https://doi.org/10.1016/j.cag.2018.05.013

2018-07-07

Abstract:We describe a guided proceduralization framework that optimizes geometry processing on architectural input models to extract target grammars. We aim to provide efficient artistic workflows by creating procedural representations from existing 3D models, where the procedural expressiveness is controlled by the user. Architectural reconstruction and modeling tasks have been handled as either time consuming manual processes or procedural generation with difficult control and artistic influence. We bridge the gap between creation and generation by converting existing manually modeled architecture to procedurally editable parametrized models, and carrying the guidance to procedural domain by letting the user define the target procedural representation. Additionally, we propose various applications of such procedural representations, including guided completion of point cloud models, controllable 3D city modeling, and other benefits of procedural modeling.

Graphics,Computer Vision and Pattern Recognition
Towards Urban Digital Twins: A Workflow for Procedural Visualization Using Geospatial Data

Sanjay Somanath,Vasilis Naserentin,Orfeas Eleftheriou,Daniel Sjölie,Beata Stahre Wästberg,Anders Logg

DOI: https://doi.org/10.3390/rs16111939

IF: 5

2024-05-28

Remote Sensing

Abstract:A key feature for urban digital twins (DTs) is an automatically generated detailed 3D representation of the built and unbuilt environment from aerial imagery, footprints, LiDAR, or a fusion of these. Such 3D models have applications in architecture, civil engineering, urban planning, construction, real estate, Geographical Information Systems (GIS), and many other areas. While the visualization of large-scale data in conjunction with the generated 3D models is often a recurring and resource-intensive task, an automated workflow is complex, requiring many steps to achieve a high-quality visualization. Methods for building reconstruction approaches have come a long way, from previously manual approaches to semi-automatic or automatic approaches. This paper aims to complement existing methods of 3D building generation. First, we present a literature review covering different options for procedural context generation and visualization methods, focusing on workflows and data pipelines. Next, we present a semi-automated workflow that extends the building reconstruction pipeline to include procedural context generation using Python and Unreal Engine. Finally, we propose a workflow for integrating various types of large-scale urban analysis data for visualization. We conclude with a series of challenges faced in achieving such pipelines and the limitations of the current approach. However, the steps for a complete, end-to-end solution involve further developing robust systems for building detection, rooftop recognition, and geometry generation and importing and visualizing data in the same 3D environment, highlighting a need for further research and development in this field.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Survey and practice of 3d city modeling

Liying Wang,Wei Hua

DOI: https://doi.org/10.1007/11736639_102

2006-01-01

Abstract:3D city modeling is an interesting subject that attracts both computer aided design and computer graphics communities. This paper surveys the recent development of 3D city modeling techniques for either real or virtual city. Some typical approaches and fundamenta1 principles behind them are also analyzed and compared. Finally we introduce a rule-driven procedure modeling approach for large-scale virtual city. Comparing with the existing approaches, the rules adopted by the proposed approach and based on urban planning principles are easy to be understood and customized. Our experiments proved the system is effective and efficient.
Procedural Modeling in Urban Digital Twins as a Tool for Visualization, Analysis, and Public Engagement: Examining a Housing Policy in California

Amir Hajrasouliha,Dave Amos

DOI: https://doi.org/10.1177/0739456x241269040

2024-08-26

Journal of Planning Education and Research

Abstract:Journal of Planning Education and Research, Ahead of Print. This article showcases the versatility of procedural modeling techniques in urban planning beyond their traditional use in visualization, such as an analytical tool and potentially a public engagement tool. The study demonstrates the potential of a specific California housing development state policy, Senate Bill 9 (SB9), which authorizes certain property owners to divide their land into two lots and erect two residences on each. Results of a California city's parametric modeling indicate that procedural modeling can visualize the implications of land use regulation in an analytical and intelligible way to planning practitioners and the public.

urban studies,regional & urban planning
Cities in electronic games: how they present and impact real urban areas?

Haochen Shi,Yutong Li,Yi Kong,Yuhan Ji,Qiqi Liu,Hao Huang,Miaoxi Zhao

DOI: https://doi.org/10.1080/13467581.2024.2399688

IF: 0.904

2024-09-26

Journal of Asian Architecture and Building Engineering

Abstract:This study investigates the interactions between virtual cities in electronic (video) games and real urban environments, highlighting a significant gap in the literature regarding the influence of real cities on virtual counterparts and vice versa. Drawing on classical urban theories, it sets two primary objectives: to systematically review how real cities are represented in games and to explore the impacts of virtual cities on real urban areas. Through typological analysis, it identifies two pathways – form and function – through which real cities manifest in games, using specific cases like Cities: Skylines to illustrate these pathways. The principle for virtual city design is also outlined, with an emphasis on the "selection" and "subtraction" of real urban elements in designing processes. Additionally, it discusses how virtual cities impact urban tourism, fostering phenomena like anime pilgrimages, and urban planning, and enhancing public engagement in planning processes. Finally, this research contributes to some newly emerging theories such as Digital Twins by elucidating the interactive relationship between physical and virtual urban spaces.

construction & building technology
Image-Based Procedural Modeling of Facades

Pascal Mueller,Gang Zeng,Peter Wonka,Luc Van Gool

DOI: https://doi.org/10.1145/1275808.1276484

IF: 6.2

2007-01-01

ACM Transactions on Graphics

Abstract:This paper describes algorithms to automatically derive 3D models of high visual quality from single facade images of arbitrary resolutions. We combine the procedural modeling pipeline of shape grammars with image analysis to derive a meaningful hierarchical facade subdivision. Our system gives rise to three exciting applications: urban reconstruction based on low resolution oblique aerial imagery, reconstruction of facades based on higher resolution ground-based imagery, and the automatic derivation of shape grammar rules from facade images to build a rule base for procedural modeling technology.
Automating Built Heritage Modelling for the Integration into 3D City Models

Ali Aboohamzeh,Marco Avena,Antonia Spanò

DOI: https://doi.org/10.5194/isprs-archives-xlviii-4-w10-2024-5-2024

2024-05-31

Abstract:Abstract. The interest in studies on 3D city models has renewed over time thanks to technological innovations that concern the methods of data acquisition and automatic classification of unstructured point clouds, to model increasingly specialized geometric objects for the growing needs of urban transformation management. Managing geometric and semantic information in cognitive systems, based on standards, increasingly open to the inquiries, analyses, and predictions that today are necessary to implement for future assessments, can digitally twin reality. The problem focused on in this work is the modelling phase, which requires efficient automatisms to make the production phase of geometric objects more sustainable, whether they are then destined to become parametric features in a BIM/CIM environment or 3D geometric objects of a geodatabase.A comprehensive methodology for automating the generation of 3D meshes from point cloud data using Python code, with a focus on practical implementation is presented parallelly to evaluations regarding the generation of the geometric 3D contents of the urban environment representation, depending on whether or not it includes examples of architectural heritage (of all ages). Leveraging the Open3D library and NumPy, the methodology provides different experiences, tests, and related discussions in the field of architectural and urban 3D surface reconstruction and visualization. The paper outlines essential steps including data loading and preparation, meshing strategy selection, data processing using Poisson reconstruction, and mesh exportation and visualization. Additionally, a method for generating multiple Levels of Detail (LoD) meshes is introduced, enhancing the applicability of the approach for city modelling framework applications, including architectural elements of buildings. The presented Python code serves as a practical resource for implementing 3D mesh generation workflows seamlessly.
UrbanWorld: An Urban World Model for 3D City Generation

Yu Shang,Yuming Lin,Yu Zheng,Hangyu Fan,Jingtao Ding,Jie Feng,Jiansheng Chen,Li Tian,Yong Li

2024-10-22

Abstract:Cities, as the essential environment of human life, encompass diverse physical elements such as buildings, roads and vegetation, which continuously interact with dynamic entities like people and vehicles. Crafting realistic, interactive 3D urban environments is essential for nurturing AGI systems and constructing AI agents capable of perceiving, decision-making, and acting like humans in real-world environments. However, creating high-fidelity 3D urban environments usually entails extensive manual labor from designers, involving intricate detailing and representation of complex urban elements. Therefore, accomplishing this automatically remains a longstanding challenge. Toward this problem, we propose UrbanWorld, the first generative urban world model that can automatically create a customized, realistic and interactive 3D urban world with flexible control conditions. UrbanWorld incorporates four key stages in the generation pipeline: flexible 3D layout generation from OSM data or urban layout with semantic and height maps, urban scene design with Urban MLLM, controllable urban asset rendering via progressive 3D diffusion, and MLLM-assisted scene refinement. We conduct extensive quantitative analysis on five visual metrics, demonstrating that UrbanWorld achieves SOTA generation realism. Next, we provide qualitative results about the controllable generation capabilities of UrbanWorld using both textual and image-based prompts. Lastly, we verify the interactive nature of these environments by showcasing the agent perception and navigation within the created environments. We contribute UrbanWorld as an open-source tool available at <a class="link-external link-https" href="https://github.com/Urban-World/UrbanWorld" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Automatic 3D Building Model Generation from Airborne LiDAR Data and OpenStreetMap Using Procedural Modeling

Adam Vinković,Rexhep Nikçi,Bernarda Pinjatela,R. Zupan

DOI: https://doi.org/10.3390/info14070394

2023-07-11

Abstract:This research is primarily focused on utilizing available airborne LiDAR data and spatial data from the OpenStreetMap (OSM) database to generate 3D models of buildings for a large-scale urban area. The city center of Ljubljana, Slovenia, was selected for the study area due to data availability and diversity of building shapes, heights, and functions, which presented a challenge for the automated generation of 3D models. To extract building heights, a range of data sources were utilized, including OSM attribute data, as well as georeferenced and classified point clouds and a digital elevation model (DEM) obtained from openly available LiDAR survey data of the Slovenian Environment Agency. A digital surface model (DSM) and digital terrain model (DTM) were derived from the processed LiDAR data. Building outlines and attributes were extracted from OSM and processed using QGIS. Spatial coverage of OSM data for buildings in the study area is excellent, whereas only 18% have attributes describing external appearance of the building and 6% describing roof type. LASTools software (rapidlasso GmbH, Friedrichshafener Straße 1, 82205 Gilching, GERMANY) was used to derive and assign building heights from 3D coordinates of the segmented point clouds. Various software options for procedural modeling were compared and Blender was selected due to the ability to process OSM data, availability of documentation, and low computing requirements. Using procedural modeling, a 3D model with level of detail (LOD) 1 was created fully automated. After analyzing roof types, a 3D model with LOD2 was created fully automated for 87.64% of buildings. For the remaining buildings, a comparison of procedural roof modeling and manual roof editing was performed. Finally, a visual comparison between the resulting 3D model and Google Earth’s model was performed. The main objective of this study is to demonstrate the efficient modeling process using open data and free software and resulting in an enhanced accuracy of the 3D building models compared to previous LOD2 iterations.

Environmental Science,Engineering,Computer Science
CityX: Controllable Procedural Content Generation for Unbounded 3D Cities

Shougao Zhang,Mengqi Zhou,Yuxi Wang,Chuanchen Luo,Rongyu Wang,Yiwei Li,Xucheng Yin,Zhaoxiang Zhang,Junran Peng

2024-08-06

Abstract:Generating a realistic, large-scale 3D virtual city remains a complex challenge due to the involvement of numerous 3D assets, various city styles, and strict layout constraints. Existing approaches provide promising attempts at procedural content generation to create large-scale scenes using Blender agents. However, they face crucial issues such as difficulties in scaling up generation capability and achieving fine-grained control at the semantic layout level. To address these problems, we propose a novel multi-modal controllable procedural content generation method, named CityX, which enhances realistic, unbounded 3D city generation guided by multiple layout conditions, including OSM, semantic maps, and satellite images. Specifically, the proposed method contains a general protocol for integrating various PCG plugins and a multi-agent framework for transforming instructions into executable Blender actions. Through this effective framework, CityX shows the potential to build an innovative ecosystem for 3D scene generation by bridging the gap between the quality of generated assets and industrial requirements. Extensive experiments have demonstrated the effectiveness of our method in creating high-quality, diverse, and unbounded cities guided by multi-modal conditions. Our project page: <a class="link-external link-https" href="https://cityx-lab.github.io" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence

Procedural modeling of urban environments for digital games development

Procedural Modeling of Urban Zone by Optimization

Improving Procedural Modeling with Semantics in Digital Architectural Heritage.

Procedural urban environments for FPS games

Procedural Planetary Multi-resolution Terrain Generation for Games

Procedural Modeling Of Residential Zone Subject To Urban Planning Constraints

Procedural Urban Forestry

3D-GIS Parametric Modelling for Virtual Urban Simulation Using CityEngine

Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussians

Procedural Crowd Generation for Semantically Augmented Virtual Cities

On procedural urban digital twin generation and visualization of large scale data

Guided Proceduralization: Optimizing Geometry Processing and Grammar Extraction for Architectural Models

Towards Urban Digital Twins: A Workflow for Procedural Visualization Using Geospatial Data

Survey and practice of 3d city modeling

Procedural Modeling in Urban Digital Twins as a Tool for Visualization, Analysis, and Public Engagement: Examining a Housing Policy in California

Cities in electronic games: how they present and impact real urban areas?

Image-Based Procedural Modeling of Facades

Automating Built Heritage Modelling for the Integration into 3D City Models

UrbanWorld: An Urban World Model for 3D City Generation

Automatic 3D Building Model Generation from Airborne LiDAR Data and OpenStreetMap Using Procedural Modeling

CityX: Controllable Procedural Content Generation for Unbounded 3D Cities