Abstract:Urban scene modeling is a challenging task for the photogrammetry and computer vision community due to its large scale, structural complexity, and topological delicacy. This paper presents an efficient multistep modeling framework for large-scale urban scenes from aerial images. It takes aerial images and a textured 3D mesh model generated by an image-based modeling system as the input and outputs compact polygon models with semantics at different levels of detail (LODs). Based on the key observation that urban buildings usually have piecewise planar rooftops and vertical walls, we propose a segment-based modeling method, which consists of three major stages: scene segmentation, roof contour extraction, and building modeling. By combining the deep neural network predictions with geometric constraints of the 3D mesh, the scene is first segmented into three classes. Then, for each building mesh, the 2D line segments are detected and used to slice the ground into polygon cells, followed by assigning each cell a roof plane via a MRF optimization. Finally, the LOD model is obtained by extruding cells to their corresponding planes. Compared with direct modeling in 3D space, we transform the mesh into a uniform 2D image grid representation and most of the modeling work is performed in 2D space, which has the advantages of low computational complexity and high robustness. In addition, our method doesn't require any global prior, such as the Manhattan or Atlanta world assumption, making it flexible to model scenes with different characteristics and complexity. Experiments on both single buildings and large-scale urban scenes demonstrate that by combining 2D photometric with 3D geometric information, the proposed algorithm is robust and efficient in urban scene LOD vectorized modeling compared with the state-of-the-art approaches.

Efficient Modeling and Real-Time Rendering of Large-scale Urban Scenes

Efficient screen space approach for high complex dynamic scenes in real-time rendering

Real-time Visualization of Urban with Gigantic Amount of Detailed Buildings

Large-Scale Model Rendering System Based on Network Streaming

Partition Based Real-Time Rendering Method for Large-Area Terrain Data

Real-Time Rendering of Large-Scale Snow Scene

High Quality Real-Time Rendering of Large Scale Point Model

3D urban landscape rendering and optimization algorithm for smart city

Efficient Modeling and Real-Time Rendering of Massive Urban Pipelines Based on GPU

Perception-motivated Visualization for 3D City Scenes.

Rendering of Virtual Environments Based on Polygonal & Point-Based Models

Interactive Expressive Illustration of 3D City Scenes

Urban Scene LOD Vectorized Modeling From Photogrammetry Meshes

Real-world large-scale terrain model reconstruction and real-time rendering

Visual-perception-driven Urban Three-dimensional Scene Data Scheduling Method

Balancing Cpu And Gpu: Real-Time Visualization Of Large Scale 3d Scanning Models

Size-Adaptive Texture Atlas Generation and Remapping for 3D Urban Building Models

Procedural Modeling of Urban Zone by Optimization

Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior

A Real-Time Rendering Method of Large Scale Terrain

Collaboratively Modeling Buildings from Large-Scale Street-Side and Remote Sensing Images