Abstract:Urban scene modeling is a challenging task for the photogrammetry and computer vision community due to its large scale, structural complexity, and topological delicacy. This paper presents an efficient multistep modeling framework for large-scale urban scenes from aerial images. It takes aerial images and a textured 3D mesh model generated by an image-based modeling system as the input and outputs compact polygon models with semantics at different levels of detail (LODs). Based on the key observation that urban buildings usually have piecewise planar rooftops and vertical walls, we propose a segment-based modeling method, which consists of three major stages: scene segmentation, roof contour extraction, and building modeling. By combining the deep neural network predictions with geometric constraints of the 3D mesh, the scene is first segmented into three classes. Then, for each building mesh, the 2D line segments are detected and used to slice the ground into polygon cells, followed by assigning each cell a roof plane via a MRF optimization. Finally, the LOD model is obtained by extruding cells to their corresponding planes. Compared with direct modeling in 3D space, we transform the mesh into a uniform 2D image grid representation and most of the modeling work is performed in 2D space, which has the advantages of low computational complexity and high robustness. In addition, our method doesn't require any global prior, such as the Manhattan or Atlanta world assumption, making it flexible to model scenes with different characteristics and complexity. Experiments on both single buildings and large-scale urban scenes demonstrate that by combining 2D photometric with 3D geometric information, the proposed algorithm is robust and efficient in urban scene LOD vectorized modeling compared with the state-of-the-art approaches.

A Hybrid Level‐of‐detail Representation for Large‐scale Urban Scenes Rendering

Efficient screen space approach for high complex dynamic scenes in real-time rendering

An Inverse Procedural Modeling and Hybrid Rendering Approach for Large-Scale Urban Scenes Visualization

High Quality Real-Time Rendering of Large Scale Point Model

A Fast and Effective Method for Large-Scale Terrain Rendering

Efficient Modeling and Real-Time Rendering of Large-scale Urban Scenes

Visualizing aerial LiDAR cities with hierarchical hybrid point-polygon structures.

Urban Scene LOD Vectorized Modeling From Photogrammetry Meshes

Real-time Visualization of Urban with Gigantic Amount of Detailed Buildings

Rendering of Virtual Environments Based on Polygonal & Point-Based Models

A Multiresolution Viewpoint Based Rendering for Large-scale Point Models

Multi-resolution Terrain Rendering Using Summed-Area Tables .

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

A Hardware Assisted Ldi Building Algorithm With Application To Hybrid Volume Rendering

Efficient 3D reconstruction for urban scenes

A Hybrid LOD-Sprite Technique for Interactive Rendering of Large Datasets

Adaptive voxels: interactive rendering of massive 3D models

Balancing Cpu And Gpu: Real-Time Visualization Of Large Scale 3d Scanning Models

Efficient Modeling and Real-Time Rendering of Massive Urban Pipelines Based on GPU

Rendering of Huge Point-Sampled Geometry Based on LOD Control and Out-of-Core Techniques

An Efficient Rendering Method for Large Vector Data on Large Terrain Models