Abstract:Urban scene modeling is a challenging task for the photogrammetry and computer vision community due to its large scale, structural complexity, and topological delicacy. This paper presents an efficient multistep modeling framework for large-scale urban scenes from aerial images. It takes aerial images and a textured 3D mesh model generated by an image-based modeling system as the input and outputs compact polygon models with semantics at different levels of detail (LODs). Based on the key observation that urban buildings usually have piecewise planar rooftops and vertical walls, we propose a segment-based modeling method, which consists of three major stages: scene segmentation, roof contour extraction, and building modeling. By combining the deep neural network predictions with geometric constraints of the 3D mesh, the scene is first segmented into three classes. Then, for each building mesh, the 2D line segments are detected and used to slice the ground into polygon cells, followed by assigning each cell a roof plane via a MRF optimization. Finally, the LOD model is obtained by extruding cells to their corresponding planes. Compared with direct modeling in 3D space, we transform the mesh into a uniform 2D image grid representation and most of the modeling work is performed in 2D space, which has the advantages of low computational complexity and high robustness. In addition, our method doesn't require any global prior, such as the Manhattan or Atlanta world assumption, making it flexible to model scenes with different characteristics and complexity. Experiments on both single buildings and large-scale urban scenes demonstrate that by combining 2D photometric with 3D geometric information, the proposed algorithm is robust and efficient in urban scene LOD vectorized modeling compared with the state-of-the-art approaches.

Feature Preserving Decimation of Urban Meshes

Non-local Scan Consolidation for 3D Urban Scenes.

Shape-preserving mesh decimation for 3D building modeling

Advanced-Technological UAVs-Based Enhanced Reconstruction of Edges for Building Models

Quality-preserving multilevel mesh generation for building models

A Shape-Preserving Simplification Method for Urban Building Models

An Efficient Approach for Feature-Preserving Mesh Denoising

UBMDP: Urban Building Mesh Decoupling and Polygonization

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

Efficient Modeling and Real-Time Rendering of Large-scale Urban Scenes

Intelligent City 3D Modeling Model Based on Multisource Data Point Cloud Algorithm

APC2Mesh: Bridging the gap from occluded building façades to full 3D models

A Feature-Preserving Simplification Method for Dense Point Clouds Based on Voxel Priority Filtering

A Planar Feature-Preserving Texture Defragmentation Method for 3D Urban Building Models

Scalable point cloud meshing for image-based large-scale 3D modeling

City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds

Extraction and Simplification of Building Façade Pieces from Mobile Laser Scanner Point Clouds for 3D Street View Services

StructuredMesh: 3D Structured Optimization of Façade Components on Photogrammetric Mesh Models using Binary Integer Programming

An Appearance‐preserving Simplification Method for Complex 3D Building Models

Optimal Pre-processing of Laser Scanning Data for Indoor Scene Analysis and 3D Reconstruction of Building Models

Urban Scene LOD Vectorized Modeling From Photogrammetry Meshes