Abstract:Urban scene modeling is a challenging task for the photogrammetry and computer vision community due to its large scale, structural complexity, and topological delicacy. This paper presents an efficient multistep modeling framework for large-scale urban scenes from aerial images. It takes aerial images and a textured 3D mesh model generated by an image-based modeling system as the input and outputs compact polygon models with semantics at different levels of detail (LODs). Based on the key observation that urban buildings usually have piecewise planar rooftops and vertical walls, we propose a segment-based modeling method, which consists of three major stages: scene segmentation, roof contour extraction, and building modeling. By combining the deep neural network predictions with geometric constraints of the 3D mesh, the scene is first segmented into three classes. Then, for each building mesh, the 2D line segments are detected and used to slice the ground into polygon cells, followed by assigning each cell a roof plane via a MRF optimization. Finally, the LOD model is obtained by extruding cells to their corresponding planes. Compared with direct modeling in 3D space, we transform the mesh into a uniform 2D image grid representation and most of the modeling work is performed in 2D space, which has the advantages of low computational complexity and high robustness. In addition, our method doesn't require any global prior, such as the Manhattan or Atlanta world assumption, making it flexible to model scenes with different characteristics and complexity. Experiments on both single buildings and large-scale urban scenes demonstrate that by combining 2D photometric with 3D geometric information, the proposed algorithm is robust and efficient in urban scene LOD vectorized modeling compared with the state-of-the-art approaches.

Modeling Urban Scenes In The Spatial-Temporal Space

A Flexible Method for 3D Reconstruction of Urban Building

Efficient 3D reconstruction for urban scenes

Multi-view 3 d city model generation with image sequences

Three-Dimensional Structure Measurement And Optimization Method Of Indoor Scene Based On Single Image

Urban Scene LOD Vectorized Modeling From Photogrammetry Meshes

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3D Building Modelling with Digital Map, Lidar Data and Video Image Sequences

City Modeling by Videogrammetry Based on Three Video Image Sequences Strips Taken from Helicopter

Fusing Spaceborne Sar Interferometry And Street View Images For 4d Urban Modeling

RECONSTRUCTION OF 3D MODELS FROM POINT CLOUDS WITH HYBRID REPRESENTATION

Efficient Modeling and Real-Time Rendering of Large-scale Urban Scenes

City modeling by videogrammetry based on three video image sequence strips taken from a helicopter

Collaboratively Modeling Buildings from Large-Scale Street-Side and Remote Sensing Images

Visual-perception-driven Urban Three-dimensional Scene Data Scheduling Method

Multi-view Urban Scene Reconstruction in Non-Uniform Volume

Automatic 3D Indoor Scene Modeling from Single Panorama

An Automated 3D Approach for Buildings Reconstruction from Airborne Laser Scanning Data

An Automatic Building Models' Parametrer Reconstruction Method from Point Clouds

Lightweight Semantic Architecture Modeling by 3D Feature Line Detection

A Method for Fa st Modeling of 3 D Buildings from Mobile Laser Scanning Point Clouds and Re mote Sensing Data