Abstract:In this paper, we propose a novel local to global plane regularity aggregation framework for dense surfel mapping, aiming for real-time reconstruction of high-quality 3D global models in both indoor and urban environments. Different from prior works that directly localize surfels globally, we investigate three interplanar geometric relations: {coplanarity, parallelism, orthogonality} from local to global scales as additional structural regularities in reconstruction, promoting the performance in plane-dominated scenes remarkably. Given a monocular RGB-D video as input, our framework extracts and utilizes the interplanar relations in three stages: local surfel creation, local to global relation propagation, and global plane-guided re-localization. In the first stage, surfels are created and refined within the current frame by aggregating temporal and spatial cues. The interplanar relations are adopted to regulate the normal and position of each surfel. Then in the second stage, we simultaneously establish correspondences between the created surfels and global model and propagate the interplanar relations from local to global. Finally, the positions of surfels are further relocated and optimized in a larger scale, based on the global interplanar relation priors aggregated across all local frames. Extensive experiments on datasets of different scales demonstrate that our framework achieves superior performance in terms of consistency and accuracy of the reconstructed global model. Meanwhile, the capability of our framework in the real-time 3D reconstruction on CPU opens the door to practical application.

Local to Global Plane Regularity Aggregation for Dense Surfel Mapping

Real-time Scalable Dense Surfel Mapping

MD-Surf: Multimodal Neural Surface Reconstruction from Driving Views

Non-local Scan Consolidation for 3D Urban Scenes.

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

Surfel-Based Dense Rgb-D Reconstruction With Global And Local Consistency

Real-Time Large-Scale Dense Mapping with Surfels

SurfelMeshing: Online Surfel-Based Mesh Reconstruction

3D Surfel Map-Aided Visual Relocalization with Learned Descriptors

SurfelWarp: Efficient Non-Volumetric Single View Dynamic Reconstruction

StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splatting

Dense Depth-Map Estimation And Geometry Inference From Light Fields Via Global Optimization

High-quality Surface Reconstruction using Gaussian Surfels

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Dense monocular Simultaneous Localization and Mapping by direct surfel optimization

CoSurfGS:Collaborative 3D Surface Gaussian Splatting with Distributed Learning for Large Scene Reconstruction

GSurf: 3D Reconstruction via Signed Distance Fields with Direct Gaussian Supervision

PlaneFusion: Real-Time Indoor Scene Reconstruction With Planar Prior

Adaptive and Temporally Consistent Gaussian Surfels for Multi-view Dynamic Reconstruction

Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene Mapping

DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splatting