Abstract:Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities since their data association usually relies on feature correspondences. Additionally, learning-based SLAM systems often fall short in terms of real-time performance and accuracy. Balancing real-time performance with dense 3D reconstruction capabilities is a challenging problem. In this paper, we propose a real-time RGB-D SLAM system that incorporates a novel view synthesis technique, 3D Gaussian Splatting, for 3D scene representation and pose estimation. This technique leverages the real-time rendering performance of 3D Gaussian Splatting with rasterization and allows for differentiable optimization in real time through CUDA implementation. We also enable mesh reconstruction from 3D Gaussians for explicit dense 3D reconstruction. To estimate accurate camera poses, we utilize a rotation-translation decoupled strategy with inverse optimization. This involves iteratively updating both in several iterations through gradient-based optimization. This process includes differentiably rendering RGB, depth, and silhouette maps and updating the camera parameters to minimize a combined loss of photometric loss, depth geometry loss, and visibility loss, given the existing 3D Gaussian map. However, 3D Gaussian Splatting (3DGS) struggles to accurately represent surfaces due to the multi-view inconsistency of 3D Gaussians, which can lead to reduced accuracy in both camera pose estimation and scene reconstruction. To address this, we utilize depth priors as additional regularization to enforce geometric constraints, thereby improving the accuracy of both pose estimation and 3D reconstruction. We also provide extensive experimental results on public benchmark datasets to demonstrate the effectiveness of our proposed methods in terms of pose accuracy, geometric accuracy, and rendering performance.

Snap-it, Tap-it, Splat-it: Tactile-Informed 3D Gaussian Splatting for Reconstructing Challenging Surfaces

Touch-GS: Visual-Tactile Supervised 3D Gaussian Splatting

GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstruction

SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surface

Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenes

SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction

TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensing

MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile-Based Geometric Consistency Densification

GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Views

SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting

3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting

Adaptive and Temporally Consistent Gaussian Surfels for Multi-view Dynamic Reconstruction

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction

Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing

Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis

DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splatting

Quadratic Gaussian Splatting for Efficient and Detailed Surface Reconstruction

Large-Scale 3D Terrain Reconstruction Using 3D Gaussian Splatting for Visualization and Simulation

TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformers

SA-GS: Semantic-Aware Gaussian Splatting for Large Scene Reconstruction with Geometry Constrain

Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion