Abstract:3D Gaussian Splatting algorithms excel in novel view rendering applications and have been adapted to extend the capabilities of traditional SLAM systems. However, current Gaussian Splatting SLAM methods, designed mainly for hand-held RGB or RGB-D sensors, struggle with tracking drifts when used with rotating RGB-D camera setups. In this paper, we propose a robust Gaussian Splatting SLAM architecture that utilizes inputs from rotating multiple RGB-D cameras to achieve accurate localization and photorealistic rendering performance. The carefully designed Gaussian Splatting Loop Closure module effectively addresses the issue of accumulated tracking and mapping errors found in conventional Gaussian Splatting SLAM systems. First, each Gaussian is associated with an anchor frame and categorized as historical or novel based on its timestamp. By rendering different types of Gaussians at the same viewpoint, the proposed loop detection strategy considers both co-visibility relationships and distinct rendering outcomes. Furthermore, a loop closure optimization approach is proposed to remove camera pose drift and maintain the high quality of 3D Gaussian models. The approach uses a lightweight pose graph optimization algorithm to correct pose drift and updates Gaussians based on the optimized poses. Additionally, a bundle adjustment scheme further refines camera poses using photometric and geometric constraints, ultimately enhancing the global consistency of scenarios. Quantitative and qualitative evaluations on both synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art methods in camera pose estimation and novel view rendering tasks. The code will be open-sourced for the community.

Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Robotics

Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling

Object-centric Reconstruction and Tracking of Dynamic Unknown Objects using 3D Gaussian Splatting

3D Gaussian Splatting in Robotics: A Survey

Automated 3D Physical Simulation of Open-world Scene with Gaussian Splatting

EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting

CoGS: Controllable Gaussian Splatting

Robust Gaussian Splatting SLAM by Leveraging Loop Closure

Gaussian Splatting Visual MPC for Granular Media Manipulation

SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos

ActiveGS: Active Scene Reconstruction using Gaussian Splatting

Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenes

Robo-GS: A Physics Consistent Spatial-Temporal Model for Robotic Arm with Hybrid Representation

Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotion

MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting

Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps

Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting

Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing

Modeling Uncertainty in 3D Gaussian Splatting through Continuous Semantic Splatting

Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videos

Let's Make a Splan: Risk-Aware Trajectory Optimization in a Normalized Gaussian Splat