Abstract:Simultaneous localization and mapping (SLAM) has achieved impressive performance in static environments. However, SLAM in dynamic environments remains an open question. Many methods directly filter out dynamic objects, resulting in incomplete scene reconstruction and limited accuracy of camera localization. The other works express dynamic objects by point clouds, sparse joints, or coarse meshes, which fails to provide a photo-realistic representation. To overcome the above limitations, we propose a photo-realistic and geometry-aware RGB-D SLAM method by extending Gaussian splatting. Our method is composed of three main modules to 1) map the dynamic foreground including non-rigid humans and rigid items, 2) reconstruct the static background, and 3) localize the camera. To map the foreground, we focus on modeling the deformations and/or motions. We consider the shape priors of humans and exploit geometric and appearance constraints of humans and items. For background mapping, we design an optimization strategy between neighboring local maps by integrating appearance constraint into geometric alignment. As to camera localization, we leverage both static background and dynamic foreground to increase the observations for noise compensation. We explore the geometric and appearance constraints by associating 3D Gaussians with 2D optical flows and pixel patches. Experiments on various real-world datasets demonstrate that our method outperforms state-of-the-art approaches in terms of camera localization and scene representation. Source codes will be publicly available upon paper acceptance.

3D SLAM Method Based on Improved Regionalized Gaussian Process Map Construction

GP-SLAM plus : real-time 3D lidar SLAM based on improved regionalized Gaussian process map reconstruction

Evaluation of GP-SLAM in Real-World Environments

Novel 3dpoint Set Registrationmethod Based on Regionalizedgaussian Processmap Reconstruction

GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

SLAM with 3Dimensional-GNSS

3D Lidar SLAM Based on Ground Segmentation and Scan Context Loop Detection

Research on SLAM Algorithm of Mobile Robot Based on the Fusion of 2D LiDAR and Depth Camera

MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements

PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environments

An Effective LiDAR-Inertial SLAM-Based Map Construction Method for Outdoor Environments

Feature- and Distribution-Based LiDAR SLAM with Generalized Feature Representation and Heuristic Nonlinear Optimization

A quality improvement method for 3D laser slam point clouds based on geometric primitives of the scan scene

LVI-GS: Tightly-coupled LiDAR-Visual-Inertial SLAM using 3D Gaussian Splatting

GLC-SLAM: Gaussian Splatting SLAM with Efficient Loop Closure

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

A New Multimodal Map Building Method Using Multiple Object Tracking and Gaussian Process Regression

Monocular Gaussian SLAM with Language Extended Loop Closure

3D SLAM based on NDT matching and ground constraints for ground robots in complex environments