Abstract:Existing visual SLAM (vSLAM) systems fail to perform well in dynamic environments as they cannot effectively ignore moving objects during pose estimation and mapping. We propose a lightweight approach to improve the robustness of existing feature based RGB-D and stereo vSLAM by accurately removing dynamic outliers in the scene that contribute to failures in pose estimation and mapping. First, a novel motion state detection algorithm using the depth and feature flow information is presented to identify regions in the scene with high moving probability. This information is then fused with semantic cues via a probability framework to enable accurate and robust moving object extraction to retain the useful features for pose estimation and mapping. To reduce the computational complexity of extracting semantic information in every frame, we propose to extract semantics only on keyframes with significant changes in image content. Semantic propagation is used to compensate for the changes in the intermediate frames (i.e., non-keyframes). This is achieved by computing the dense transformation map using the available feature flow vectors. The proposed techniques can be integrated into existing vSLAM systems to increase their robustness in dynamic environments without incurring much computation cost. Our work highlights the importance of distinguishing between motion states of potential moving objects for vSLAM in highly dynamic environments. We provide extensive experimental results on four well-known RGB-D and stereo datasets to show that the proposed technique outperforms existing vSLAM methods in indoor and outdoor environments under various dynamic scenarios including crowded scenes. We also perform our experiments on a low-cost embedded platform, i.e., Jetson TX1, to demonstrate the computational efficiency of our method.

Dense Depth and Color Acquisition of Repetitive Motions

Dense depth acquisition via one-shot stripe structured light

Robust Keyframe-based Dense SLAM with an RGB-D Camera.

Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Image

Spatio-Temporal Depth Recovery of Dynamic Scenes with Multiple Handheld Cameras

SPA: Sparse Photorealistic Animation Using a Single RGB-D Camera

CRF-Based Reconstruction from Narrow-Baseline Image Sequences.

Neural Active Structure-from-Motion in Dark and Textureless Environment

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Real-Time Geometry, Albedo, and Motion Reconstruction Using a Single RGB-D Camera

Monocular Piecewise Depth Estimation in Dynamic Scenes by Exploiting Superpixel Relations

Depth Map Estimation of Dynamic Scenes Using Prior Depth Information

Feature-Assisted Dense Spatio-Temporal Reconstruction From Binocular Sequences

Dense Scene Reconstruction from Light-Field Images Affected by Rolling Shutter

Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes

3d Reconstruction Of Dynamic Scenes With Multiple Handheld Cameras

Real-time Acquisition and Reconstruction of Dynamic Volumes with Neural Structured Illumination

Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light

Self-Distilled Depth From Single-Shot Structured Light With Intensity Reconstruction

Shape of Motion: 4D Reconstruction from a Single Video

Fast Semantic-Aware Motion State Detection for Visual SLAM in Dynamic Environment