Abstract:Existing visual SLAM (vSLAM) systems fail to perform well in dynamic environments as they cannot effectively ignore moving objects during pose estimation and mapping. We propose a lightweight approach to improve the robustness of existing feature based RGB-D and stereo vSLAM by accurately removing dynamic outliers in the scene that contribute to failures in pose estimation and mapping. First, a novel motion state detection algorithm using the depth and feature flow information is presented to identify regions in the scene with high moving probability. This information is then fused with semantic cues via a probability framework to enable accurate and robust moving object extraction to retain the useful features for pose estimation and mapping. To reduce the computational complexity of extracting semantic information in every frame, we propose to extract semantics only on keyframes with significant changes in image content. Semantic propagation is used to compensate for the changes in the intermediate frames (i.e., non-keyframes). This is achieved by computing the dense transformation map using the available feature flow vectors. The proposed techniques can be integrated into existing vSLAM systems to increase their robustness in dynamic environments without incurring much computation cost. Our work highlights the importance of distinguishing between motion states of potential moving objects for vSLAM in highly dynamic environments. We provide extensive experimental results on four well-known RGB-D and stereo datasets to show that the proposed technique outperforms existing vSLAM methods in indoor and outdoor environments under various dynamic scenarios including crowded scenes. We also perform our experiments on a low-cost embedded platform, i.e., Jetson TX1, to demonstrate the computational efficiency of our method.

Robust Semantic Optical Flow Visual Odometry in Dynamic Environment

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

Optical Flow Based Obstacle Detection in Static Environment

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Stereo Visual Odometry for Object Segmentation Based on Sparse Optical Flow in Dynamic Scene

Robust Monocular SLAM in Dynamic Environments

Optical Flow-Based Stereo Visual Odometry With Dynamic Object Detection

A robust visual odometry based on RGB-D camera in dynamic indoor environments

A Robust and Integrated Visual Odometry Framework Exploiting the Optical Flow and Feature Point Method

A Dense Optical Flow-Based Feature Matching Approach in Visual Odometry

A Robust Optical Flow Tracking Method Based On Prediction Model for Visual-Inertial Odometry.

A Monocular-Visual SLAM System with Semantic and Optical-Flow Fusion for Indoor Dynamic Environments

FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flow

A Robust Optical Flow Estimation under Varying Illumination.

Robust LiDAR visual inertial odometry for dynamic scenes

A Robust Optical Flow Computation

An Efficient Optical Flow Based Motion Detection Method for Non-stationary Scenes

Fast Semantic-Aware Motion State Detection for Visual SLAM in Dynamic Environment

Mask R-CNN Based Semantic RGB-D SLAM for Dynamic Scenes