Abstract:Purpose The prerequisite for most traditional visual simultaneous localization and mapping (V-SLAM) algorithms is that most objects in the environment should be static or in low-speed locomotion. These algorithms rely on geometric information of the environment and restrict the application scenarios with dynamic objects. Semantic segmentation can be used to extract deep features from images to identify dynamic objects in the real world. Therefore, V-SLAM fused with semantic information can reduce the influence from dynamic objects and achieve higher accuracy. This paper aims to present a new semantic stereo V-SLAM method toward outdoor dynamic environments for more accurate pose estimation. Design/methodology/approach First, the Deeplabv3+ semantic segmentation model is adopted to recognize semantic information about dynamic objects in the outdoor scenes. Second, an approach that combines prior knowledge to determine the dynamic hierarchy of moveable objects is proposed, which depends on the pixel movement between frames. Finally, a semantic stereo V-SLAM based on ORB-SLAM2 to calculate accurate trajectory in dynamic environments is presented, which selects corresponding feature points on static regions and eliminates useless feature points on dynamic regions. Findings The proposed method is successfully verified on the public data set KITTI and ZED2 self-collected data set in the real world. The proposed V-SLAM system can extract the semantic information and track feature points steadily in dynamic environments. Absolute pose error and relative pose error are used to evaluate the feasibility of the proposed method. Experimental results show significant improvements in root mean square error and standard deviation error on both the KITTI data set and an unmanned aerial vehicle. That indicates this method can be effectively applied to outdoor environments. Originality/value The main contribution of this study is that a new semantic stereo V-SLAM method is proposed with greater robustness and stability, which reduces the impact of moving objects in dynamic scenes.

Dense 3D Semantic SLAM of traffic environment based on stereo vision

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

A semantic SLAM-based dense mapping approach for large-scale dynamic outdoor environment

Hybrid Semi-Dense 3D Semantic-Topological Mapping From Stereo Visual-Inertial Odometry SLAM With Loop Closure Detection

RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

A Stereo SLAM System With Dense Mapping

Semi-Dense 3D Semantic Mapping from Monocular SLAM

Neural Implicit Dense Semantic SLAM

SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision

Stereo SLAM in Dynamic Environments Using Semantic Segmentation

Visual-Based Semantic SLAM with Landmarks for Large-Scale Outdoor Environment

Building and optimization of 3D semantic map based on Lidar and camera fusion

Ds-Slam: A Semantic Visual Slam Towards Dynamic Environments

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

SemanticSLAM: Learning based Semantic Map Construction and Robust Camera Localization

CD-SLAM:A Real-Time Stereo Visual-Inertial SLAM for Complex Dynamic Environments with Semantic and Geometric Information

A semantic visual SLAM based on improved mask R-CNN in dynamic environment

Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2

A dense RGB-D SLAM algorithm based on convolutional neural network of multi-layer image invariant feature

DOT-SLAM: A Stereo Visual Simultaneous Localization and Mapping (SLAM) System with Dynamic Object Tracking Based on Graph Optimization

StereoNeuroBayesSLAM: A Neurobiologically Inspired Stereo Visual SLAM System Based on Direct Sparse Method