Abstract:Purpose The prerequisite for most traditional visual simultaneous localization and mapping (V-SLAM) algorithms is that most objects in the environment should be static or in low-speed locomotion. These algorithms rely on geometric information of the environment and restrict the application scenarios with dynamic objects. Semantic segmentation can be used to extract deep features from images to identify dynamic objects in the real world. Therefore, V-SLAM fused with semantic information can reduce the influence from dynamic objects and achieve higher accuracy. This paper aims to present a new semantic stereo V-SLAM method toward outdoor dynamic environments for more accurate pose estimation. Design/methodology/approach First, the Deeplabv3+ semantic segmentation model is adopted to recognize semantic information about dynamic objects in the outdoor scenes. Second, an approach that combines prior knowledge to determine the dynamic hierarchy of moveable objects is proposed, which depends on the pixel movement between frames. Finally, a semantic stereo V-SLAM based on ORB-SLAM2 to calculate accurate trajectory in dynamic environments is presented, which selects corresponding feature points on static regions and eliminates useless feature points on dynamic regions. Findings The proposed method is successfully verified on the public data set KITTI and ZED2 self-collected data set in the real world. The proposed V-SLAM system can extract the semantic information and track feature points steadily in dynamic environments. Absolute pose error and relative pose error are used to evaluate the feasibility of the proposed method. Experimental results show significant improvements in root mean square error and standard deviation error on both the KITTI data set and an unmanned aerial vehicle. That indicates this method can be effectively applied to outdoor environments. Originality/value The main contribution of this study is that a new semantic stereo V-SLAM method is proposed with greater robustness and stability, which reduces the impact of moving objects in dynamic scenes.

A Method of Vision Aided GNSS Positioning Using Semantic Information in Complex Urban Environment

A robust stereo feature-aided semi-direct SLAM system

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Continuous and Precise Positioning in Urban Environments by Tightly Coupled Integration of GNSS, INS and Vision

Semantic-Structure-Aware Multi-Level Information Fusion for Robust Global Orientation Optimization of Autonomous Mobile Robots

Improved Multi-Sensor Fusion Positioning System Based on GNSS/LiDAR/Vision/IMU With Semi-Tight Coupling and Graph Optimization in GNSS Challenging Environments

LD-SLAM: A Robust and Accurate GNSS-Aided Multi-Map Method for Long-Distance Visual SLAM

A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information

A Multisensor Fusion With Automatic Vision–LiDAR Calibration Based on Factor Graph Joint Optimization for SLAM

A Semantic-aided Fusion Localization Method for Intelligent Vehicles in GNSS-denied Dynamic Environments

Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2

Visual SLAM Algorithm Based on Semantic Information and Geometric Consistency1.

Localization and Mapping Based on Multi-feature and Multi-sensor Fusion

Accurate Location in Dynamic Traffic Environment Using Semantic Information and Probabilistic Data Association

Tightly Coupled GNSS with Stereo Camera Navigation Using Graph Optimization

Real-Time Visual-Inertial Localization Using Semantic Segmentation Towards Dynamic Environments

A semantic visual SLAM based on improved mask R-CNN in dynamic environment

Sensor Fusion SLAM: An Efficient and Robust SLAM system for Dynamic Environments

Tightly Coupled GNSS, INS and Visual Odometry for Accurate and Robust Vehicle Positioning

Fusing GNSS/INS/Vision With A Priori Feature Map for High-Precision and Continuous Navigation

Semantic-Assisted LIDAR Tightly Coupled SLAM for Dynamic Environments