Abstract:With the popularization of consumer-grade low-cost robots, visual SLAM technology has been widely used for robot localization and navigation in indoor and outdoor environments. However, most current visual SLAM systems suffer from poor accuracy and robustness of pose estimation due to their vulnerability to feature extraction challenges, mismatching, and tracking loss in illumination changes and low-texture environments. Aiming to reduce the localization error of the robot and improve its operational stability, this paper proposes a novel stereo vision SLAM system based on deep neural networks. Firstly, in view of the fact that the handcrafted visual features have problems such as unstable feature extraction and inaccurate feature matching in environments with illumination changes and low texture, we designed a visual feature extraction module based on feature extraction network to overcome these issues, which contains a differentiable keypoint detection module, as well as reprojection and dispersed peak losses for accurate and repeatable keypoint training. Secondly, since the feature similarity measure of the bag-of-word algorithm uses Hamming distance, it cannot support the query and matching of visual features of deep neural networks. We improved it and generated a new visual feature dictionary based on deep neural network extraction to ensure the correctness of visual feature query and matching. Finally, in order to further optimize the pose of SLAM system, based on the original vision odometry, we use the redundant pose information of Lidar to complementary fuse the pose information of the visual front end and the laser front end. We apply the algorithm to the KITTI dataset and an actual mobile robot platform. Experimental results show that compared with other methods, the approach proposed in this article effectively enhances the accuracy and robustness of the SLAM system, and also proves the practicability and effectiveness of the method.

DeblurSLAM: A Novel Visual SLAM System Robust in Blurring Scene

A robust stereo feature-aided semi-direct SLAM system

BEBLID-SLAM: an Efficient Feature-Based Monocular SLAM System

A Neural Motion Deblurring Approach To Restore Rich Textures For Visual Slam

A visual SLAM method assisted by IMU and deep learning in indoor dynamic blurred scenes

COEB-SLAM: A Robust VSLAM in Dynamic Environments Combined Object Detection, Epipolar Geometry Constraint, and Blur Filtering

BY-SLAM: Dynamic Visual SLAM System Based on BEBLID and Semantic Information Extraction

SharpSLAM: 3D Object-Oriented Visual SLAM with Deblurring for Agile Drones

DXSLAM: A Robust and Efficient Visual SLAM System with Deep Features.

USP-SLAM: Deep Learning Based Visual SLAM with Robust Feature Extraction under Dynamic Environments.

InterpolationSLAM: A Novel Robust Visual SLAM System in Rotating Scenes

Stereo Vision SLAM Based on Feature Extraction Network

DyStSLAM: An Efficient Stereo Vision SLAM System in Dynamic Environment

DM-SLAM: A Feature-Based SLAM System for Rigid Dynamic Scenes

A real-time, robust and versatile visual-SLAM framework based on deep learning networks

Accurate RGB-D SLAM in Dynamic Environments Based on Dynamic Visual Feature Removal

AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System

DIR-SLAM: Dynamic Interference Removal for Real-Time VSLAM in Dynamic Environments

Robust Stereo Visual SLAM for Dynamic Environments With Moving Object

Video-based non-uniform object motion blur estimation and deblurring

Multiscale Spatially-Varying Blur Detection and Extraction