Abstract:A robust and efficient Simultaneous Localization and Mapping (SLAM) system is essential for robot autonomy. For visual SLAM algorithms, though the theoretical framework has been well established for most aspects, feature extraction and association is still empirically designed in most cases, and can be vulnerable in complex environments. This paper shows that feature extraction with deep convolutional neural networks (CNNs) can be seamlessly incorporated into a modern SLAM framework. The proposed SLAM system utilizes a state-of-the-art CNN to detect keypoints in each image frame, and to give not only keypoint descriptors, but also a global descriptor of the whole image. These local and global features are then used by different SLAM modules, resulting in much more robustness against environmental changes and viewpoint changes compared with using hand-crafted features. We also train a visual vocabulary of local features with a Bag of Words (BoW) method. Based on the local features, global features, and the vocabulary, a highly reliable loop closure detection method is built. Experimental results show that all the proposed modules significantly outperforms the baseline, and the full system achieves much lower trajectory errors and much higher correct rates on all evaluated data. Furthermore, by optimizing the CNN with Intel OpenVINO toolkit and utilizing the Fast BoW library, the system benefits greatly from the SIMD (single-instruction-multiple-data) techniques in modern CPUs. The full system can run in real-time without any GPU or other accelerators. The code is public at https://github.com/ivipsourcecode/dxslam.

An FPGA-based Real-Time Simultaneous Localization and Mapping System.

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

An FPGA Based Energy Efficient DS-SLAM Accelerator for Mobile Robots in Dynamic Environment

ROPY-SLAM: a Heterogeneous CPU-FPGA System for Simultaneous Localization and Mapping

An FPGA Acceleration and Optimization Techniques for 2D LiDAR SLAM Algorithm

CNN-based Monocular Decentralized SLAM on Embedded FPGA

Reconfigurable System-on-Chip Architectures for Robust Visual SLAM on Humanoid Robots

Local Optimized and Scalable Frame-to-model SLAM

ORB-based SLAM accelerator on SoC FPGA

A Lightweight, Centralized, Collaborative, Truncated Signed Distance Function-Based Dense Simultaneous Localization and Mapping System for Multiple Mobile Vehicles

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

Em-SLAM: a Fast and Robust Monocular SLAM Method for Embedded Systems.

Hardware Acceleration for SLAM in Mobile Systems

OL-SLAM: A Robust and Versatile System of Object Localization and SLAM

Research on SLAM Algorithm of Mobile Robot Based on the Fusion of 2D LiDAR and Depth Camera

DXSLAM: A Robust and Efficient Visual SLAM System with Deep Features.

AFO-SLAM: an improved visual SLAM in dynamic scenes using acceleration of feature extraction and object detection

An algorithm of simultaneous localization and mapping for mobile robots based on graph optimization

Navigating the Landscape for Real-time Localisation and Mapping for Robotics and Virtual and Augmented Reality

CD-SLAM:A Real-Time Stereo Visual-Inertial SLAM for Complex Dynamic Environments with Semantic and Geometric Information

A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information