Abstract:Recently, deep learning techniques have been applied to solve visual or light detection and ranging (LiDAR) simultaneous localization and mapping (SLAM) problems. Supervised deep learning SLAM methods need ground truth data for training, but collecting such data is costly and labour-intensive. Unsupervised training strategies have been adopted by some visual or LiDAR SLAM methods. However, these methods only exploit the potential of single-sensor modalities, which do not take the complementary advantages of LiDAR and visual data. In this paper, we propose a novel unsupervised multi-channel visual-LiDAR SLAM method (MVL-SLAM) which can fuse visual and LiDAR data together. Our SLAM system consists of an unsupervised multi-channel visual-LiDAR odometry (MVLO) component, a deep learning–based loop closure detection component, and a 3D mapping component. The visual-LiDAR odometry component adopts a multi-channel recurrent convolutional neural network (RCNN). Its input consists of front, left, and right view depth images generated from 3D LiDAR data and RGB images. We use the features from a deep convolutional neural network (CNN) for the loop closure detection component. Our SLAM method does not require ground truth data for training and can directly construct environmental 3D maps from the 3D mapping component. Experiments conducted on the KITTI odometry dataset have shown the rotation and translation errors are lower than some of the other unsupervised methods, including UnMono, SfmLearner, DeepSLAM, and UnDeepVO. Experimental results show that our methods have good performance. By fusing visual and LiDAR data, MVL-SLAM has higher accuracy and robustness of the pose estimation compared with other single-modal SLAM systems.

Indoor SLAM for Micro Aerial Vehicles Using Visual and Laser Sensor Fusion

A Implementation Method of Indoor SLAM Using Velodyne Laser Radar for Mobile Robot

The SLAM combining with visual odometry for small-scale aerial robots

Multi-camera visual SLAM for autonomous navigation of micro aerial vehicles

Indoor Integrated Navigation of Micro Aerial Vehicle Based on Radar-Scanner and Inertial Navigation System

Monocular Vision SLAM for Indoor Aerial Vehicles

Self-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle

Sensor Fusion SLAM: An Efficient and Robust SLAM system for Dynamic Environments

Camera, LiDAR and Multi-modal SLAM Systems for Autonomous Ground Vehicles: a Survey

Visual-Inertial-Laser SLAM Based on ORB-SLAM3

Exploration-Based SLAM (e-SLAM) for the Indoor Mobile Robot Using Lidar

Visual-LiDAR SLAM Based on Unsupervised Multi-channel Deep Neural Networks

Fusion of binocular vision, 2D LiDAR and IMU for outdoor localization and indoor planar mapping

Efficient Submap-based Autonomous MAV Exploration using Visual-Inertial SLAM Configurable for LiDARs or Depth Cameras

A Multisensor Fusion With Automatic Vision–LiDAR Calibration Based on Factor Graph Joint Optimization for SLAM

Indoor Robot SLAM with Multi-Sensor Fusion

IMU and Multiple RGB-D Camera Fusion for Assisting Indoor Stop-and-Go 3D Terrestrial Laser Scanning

Multi-LiDAR Mapping for Scene Segmentation in Indoor Environments for Mobile Robots

Research on SLAM Algorithm of Mobile Robot Based on the Fusion of 2D LiDAR and Depth Camera