Abstract:Accurate and reliable state estimation and mapping are the foundation of most autonomous driving systems. In recent years, researchers have focused on pose estimation through geometric feature matching. However, most of the works in the literature assume a static scenario. Moreover, a registration based on a geometric feature is vulnerable to the interference of a dynamic object, resulting in a decline of accuracy. With the development of a deep semantic segmentation network, we can conveniently obtain the semantic information from the point cloud in addition to geometric information. Semantic features can be used as an accessory to geometric features that can improve the performance of odometry and loop closure detection. In a more realistic environment, semantic information can filter out dynamic objects in the data, such as pedestrians and vehicles, which lead to information redundancy in generated map and map-based localization failure. In this paper, we propose a method called LiDAR inertial odometry (LIO) with loop closure combined with semantic information (LIO-CSI), which integrates semantic information to facilitate the front-end process as well as loop closure detection. First, we made a local optimization on the semantic labels provided by the Sparse Point-Voxel Neural Architecture Search (SPVNAS) network. The optimized semantic information is combined into the front-end process of tightly-coupled light detection and ranging (LiDAR) inertial odometry via smoothing and mapping (LIO-SAM), which allows us to filter dynamic objects and improve the accuracy of the point cloud registration. Then, we proposed a semantic assisted scan-context method to improve the accuracy and robustness of loop closure detection. The experiments were conducted on an extensively used dataset KITTI and a self-collected dataset on the Jilin University (JLU) campus. The experimental results demonstrate that our method is better than the purely geometric method, especially in dynamic scenarios, and it has a good generalization ability.

A Semantic-Assisted LiDAR SLAM Based on Attention Feature Points

Semantic-Assisted LIDAR Tightly Coupled SLAM for Dynamic Environments

SD-SLAM: A Semantic SLAM Approach for Dynamic Scenes Based on LiDAR Point Clouds

RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

An Efficient LiDAR SLAM With Angle-Based Feature Extraction and Voxel-Based Fixed-Lag Smoothing

A LiDAR Point Cloud Semantic Segmentation Algorithm Based on Attention Mechanism and Hybrid CNN-LSTM

Efficient LiDAR Odometry for Autonomous Driving.

SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure

FELC-SLAM: Feature Extraction and Loop Closure Optimized Lidar SLAM System

Fast Context-Awareness Encoder for LiDAR Point Semantic Segmentation

DeepPointMap2: Accurate and Robust LiDAR-Visual SLAM with Neural Descriptors

LiDAR Data Enrichment Using Deep Learning Based on High-Resolution Image: An Approach to Achieve High-Performance LiDAR SLAM Using Low-cost LiDAR

Ground-Aware Point Cloud Semantic Segmentation for Autonomous Driving

A Monocular Visual SLAM System Augmented by Lightweight Deep Local Feature Extractor Using In-House and Low-Cost LIDAR-camera Integrated Device

LIO-CSI: LiDAR inertial odometry with loop closure combined with semantic information

A LiDAR-intensity SLAM and loop closure detection method using an intensity cylindrical-projection shape context descriptor

SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision

Semantic scan context: a novel semantic-based loop-closure method for LiDAR SLAM

Semantic SLAM Based on Object Detection and Improved Octomap

Feature- and Distribution-Based LiDAR SLAM with Generalized Feature Representation and Heuristic Nonlinear Optimization