Abstract:Accurate and reliable state estimation and mapping are the foundation of most autonomous driving systems. In recent years, researchers have focused on pose estimation through geometric feature matching. However, most of the works in the literature assume a static scenario. Moreover, a registration based on a geometric feature is vulnerable to the interference of a dynamic object, resulting in a decline of accuracy. With the development of a deep semantic segmentation network, we can conveniently obtain the semantic information from the point cloud in addition to geometric information. Semantic features can be used as an accessory to geometric features that can improve the performance of odometry and loop closure detection. In a more realistic environment, semantic information can filter out dynamic objects in the data, such as pedestrians and vehicles, which lead to information redundancy in generated map and map-based localization failure. In this paper, we propose a method called LiDAR inertial odometry (LIO) with loop closure combined with semantic information (LIO-CSI), which integrates semantic information to facilitate the front-end process as well as loop closure detection. First, we made a local optimization on the semantic labels provided by the Sparse Point-Voxel Neural Architecture Search (SPVNAS) network. The optimized semantic information is combined into the front-end process of tightly-coupled light detection and ranging (LiDAR) inertial odometry via smoothing and mapping (LIO-SAM), which allows us to filter dynamic objects and improve the accuracy of the point cloud registration. Then, we proposed a semantic assisted scan-context method to improve the accuracy and robustness of loop closure detection. The experiments were conducted on an extensively used dataset KITTI and a self-collected dataset on the Jilin University (JLU) campus. The experimental results demonstrate that our method is better than the purely geometric method, especially in dynamic scenarios, and it has a good generalization ability.

GOSMatch: Graph-of-Semantics Matching for Detecting Loop Closures in 3D LiDAR data

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

A Semantic-Based Loop Closure Detection of 3D Point Cloud

Indoor Loop Closure Detection Based on Semantic Topology Graph Matching

Loop Closure Detection Based on Object-level Spatial Layout and Semantic Consistency

SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure

Loop closure detection using local 3D deep descriptors

Topology Aware Object-Level Semantic Mapping Towards More Robust Loop Closure

ASL-SLAM: A LiDAR SLAM with Activity Semantics-Based Loop Closure

A Semantic Spatial Structure-Based Loop Detection Algorithm for Visual Environmental Sensing

Deep Pose Graph-Matching-Based Loop Closure Detection for Semantic Visual SLAM

Towards Accurate Loop Closure Detection in Semantic SLAM with 3D Semantic Covisibility Graphs

LLOAM: LiDAR Odometry and Mapping with Loop-closure Detection Based Correction

SGLC: Semantic Graph-Guided Coarse-Fine-Refine Full Loop Closing for LiDAR SLAM

Semantic scan context: a novel semantic-based loop-closure method for LiDAR SLAM

LIO-CSI: LiDAR inertial odometry with loop closure combined with semantic information

Loop detection for 3D LiDAR SLAM using segment-group matching

GeoLCR: Attention-based Geometric Loop Closure and Registration