Abstract:Accurate and reliable state estimation and mapping are the foundation of most autonomous driving systems. In recent years, researchers have focused on pose estimation through geometric feature matching. However, most of the works in the literature assume a static scenario. Moreover, a registration based on a geometric feature is vulnerable to the interference of a dynamic object, resulting in a decline of accuracy. With the development of a deep semantic segmentation network, we can conveniently obtain the semantic information from the point cloud in addition to geometric information. Semantic features can be used as an accessory to geometric features that can improve the performance of odometry and loop closure detection. In a more realistic environment, semantic information can filter out dynamic objects in the data, such as pedestrians and vehicles, which lead to information redundancy in generated map and map-based localization failure. In this paper, we propose a method called LiDAR inertial odometry (LIO) with loop closure combined with semantic information (LIO-CSI), which integrates semantic information to facilitate the front-end process as well as loop closure detection. First, we made a local optimization on the semantic labels provided by the Sparse Point-Voxel Neural Architecture Search (SPVNAS) network. The optimized semantic information is combined into the front-end process of tightly-coupled light detection and ranging (LiDAR) inertial odometry via smoothing and mapping (LIO-SAM), which allows us to filter dynamic objects and improve the accuracy of the point cloud registration. Then, we proposed a semantic assisted scan-context method to improve the accuracy and robustness of loop closure detection. The experiments were conducted on an extensively used dataset KITTI and a self-collected dataset on the Jilin University (JLU) campus. The experimental results demonstrate that our method is better than the purely geometric method, especially in dynamic scenarios, and it has a good generalization ability.

LiDAR-Aided Visual-Inertial Localization with Semantic Maps

Multimodal Localization: Stereo over LiDAR Map

3D LiDAR-Based Global Localization Using Siamese Neural Network

Persistent Stereo Visual Localization on Cross-Modal Invariant Map

Laser Map Aided Visual Inertial Localization in Changing Environment.

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Visual Localization in a Prior 3D LiDAR Map Combining Points and Lines

Learning Visual Semantic Map-Matching for Loosely Multi-Sensor Fusion Localization of Autonomous Vehicles

Monocular Localization with Semantics Map for Autonomous Vehicles

MLIOM-AB: Multi-LiDAR-Inertial-Odometry and Mapping for Autonomous Buses

LIO-CSI: LiDAR inertial odometry with loop closure combined with semantic information

A Survey on Visual Map Localization Using LiDARs and Cameras

RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

SemanticSLAM: Learning based Semantic Map Construction and Robust Camera Localization

SELVO: A Semantic-Enhanced Lidar-Visual Odometry.

Monocular Vehicle Self-localization Method Based on Compact Semantic Map

Visual Semantic Localization based on HD Map for Autonomous Vehicles in Urban Scenarios

Vehicle Localization on Semantic Map by Combining Visual and Distance Measurements

Enhanced Mobile Robot Odometry With Error Kalman Filtering Incorporating 3D Point Cloud Intensity

Semantic Image Alignment for Vehicle Localization

Visual-Marker-Based Localization for Flat-Variation Scene