Abstract:LiDAR‐based 3D place recognition is an essential component of simultaneous localization and mapping systems in multi‐scene robotic applications. However, extracting discriminative and generalizable global descriptors of point clouds is still an open issue due to the insufficient use of the information contained in the LiDAR scans in existing approaches. In this paper, we propose a novel spatial‐temporal point cloud encoding network for multiple scenes, dubbed STM‐Net, to fully fuse the multi‐view spatial information and temporal information of LiDAR point clouds. Specifically, we first develop a spatial feature encoding module consisting of the single‐view transformer and multi‐view transformer. The module learns the correlation both within a single view and between two views by utilizing the multi‐layer range images generated by spherical projection and multi‐layer bird's eye view images generated by top‐down projection. Then in the temporal feature encoding module, we exploit the temporal transformer to mine the temporal information in the sequential point clouds, and a NetVLAD layer is applied to aggregate features and generate sub‐descriptors. Furthermore, we use a GeM pooling layer to fuse more information along the time dimension for the final global descriptors. Extensive experiments conducted on unmanned ground/surface vehicles with different LiDAR configurations indicate that our method (1) achieves superior place recognition performance than state‐of‐the‐art algorithms, (2) generalizes well to diverse sceneries, (3) is robust to viewpoint changes, (4) can operate in real‐time, demonstrating the effectiveness and satisfactory capability of the proposed approach and highlighting its promising applications in multi‐scene place recognition tasks.

3D LiDAR-Based Global Localization Using Siamese Neural Network

LocNet: Global Localization in 3D Point Clouds for Mobile Robots.

Geo-Localization with Transformer-Based 2D-3D Match Network

Multimodal Localization: Stereo over LiDAR Map

Persistent Stereo Visual Localization on Cross-Modal Invariant Map

RINet: Efficient 3D Lidar-Based Place Recognition Using Rotation Invariant Neural Network

LiDAR-Based Global Localization Using Histogram of Orientations of Principal Normals

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

3D LiDAR Map Compression Using Deep Neural Network.

3D LiDAR Map Compression for Efficient Localization on Resource Constrained Vehicles

2-Entity RANSAC for Robust Visual Localization in Changing Environment

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Global Localization in Large-scale Point Clouds via Roll-pitch-yaw Invariant Place Recognition and Low-overlap Global Registration

LiDAR‐based place recognition for mobile robots in ground/water surface multiple scenes

OneShot Global Localization: Instant LiDAR-Visual Pose Estimation

A fast LiDAR place recognition and localization method by fusing local and global search

Monocular Vehicle Self-localization Method Based on Compact Semantic Map

A novel 3D LiDAR deep learning approach for uncrewed vehicle odometry

Relative geometry-aware siamese neural network for 6DOF camera relocalization

An Efficient LiDAR-based Localization Method for Self-Driving Cars in Dynamic Environments

DeepPointMap2: Accurate and Robust LiDAR-Visual SLAM with Neural Descriptors