Abstract:In large-scale long-term dynamic environments, high-frequency dynamic objects inevitably lead to significant changes in the appearance of the scene at the same location at different times, which is catastrophic for place recognition (PR). Therefore, how to eliminate the influence of dynamic objects to achieve robust PR has universal practical value for mobile robots and autonomous vehicles. To this end, we suggest a novel semantically consistent LiDAR PR method based on chained cascade network, called SC_LPR, which mainly consists of a LiDAR semantic image inpainting network (LSI-Net) and a semantic pyramid Transformer-based PR network (SPT-Net). Specifically, LSI-Net is a coarse-to-fine generative adversarial network (GAN) with a gated convolutional autoencoder as the backbone. To effectively address the challenges posed by variable-scale dynamic object masks, we integrate the updated Transformer block with mask attention and gated trident block into LSI-Net. Sequentially, in order to generate a discriminative global descriptor representing the point cloud, we design an encoder with pyramid Transformer block to efficiently encode long-range dependencies and global contexts between different categories in the inpainted semantic image, followed by an augmented NetVALD, a generalized VLAD (Vector of Locally Aggregated Descriptors) layer that adaptively aggregates salient local features. Last but not least, we first attempt to create a LiDAR semantic inpainting dataset, called LSI-Dataset, to effectively validate the proposed method. Experimental comparisons show that our method not only improves semantic inpainting performance by about 6%, but also improves PR performance in dynamic environments by about 8% compared to the representative optimal baseline. LSI-Dataset will be publicly available at https://github.KD.LPR.com/.

Camera-LiDAR Fusion with Latent Correlation for Cross-Scene Place Recognition

Camera-LiDAR Fusion with Latent Contact for Place Recognition in Challenging Cross-Scenes

Context for LiDAR-based Place Recognition

LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recognition

RINet: Efficient 3D Lidar-Based Place Recognition Using Rotation Invariant Neural Network

A Panoramic Localizer Based on Coarse-to-Fine Descriptors for Navigation Assistance

C2L-PR: Cross-modal Camera-to-LiDAR Place Recognition Via Modality Alignment and Orientation Voting

PRFusion: Toward Effective and Robust Multi-Modal Place Recognition with Image and Point Cloud Fusion

LiDAR‐based place recognition for mobile robots in ground/water surface multiple scenes

SC-LPR: Spatiotemporal Context Based LiDAR Place Recognition

Large-Scale Place Recognition Based on Camera-LiDAR Fused Descriptor

CRPlace: Camera-Radar Fusion with BEV Representation for Place Recognition

Semantics-enhanced discriminative descriptor learning for LiDAR-based place recognition

A Novel Place Recognition Network Using Visual Sequences and LiDAR Point Clouds for Autonomous Vehicles

Monocular Visual Place Recognition in LiDAR Maps via Cross-Modal State Space Model and Multi-View Matching

MFF-PR: Point Cloud and Image Multi-modal Feature Fusion for Place Recognition.

SC_LPR: Semantically Consistent LiDAR Place Recognition Based on Chained Cascade Network in Long-Term Dynamic Environments

CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data

A Multi-Sensor Fusion Framework for Localization Using LiDAR, IMU and RGB-DCamera

(LC)$^2$: LiDAR-Camera Loop Constraints For Cross-Modal Place Recognition

GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Driving