Abstract:This article introduces BEVPlace++, a novel, fast, and robust LiDAR global localization method for unmanned ground vehicles. It uses lightweight convolutional neural networks (CNNs) on Bird's Eye View (BEV) image-like representations of LiDAR data to achieve accurate global localization through place recognition followed by 3-DoF pose estimation. Our detailed analyses reveal an interesting fact that CNNs are inherently effective at extracting distinctive features from LiDAR BEV images. Remarkably, keypoints of two BEV images with large translations can be effectively matched using CNN-extracted features. Building on this insight, we design a rotation equivariant module (REM) to obtain distinctive features while enhancing robustness to rotational changes. A Rotation Equivariant and Invariant Network (REIN) is then developed by cascading REM and a descriptor generator, NetVLAD, to sequentially generate rotation equivariant local features and rotation invariant global descriptors. The global descriptors are used first to achieve robust place recognition, and the local features are used for accurate pose estimation. Experimental results on multiple public datasets demonstrate that BEVPlace++, even when trained on a small dataset (3000 frames of KITTI) only with place labels, generalizes well to unseen environments, performs consistently across different days and years, and adapts to various types of LiDAR scanners. BEVPlace++ achieves state-of-the-art performance in subtasks of global localization including place recognition, loop closure detection, and global localization. Additionally, BEVPlace++ is lightweight, runs in real-time, and does not require accurate pose supervision, making it highly convenient for deployment. The source codes are publicly available at <a class="link-external link-https" href="https://github.com/zjuluolun/BEVPlace" rel="external noopener nofollow">this https URL</a>.

BEVLOC: End-to-End 6-Dof Localization Via Cross-Modality Correlation under Bird’s Eye View

BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Images

Multimodal Localization: Stereo over LiDAR Map

A Unified BEV Model for Joint Learning of 3D Local Features and Overlap Estimation.

Persistent Stereo Visual Localization on Cross-Modal Invariant Map

BEVPlace++: Fast, Robust, and Lightweight LiDAR Global Localization for Unmanned Ground Vehicles

BEVLoc: Cross-View Localization and Matching via Birds-Eye-View Synthesis

Attention-Enhanced Cross-modal Localization Between Spherical Images and Point Clouds

Efficient LiDAR Odometry for Autonomous Driving.

2D-3D Cross-Modality Network for End-to-End Localization with Probabilistic Supervision

Visual Localization in a Prior 3D LiDAR Map Combining Points and Lines

U-BEV: Height-aware Bird's-Eye-View Segmentation and Neural Map-based Relocalization

BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregation

GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detection

BEVRender: Vision-based Cross-view Vehicle Registration in Off-road GNSS-denied Environment

BEV-CV: Birds-Eye-View Transform for Cross-View Geo-Localisation

BLOS-BEV: Navigation Map Enhanced Lane Segmentation Network, Beyond Line of Sight

I2D-Loc: Camera Localization Via Image to LiDAR Depth Flow

CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusion

X-Align++: cross-modal cross-view alignment for Bird's-eye-view segmentation

Window-to-Window BEV Representation Learning for Limited FoV Cross-View Geo-localization