Abstract:3D point clouds have gained much research attention because of their ability to represent the spatial information of real-world environments in a detailed manner. Despite recent progress in point cloud processing with deep neural networks, most of them either implement sophisticated local feature aggregation methods or imitate 2D convolution operations in the range of K nearest neighbors with limited local context information. These methods may struggle to distinguish between similar geometric shapes within the local region of K nearest neighbors, such as doors and walls. To address this issue, we propose a novel local–global fusion network that captures the diverse local geometric shapes with global structure information. The proposed local–global fusion network comprises two main modules. Firstly, we have developed an effective approach for local context learning using incremental dilated KNN (IDKNN) as the neighbor selecting mechanism to enlarge the receptive field and incorporate more reliable points for local geometric shape learning. Secondly, a three-direction region-wise spatial attention (TRSA) algorithm has been developed to explore the global contextual dependencies. For global context learning, we first split the entire 3D space into regions with equal numbers of points, and, then, intra-region context features are extracted to learn the inter-region relations from three orthogonal directions, taking global structural knowledge into account. By fusing the local context information and global contextual dependencies, we establish a Local-Global Fusion Network, end-to-end framework, called LGFNet. Extensive experimental results on several benchmark datasets clearly demonstrate our approach can achieve state-of-the-art (SOTA) performance on point cloud classification, part segmentation, and indoor semantic segmentation. In addition, TRSA and IKDNN can be easily used in a plug-and-play fashion with various existing SOTA networks to substantially improve their performance. Our code is available at https://github.com/jasonwjw/IDKNN

PLReg3D: Learning 3D Local and Global Descriptors Jointly for Global Localization

3D LiDAR-Based Global Localization Using Siamese Neural Network

LocNet: Global Localization in 3D Point Clouds for Mobile Vehicles

Geo-Localization with Transformer-Based 2D-3D Match Network

A Panoramic Localizer Based on Coarse-to-Fine Descriptors for Navigation Assistance

Global Localization in Large-scale Point Clouds via Roll-pitch-yaw Invariant Place Recognition and Low-overlap Global Registration

Global Localization Based on Road-centric 3D Point Cloud Descriptor in Urban Environments

A Registration-aided Domain Adaptation Network for 3D Point Cloud Based Place Recognition

DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalization

Global Localization with a Single-Line LiDAR by Dense 2D Signature and 1D Registration

GRLoR: A Unified Global Retrieval and Local Reranking Framework for 3-D Place Recognition

RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds

CapsLoc3D: Point Cloud Retrieval for Large-Scale Place Recognition Based on 3D Capsule Networks

End-to-end 2D-3D Registration between Image and LiDAR Point Cloud for Vehicle Localization

A Base-Map-Guided Global Localization Solution for Heterogeneous Robots Using a Co-View Context Descriptor

DeLS-3D: Deep Localization and Segmentation with a 3D Semantic Map

G3DOA: Generalizable 3D Descriptor with Overlap Attention for Point Cloud Registration

Context-based local-global fusion network for 3D point cloud classification and segmentation

2D-3D Cross-Modality Network for End-to-End Localization with Probabilistic Supervision

Lgnet: Local and Global Point Dependency Network for 3d Object Detection

Three-Dimensional Object Co-Localization from Mobile LiDAR Point Clouds