Abstract:3D point clouds have gained much research attention because of their ability to represent the spatial information of real-world environments in a detailed manner. Despite recent progress in point cloud processing with deep neural networks, most of them either implement sophisticated local feature aggregation methods or imitate 2D convolution operations in the range of K nearest neighbors with limited local context information. These methods may struggle to distinguish between similar geometric shapes within the local region of K nearest neighbors, such as doors and walls. To address this issue, we propose a novel local–global fusion network that captures the diverse local geometric shapes with global structure information. The proposed local–global fusion network comprises two main modules. Firstly, we have developed an effective approach for local context learning using incremental dilated KNN (IDKNN) as the neighbor selecting mechanism to enlarge the receptive field and incorporate more reliable points for local geometric shape learning. Secondly, a three-direction region-wise spatial attention (TRSA) algorithm has been developed to explore the global contextual dependencies. For global context learning, we first split the entire 3D space into regions with equal numbers of points, and, then, intra-region context features are extracted to learn the inter-region relations from three orthogonal directions, taking global structural knowledge into account. By fusing the local context information and global contextual dependencies, we establish a Local-Global Fusion Network, end-to-end framework, called LGFNet. Extensive experimental results on several benchmark datasets clearly demonstrate our approach can achieve state-of-the-art (SOTA) performance on point cloud classification, part segmentation, and indoor semantic segmentation. In addition, TRSA and IKDNN can be easily used in a plug-and-play fashion with various existing SOTA networks to substantially improve their performance. Our code is available at https://github.com/jasonwjw/IDKNN

Local-to-Global Perception Network for Point Cloud Segmentation

CenterLPS: Segment Instances by Centers for LiDAR Panoptic Segmentation

Large-scale point cloud semantic segmentation via local perception and global descriptor vector

A Large-Scale Point Cloud Semantic Segmentation Network Via Local Dual Features and Global Correlations

Efficiently Expanding Receptive Fields: Local Split Attention and Parallel Aggregation for Enhanced Large-scale Point Cloud Semantic Segmentation

Local-to-Global Semantic Learning for Multi-View 3D Object Detection from Point Cloud

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation

Mining Local Geometric Structure for Large-Scale 3D Point Clouds Semantic Segmentation

Kernel Point Non-local Networks for LiDAR Semantic Segmentation

Efficient LiDAR Point Cloud Oversegmentation Network

LACV-Net: Semantic Segmentation of Large-Scale Point Cloud Scene via Local Adaptive and Comprehensive VLAD

Density-aware Global-Local Attention Network for Point Cloud Segmentation

Exploiting Local and Global Structure for Point Cloud Semantic Segmentation with Contextual Point Representations

LLGF-Net: Learning Local and Global Feature Fusion for 3D Point Cloud Semantic Segmentation

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation

Hierarchical Semantic Segmentation of Urban Scene Point Clouds Via Group Proposal and Graph Attention Network

Context-based local-global fusion network for 3D point cloud classification and segmentation

RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentation

LPFE-Net: a local parallel feature extraction network for large-scale point cloud semantic segmentation

Point Cloud Segmentation via Edge-fused Local Graph Learning