Abstract:3D point clouds have gained much research attention because of their ability to represent the spatial information of real-world environments in a detailed manner. Despite recent progress in point cloud processing with deep neural networks, most of them either implement sophisticated local feature aggregation methods or imitate 2D convolution operations in the range of K nearest neighbors with limited local context information. These methods may struggle to distinguish between similar geometric shapes within the local region of K nearest neighbors, such as doors and walls. To address this issue, we propose a novel local–global fusion network that captures the diverse local geometric shapes with global structure information. The proposed local–global fusion network comprises two main modules. Firstly, we have developed an effective approach for local context learning using incremental dilated KNN (IDKNN) as the neighbor selecting mechanism to enlarge the receptive field and incorporate more reliable points for local geometric shape learning. Secondly, a three-direction region-wise spatial attention (TRSA) algorithm has been developed to explore the global contextual dependencies. For global context learning, we first split the entire 3D space into regions with equal numbers of points, and, then, intra-region context features are extracted to learn the inter-region relations from three orthogonal directions, taking global structural knowledge into account. By fusing the local context information and global contextual dependencies, we establish a Local-Global Fusion Network, end-to-end framework, called LGFNet. Extensive experimental results on several benchmark datasets clearly demonstrate our approach can achieve state-of-the-art (SOTA) performance on point cloud classification, part segmentation, and indoor semantic segmentation. In addition, TRSA and IKDNN can be easily used in a plug-and-play fashion with various existing SOTA networks to substantially improve their performance. Our code is available at https://github.com/jasonwjw/IDKNN

Backward Attentive Fusing Network With Local Aggregation Classifier for 3D Point Cloud Semantic Segmentation

Background-Aware 3D Point Cloud Segmentationwith Dynamic Point Feature Aggregation

Point Attention Network for Semantic Segmentation of 3D Point Clouds

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion

RAAFNet: Reverse Attention Adaptive Fusion Network for Large-Scale Point Cloud Semantic Segmentation

A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation

LLGF-Net: Learning Local and Global Feature Fusion for 3D Point Cloud Semantic Segmentation

Fuzzy Neighborhood Learning for Deep 3-D Segmentation of Point Cloud.

Fast Context-Awareness Encoder for LiDAR Point Semantic Segmentation

GAF-Net: Geometric Contextual Feature Aggregation and Adaptive Fusion for Large-Scale Point Cloud Semantic Segmentation

Joint Point Clouds Semantic and Instance Segmentation by Local Aggregation and Clustering

APPFNet: Adaptive point-pixel fusion network for 3D semantic segmentation with neighbor feature aggregation

DCNet: Large-Scale Point Cloud Semantic Segmentation with Discriminative and Efficient Feature Aggregation

Local Fusion Attention Network for Semantic Segmentation of Building Facade Point Clouds

An attention-based bilateral feature fusion network for 3D point cloud

Point-based Attention Convolutional Neural Networks for Point Clouds Semantic Segmentation

FFA-Net: Fast Feature Aggregation Network for 3D Point Cloud Segmentation

CLFusion:3D Semantic Segmentation Based on Camera and Lidar Fusion

Context-based local-global fusion network for 3D point cloud classification and segmentation

PointLAE: A Point Cloud Semantic Segmentation Neural Network via Multifeature Aggregation for Large-Scale Application