Abstract:3D point clouds have gained much research attention because of their ability to represent the spatial information of real-world environments in a detailed manner. Despite recent progress in point cloud processing with deep neural networks, most of them either implement sophisticated local feature aggregation methods or imitate 2D convolution operations in the range of K nearest neighbors with limited local context information. These methods may struggle to distinguish between similar geometric shapes within the local region of K nearest neighbors, such as doors and walls. To address this issue, we propose a novel local–global fusion network that captures the diverse local geometric shapes with global structure information. The proposed local–global fusion network comprises two main modules. Firstly, we have developed an effective approach for local context learning using incremental dilated KNN (IDKNN) as the neighbor selecting mechanism to enlarge the receptive field and incorporate more reliable points for local geometric shape learning. Secondly, a three-direction region-wise spatial attention (TRSA) algorithm has been developed to explore the global contextual dependencies. For global context learning, we first split the entire 3D space into regions with equal numbers of points, and, then, intra-region context features are extracted to learn the inter-region relations from three orthogonal directions, taking global structural knowledge into account. By fusing the local context information and global contextual dependencies, we establish a Local-Global Fusion Network, end-to-end framework, called LGFNet. Extensive experimental results on several benchmark datasets clearly demonstrate our approach can achieve state-of-the-art (SOTA) performance on point cloud classification, part segmentation, and indoor semantic segmentation. In addition, TRSA and IKDNN can be easily used in a plug-and-play fashion with various existing SOTA networks to substantially improve their performance. Our code is available at https://github.com/jasonwjw/IDKNN

Lgnet: Local and Global Point Dependency Network for 3d Object Detection

LocNet: Global Localization in 3D Point Clouds for Mobile Vehicles

3DLG-Detector: 3D Object Detection via Simultaneous Local-Global Feature Learning

LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross- Modal Fusion

GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

Context-based local-global fusion network for 3D point cloud classification and segmentation

HEDNet: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Clouds

SP-Net: A Sparse Convolution and Point-Encoding Enhanced Network for 3D Object Detection in LiDAR Point Clouds.

SVGA-Net: Sparse Voxel-Graph Attention Network for 3D Object Detection from Point Clouds

P2-Net - Joint Description and Detection of Local Features for Pixel and Point Matching.

PC-RGNN: Point Cloud Completion and Graph Neural Network for 3D Object Detection

VirPNet: A Multimodal Virtual Point Generation Network for 3D Object Detection

Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud

FARP-Net: Local-Global Feature Aggregation and Relation-Aware Proposals for 3D Object Detection

SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism

MENet: Multi-Modal Mapping Enhancement Network for 3D Object Detection in Autonomous Driving

PointTrackNet: An End-to-End Network For 3-D Object Detection and Tracking From Point Clouds

Stereo RGB and Deeper LIDAR-Based Network for 3D Object Detection in Autonomous Driving.

Graph R-CNN: Towards Accurate 3D Object Detection with Semantic-Decorated Local Graph