Abstract:3D point clouds have gained much research attention because of their ability to represent the spatial information of real-world environments in a detailed manner. Despite recent progress in point cloud processing with deep neural networks, most of them either implement sophisticated local feature aggregation methods or imitate 2D convolution operations in the range of K nearest neighbors with limited local context information. These methods may struggle to distinguish between similar geometric shapes within the local region of K nearest neighbors, such as doors and walls. To address this issue, we propose a novel local–global fusion network that captures the diverse local geometric shapes with global structure information. The proposed local–global fusion network comprises two main modules. Firstly, we have developed an effective approach for local context learning using incremental dilated KNN (IDKNN) as the neighbor selecting mechanism to enlarge the receptive field and incorporate more reliable points for local geometric shape learning. Secondly, a three-direction region-wise spatial attention (TRSA) algorithm has been developed to explore the global contextual dependencies. For global context learning, we first split the entire 3D space into regions with equal numbers of points, and, then, intra-region context features are extracted to learn the inter-region relations from three orthogonal directions, taking global structural knowledge into account. By fusing the local context information and global contextual dependencies, we establish a Local-Global Fusion Network, end-to-end framework, called LGFNet. Extensive experimental results on several benchmark datasets clearly demonstrate our approach can achieve state-of-the-art (SOTA) performance on point cloud classification, part segmentation, and indoor semantic segmentation. In addition, TRSA and IKDNN can be easily used in a plug-and-play fashion with various existing SOTA networks to substantially improve their performance. Our code is available at https://github.com/jasonwjw/IDKNN

InOR-Net: Incremental 3-D Object Recognition Network for Point Cloud Representation

I3DOL: Incremental 3D Object Learning without Catastrophic Forgetting

L3DOR: Lifelong 3D Object Recognition.

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection

iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning

SE-ORNet: Self-Ensembling Orientation-aware Network for Unsupervised Point Cloud Shape Correspondence

Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation

Triangle-Net: Towards Robustness in Point Cloud Learning

Self-Training and Curriculum Learning Guided Dynamic Refined Network for Remote Sensing Class-Incremental Semantic Segmentation

Context-based local-global fusion network for 3D point cloud classification and segmentation

I3DOD: Towards Incremental 3D Object Detection via Prompting

Domain Incremental Object Detection Based on Feature Space Topology Preserving Strategy

Progressive Deep Learning Framework for Recognizing 3D Orientations and Object Class Based on Point Cloud Representation

RT-Net: replay-and-transfer network for class incremental object detection

Learning without Forgetting for 3D Point Cloud Objects

3D IoU-Net: IoU Guided 3D Object Detector for Point Clouds

Towards Class-incremental Object Detection with Nearest Mean of Exemplars

Class incremental learning of remote sensing images based on class similarity distillation

3DTI-Net: Learn Inner Transform Invariant 3D Geometry Features using Dynamic GCN.

MiSSNet: Memory-Inspired Semantic Segmentation Augmentation Network for Class-Incremental Learning in Remote Sensing Images