Abstract:3D point clouds have gained much research attention because of their ability to represent the spatial information of real-world environments in a detailed manner. Despite recent progress in point cloud processing with deep neural networks, most of them either implement sophisticated local feature aggregation methods or imitate 2D convolution operations in the range of K nearest neighbors with limited local context information. These methods may struggle to distinguish between similar geometric shapes within the local region of K nearest neighbors, such as doors and walls. To address this issue, we propose a novel local–global fusion network that captures the diverse local geometric shapes with global structure information. The proposed local–global fusion network comprises two main modules. Firstly, we have developed an effective approach for local context learning using incremental dilated KNN (IDKNN) as the neighbor selecting mechanism to enlarge the receptive field and incorporate more reliable points for local geometric shape learning. Secondly, a three-direction region-wise spatial attention (TRSA) algorithm has been developed to explore the global contextual dependencies. For global context learning, we first split the entire 3D space into regions with equal numbers of points, and, then, intra-region context features are extracted to learn the inter-region relations from three orthogonal directions, taking global structural knowledge into account. By fusing the local context information and global contextual dependencies, we establish a Local-Global Fusion Network, end-to-end framework, called LGFNet. Extensive experimental results on several benchmark datasets clearly demonstrate our approach can achieve state-of-the-art (SOTA) performance on point cloud classification, part segmentation, and indoor semantic segmentation. In addition, TRSA and IKDNN can be easily used in a plug-and-play fashion with various existing SOTA networks to substantially improve their performance. Our code is available at https://github.com/jasonwjw/IDKNN

Occlusion Localization Based on Convolutional Neural Networks.

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Omnisupervised Omnidirectional Semantic Segmentation

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Visual Localizer: Outdoor Localization Based on ConvNet Descriptor and Global Optimization for Visually Impaired Pedestrians

Mapping Impervious Surfaces in Town–Rural Transition Belts Using China’s GF-2 Imagery and Object-Based Deep CNNs

Boundary Objectness Network For Object Detection And Localization

Occlusion Aware Facial Expression Recognition Using CNN With Attention Mechanism

Occluded Scene Classification via Cascade Supervised Contrastive Learning

Simultaneous Traffic Sign Detection and Boundary Estimation using Convolutional Neural Network

Occlusion-Aware Object Localization, Segmentation and Pose Estimation

A Novel Convolutional Neural Network Based Localization System for Monocular Images.

Occlusion-Aware Detection for Internet of Vehicles in Urban Traffic Sensing Systems

Now You See Me: Robust approach to Partial Occlusions

Sign Detection based on Convolutional Neural Networks

CSNet: a ConvNeXt-based Siamese network for RGB-D salient object detection

Few-Shot Common-Object Reasoning Using Common-Centric Localization Network

CoupleNet: Coupling Global Structure with Local Parts for Object Detection

Guided Attention in CNNs for Occluded Pedestrian Detection and Re-identification

Context-based local-global fusion network for 3D point cloud classification and segmentation

Delving deeper into convolutional neural networks for camera relocalization.