Abstract:In the field of autonomous driving and robotics, 3D object detection is a difficult, but important task. To improve the accuracy of detection, LiDAR, which collects the 3D point cloud of a scene, is updated constantly. But the density of the collected 3D points is low, and its distribution is unbalanced in the scene, which influences the accuracy of 3D object detectors in regards to object location and identification. Although corresponding high-resolution scene images from cameras can be used as supplemental information, poor fusion strategies can result in decreased accuracy compared with that of LiDAR-point-only detectors. Thus, to improve the detection performance for the classification, localization, and even boundary location of 3D objects, a two-stage detector with density-and-sparsity feature aggregation, called DASANet, is proposed in this paper. In the first stage, dense pseudo point clouds are generated with images from cameras and are used to obtain the initial proposals. In the second stage, two novel feature aggregation modules are designed to fuse LiDAR point information and pseudo point information, which refines the semantic and detailed representation of the feature maps. To supplement the semantic information of the highest-scale LiDAR features for object localization and classification, a triple differential information supplement (TDIS) module is presented to extract the LiDAR-pseudo differential features and enhance them in spatial, channel, and global dimensions. To increase the detailed information of the LiDAR features for object boundary location, a Siamese three-dimension coordinate attention (STCA) module is presented to extract stable LiDAR and pseudo point cloud features with a Siamese encoder and fuse these features using a three-dimension coordinate attention. Experiments using the KITTI Vision Benchmark Suite demonstrate the improved performance of our DASANet in regards to the localization and boundary location of objects. The ablation studies demonstrate the effectiveness of the TDIS and the STCA modules.

DSANet: Dynamic and Structure-Aware GCN for Sparse and Incomplete Point Cloud Learning

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Learning Point Cloud Shapes with Geometric and Topological Structures.

Structure-Aware Graph Convolution Network for Point Cloud Parsing

SDANet: spatial deep attention-based for point cloud classification and segmentation

PointSCNet: Point Cloud Structure and Correlation Learning Based on Space Filling Curve-Guided Sampling

SD-Net: Spatially-Disentangled Point Cloud Completion Network

LSANet: Feature Learning on Point Sets by Local Spatial Aware Layer

STD-Net: Structure-preserving and Topology-adaptive Deformation Network for Single-View 3D Reconstruction

Structure-Aware Convolution for 3D Point Cloud Classification and Segmentation

DSGI‐Net: Density‐based Selective Grouping Point Cloud Learning Network for Indoor Scene

DASANet: A 3D Object Detector with Density-and-Sparsity Feature Aggregation

Point Cloud Completion Based on Nonlocal Neural Networks with Adaptive Sampling

SCA-Net: Spatial and channel attention-based network for 3D point clouds

DSACNN: Dynamically Local Self-Attention CNN for 3D Point Cloud Analysis.

Long Short‐distance Topology Modelling of 3D Point Cloud Segmentation with a Graph Convolution Neural Network

GCSANet: A Global Context Spatial Attention Deep Learning Network for Remote Sensing Scene Classification

SGT-Net: A Transformer-Based Stratified Graph Convolutional Network for 3D Point Cloud Semantic Segmentation

Geo GCN: Geometric-based Graph CNN for Learning on Point Cloud

PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representation

Pointwise Geometric and Semantic Learning Network on 3D Point Clouds.