Abstract:The authors design a Structural Information Augment (SIA) module to reconstruct the complete shapes of objects within proposals and then integrate the reconstructed structural information into the spatial feature of the object for box refinement. Besides, the authors construct a novel backbone network, which stacks Context‐enhanced Transformer modules and an upsampling branch to capture contextual information efficiently and generate accurate proposals for the SIA module. Extensive experiments on the KITTI and Waymo datasets show that the authors' well‐designed SIANet can effectively improve detection performance. 3D object detection technology from point clouds has been widely applied in the field of automatic driving in recent years. In practical applications, the shape point clouds of some objects are incomplete due to occlusion or far distance, which means they suffer from insufficient structural information. This greatly affects the detection performance. To address this challenge, the authors design a Structural Information Augment (SIA) Network for 3D object detection, named SIANet. Specifically, the authors design a SIA module to reconstruct the complete shapes of objects within proposals for enhancing their geometric features, which are further fused into the spatial feature of the object for box refinement to predict accurate detection boxes. Besides, the authors construct a novel Unet‐liked Context‐enhanced Transformer backbone network, which stacks Context‐enhanced Transformer modules and an upsampling branch to capture contextual information efficiently and generate high‐quality proposals for the SIA module. Extensive experiments show that the authors' well‐designed SIANet can effectively improve detection performance, especially surpassing the baseline network by 1.04% mean Average Precision (mAP) gain in the KITTI dataset and 0.75% LEVEL_2 mAP gain in the Waymo dataset.

SIANet: 3D object detection with structural information augment network

SIENet: Spatial Information Enhancement Network for 3D Object Detection from Point Cloud

SEGANet: 3D Object Detection with Shape-Enhancement and Geometry-Aware Network.

Improving 3D Object Detection with Context-Aware and Dimensional Interaction Attention

CSANet: Cuboid-Wise Shape Augmentation 3D Object Detector for Occluded Targets

S$^{2}$CNet: Semantic and Structure Completion Network for 3D Object Detection

Three-dimensional Object Detection Network Based on Geometric Information Supplement Strategy

SIEV-Net: A Structure-Information Enhanced Voxel Network for 3D Object Detection From LiDAR Point Clouds

SAANet: Spatial Adaptive Alignment Network for Object Detection in Automatic Driving

SASAN: Shape-Adaptive Set Abstraction Network for Point-Voxel 3D Object Detection.

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

Improving 3D Object Detection with Channel-wise Transformer

Semantic-Context Graph Network for Point-based 3D Object Detection

Scanet: Spatial-Channel Attention Network For 3d Object Detection

3D OBJECT DETECTION NETWORK COMBINED WITH POINT CLOUD COMPLETION

MSIT-Det: Multi-Scale Feature Aggregation with Iterative Transformer Networks for 3D Object Detection

Structure Aware Single-Stage 3D Object Detection From Point Cloud

Spatial and Semantic Information Enhancement for Indoor 3D Object Detection

3D IoU-Net: IoU Guided 3D Object Detector for Point Clouds

Spatial Awareness Enhancement Based Single-Stage Anchor-Free 3D Object Detection for Autonomous Driving

SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism