Abstract:3D object detection from LiDAR point clouds is a challenging task, since the point clouds are irregular and sparse. Existing one-stage methods mainly predict the 3D bounding box of 3D objects by extracting deep down-scaled features of point clouds from low-level (high-resolution, HR) feature maps to high-level (low-resolution, LR). Nonetheless, most of these methods ignore geometric context information of the down-scaled feature maps across scales, especially only using the LR feature will result in incomplete structure and less location accuracy of 3D objects. In this paper, we propose a novel cross-scale graph network-based one-stage 3D object detector to fully exploit the geometric contexts of the voxels between the down-scaled feature maps. Specifically, we first employ a 3D sparse convolution neural network to form different resolutions of feature maps of voxels. We then dynamically construct a cross-scale bilateral graph to search the neighbor non-empty voxels in the HR feature map with a fixed radius for each non-empty voxel in the LR feature map. In the constructed graph, we present a bilateral attention mechanism (i.e., self-attention and spatial attention) in the HR feature map and encode each non-empty voxel in the LR feature map by aggregating the HR features to obtain the attention features. In addition, we design a non-local part pooling operation to improve the score of the detected bounding box of 3D objects. Finally, we formulate a multi-task loss to train our network for regression of the 3D bounding box of the 3D objects. Experiments on the challenging KITTI's 3D/BEV benchmark show that our proposed detector outperforms all one-stage 3D object detectors and is comparable to two-stage 3D object detectors. Our code is available at https://github.com/csjxchen/CBi-GNN.

GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network

A Hierarchical Graph Network for 3D Object Detection on Point Clouds

Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud

SVGA-Net: Sparse Voxel-Graph Attention Network for 3D Object Detection from Point Clouds

GUPNet++: Geometry Uncertainty Propagation Network for Monocular 3D Object Detection

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

HEDNet: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Clouds

CenterNet3D: An Anchor Free Object Detector for Point Cloud

REGNet: Ray-Based Enhancement Grouping for 3D Object Detection Based on Point Cloud

CBi-GNN: Cross-Scale Bilateral Graph Neural Network for 3D Object Detection

Real-Time Point Cloud Object Detection via Voxel-Point Geometry Abstraction

PVGNet: A Bottom-Up One-Stage 3D Object Detector with Integrated Multi-Level Features

Geometry Uncertainty Projection Network for Monocular 3D Object Detection

GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimation

CenterNet3D: An Anchor free Object Detector for Autonomous Driving.

FVNet: 3D Front-View Proposal Generation for Real-Time Object Detection from Point Clouds

Semantic-Context Graph Network for Point-based 3D Object Detection

SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism

VirPNet: A Multimodal Virtual Point Generation Network for 3D Object Detection

Deep 3D point cloud classification and segmentation network based on GateNet