Abstract:Accurate and fast 3D object detection from point clouds is a key task in autonomous driving. Existing one-stage 3D object detection methods can achieve real-time performance, however, they are dominated by anchor-based detectors which are inefficient and require additional post-processing. In this paper, we eliminate anchors and model an object as a single point—the center point of its bounding box. Based on the center point, we propose an anchor-free CenterNet3D network that performs 3D object detection without anchors. Our CenterNet3D uses keypoint estimation to find center points and directly regresses 3D bounding boxes. However, because inherent sparsity of point clouds, 3D object center points are likely to be in empty space which makes it difficult to estimate accurate boundaries. To solve this issue, we propose an extra corner attention module to enforce the CNN backbone to pay more attention to object boundaries. Besides, considering that one-stage detectors suffer from the discordance between the predicted bounding boxes and corresponding classification confidences, we develop an efficient keypoint-sensitive warping operation to align the confidences to the predicted bounding boxes. Our proposed CenterNet3D is non-maximum suppression free which makes it more efficient and simpler. We evaluate CenterNet3D on the widely used KITTI dataset and more challenging nuScenes dataset. Our method outperforms all state-of-the-art anchor-based one-stage methods and has comparable performance to two-stage methods as well. It has an inference speed of 20 FPS and achieves the best speed and accuracy trade-off. Our source code will be released at https://github.com/wangguojun2018/CenterNet3d.

Real-time 3D Object Detection Using Improved Convolutional Neural Network Based on Image-driven Point Cloud

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

Accurate and Real-Time Object Detection Based on Bird's Eye View on 3D Point Clouds

GridNet-3D:A Novel Real-Time 3D Object Detection Algorithm Based on Point Cloud

Real-Time Object Detection Using Efficient Convolutional Networks.

GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network

Improved Point-Voxel Region Convolutional Neural Network: 3D Object Detectors for Autonomous Driving

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

A 3D Convolutional Neural Network Towards Real-Time Amodal 3D Object Detection.

Real-Time Point Cloud Object Detection via Voxel-Point Geometry Abstraction

Structure Aware Single-Stage 3D Object Detection From Point Cloud

P2V-RCNN: Point to Voxel Feature Learning for 3D Object Detection From Point Clouds

A Hierarchical Graph Network for 3D Object Detection on Point Clouds

FVNet: 3D Front-View Proposal Generation for Real-Time Object Detection from Point Clouds

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud

3D Point Cloud Target Detection Method Based on R-PointGNN

Real-Time Semantic Segmentation of Point Clouds Based on an Attention Mechanism and a Sparse Tensor

CenterNet3D: An Anchor Free Object Detector for Point Cloud

FasterV-RCNN: Efficient Point Cloud 3D Object Detection Framework

One-Stage Multi-Sensor Data Fusion Convolutional Neural Network For 3d Object Detection