Abstract:There have been two streams in the 3D detection from point clouds: single-stage methods and two-stage methods. While the former is more computationally efficient, the latter usually provides better detection accuracy. By carefully examining the two-stage approaches, we have found that if appropriately designed, the first stage can produce accurate box regression. In this scenario, the second stage mainly rescores the boxes such that the boxes with better localization get selected. From this observation, we have devised a single-stage anchor-free network that can fulfill these requirements. This network, named AFDetV2, extends the previous work by incorporating a self-calibrated convolution block in the backbone, a keypoint auxiliary supervision, and an IoU prediction branch in the multi-task head. We take a simple product of the predicted IoU score with the classification heatmap to form the final classification confidence. The enhanced backbone strengthens the box localization capability, and the rescoring approach effectively joins the object presence confidence and the box regression accuracy. As a result, the detection accuracy is drastically boosted in the single-stage. To evaluate our approach, we have conducted extensive experiments on the Waymo Open Dataset and the nuScenes Dataset. We have observed that our AFDetV2 achieves the state-of-the-art results on these two datasets, superior to all the prior arts, including both the single-stage and the two-stage 3D detectors. AFDetV2 won the 1st place in the Real-Time 3D Detection of the Waymo Open Dataset Challenge 2021. In addition, a variant of our model AFDetV2-Base was entitled the "Most Efficient Model" by the Challenge Sponsor, showing a superior computational efficiency. To demonstrate the generality of this single-stage method, we have also applied it to the first stage of the two-stage networks. Without exception, the results show that with the strengthened backbone and the rescoring approach, the second stage refinement is no longer needed.

A Double Stream Module in Backbone for Object Detection Network

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

Double-stream atrous network for shadow detection

DSFD: Dual Shot Face Detector

Feature-enhanced composite backbone network for object detection

CBNet: A Composite Backbone Network Architecture for Object Detection

BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network

Boosting 3D Object Detection with Semantic-Aware Multi-Branch Framework

DSAFF-Net: A Backbone Network Based on Mask R-CNN for Small Object Detection

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

RCNet: Reverse Feature Pyramid and Cross-scale Shift Network for Object Detection

A Rich Feature Fusion Single-Stage Object Detector.

Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection

Rethinking feature aggregation for deep RGB-D salient object detection

TDFSSD: Top-Down Feature Fusion Single Shot MultiBox Detector

RelationNet++: Bridging Visual Representations for Object Detection via Transformer Decoder

DPSSD: Dual-Path Single-Shot Detector

A Single Stream Network for Robust and Real-Time RGB-D Salient Object Detection

AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Clouds

Beyond Skip Connections: Top-Down Modulation for Object Detection