Abstract:There have been two streams in the 3D detection from point clouds: single-stage methods and two-stage methods. While the former is more computationally efficient, the latter usually provides better detection accuracy. By carefully examining the two-stage approaches, we have found that if appropriately designed, the first stage can produce accurate box regression. In this scenario, the second stage mainly rescores the boxes such that the boxes with better localization get selected. From this observation, we have devised a single-stage anchor-free network that can fulfill these requirements. This network, named AFDetV2, extends the previous work by incorporating a self-calibrated convolution block in the backbone, a keypoint auxiliary supervision, and an IoU prediction branch in the multi-task head. We take a simple product of the predicted IoU score with the classification heatmap to form the final classification confidence. The enhanced backbone strengthens the box localization capability, and the rescoring approach effectively joins the object presence confidence and the box regression accuracy. As a result, the detection accuracy is drastically boosted in the single-stage. To evaluate our approach, we have conducted extensive experiments on the Waymo Open Dataset and the nuScenes Dataset. We have observed that our AFDetV2 achieves the state-of-the-art results on these two datasets, superior to all the prior arts, including both the single-stage and the two-stage 3D detectors. AFDetV2 won the 1st place in the Real-Time 3D Detection of the Waymo Open Dataset Challenge 2021. In addition, a variant of our model AFDetV2-Base was entitled the "Most Efficient Model" by the Challenge Sponsor, showing a superior computational efficiency. To demonstrate the generality of this single-stage method, we have also applied it to the first stage of the two-stage networks. Without exception, the results show that with the strengthened backbone and the rescoring approach, the second stage refinement is no longer needed.

Guided Refine-Head For Object Detection

Single-Shot Refinement Neural Network for Object Detection

RefineDetLite: A Lightweight One-stage Object Detection Framework for CPU-only Devices

Auxiliary Detection Head for One-Stage Object Detection

RESC: REfine the SCore with Adaptive Transformer Head for End-to-end Object Detection

Light-Head R-CNN: In Defense of Two-Stage Object Detector

RefineFace: Refinement Neural Network for High Performance Face Detection

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection

D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinement

Improve Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient Detectors.

Improvement of Classification in One-Stage Detector

AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Clouds

Exploring Context Information for Accurate and Fast Object Detection

A Multistage Refinement Network for Salient Object Detection

Prediction-Guided Distillation for Dense Object Detection

Decoupled Classification Refinement: Hard False Positive Suppression for Object Detection

Distilling Object Detectors With Fine-Grained Feature Imitation

Suppress-and-Refine Framework for End-to-End 3D Object Detection

Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training

Image Processing: Facilitating Retinanet for Detecting Small Objects

Comprehensive Feature Enhancement Module For Single-Shot Object Detector