Abstract:There have been two streams in the 3D detection from point clouds: single-stage methods and two-stage methods. While the former is more computationally efficient, the latter usually provides better detection accuracy. By carefully examining the two-stage approaches, we have found that if appropriately designed, the first stage can produce accurate box regression. In this scenario, the second stage mainly rescores the boxes such that the boxes with better localization get selected. From this observation, we have devised a single-stage anchor-free network that can fulfill these requirements. This network, named AFDetV2, extends the previous work by incorporating a self-calibrated convolution block in the backbone, a keypoint auxiliary supervision, and an IoU prediction branch in the multi-task head. We take a simple product of the predicted IoU score with the classification heatmap to form the final classification confidence. The enhanced backbone strengthens the box localization capability, and the rescoring approach effectively joins the object presence confidence and the box regression accuracy. As a result, the detection accuracy is drastically boosted in the single-stage. To evaluate our approach, we have conducted extensive experiments on the Waymo Open Dataset and the nuScenes Dataset. We have observed that our AFDetV2 achieves the state-of-the-art results on these two datasets, superior to all the prior arts, including both the single-stage and the two-stage 3D detectors. AFDetV2 won the 1st place in the Real-Time 3D Detection of the Waymo Open Dataset Challenge 2021. In addition, a variant of our model AFDetV2-Base was entitled the "Most Efficient Model" by the Challenge Sponsor, showing a superior computational efficiency. To demonstrate the generality of this single-stage method, we have also applied it to the first stage of the two-stage networks. Without exception, the results show that with the strengthened backbone and the rescoring approach, the second stage refinement is no longer needed.

Overview of Two-Stage Object Detection Algorithms

Probabilistic two-stage detection

AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Clouds

A Survey of Deep Learning-based Object Detection

Light-Head R-CNN: In Defense of Two-Stage Object Detector

Accurate Single Stage Detector Using Recurrent Rolling Convolution

Object detection using YOLO: challenges, architectural successors, datasets and applications

Revisiting Faster R-Cnn: A Deeper Look At Region Proposal Network

A review of object detection: Datasets, performance evaluation, architecture, applications and current trends

A Survey of Object Detection Models Based on Deep Learning

Comprehensive Feature Enhancement Module For Single-Shot Object Detector

Condensing Two-stage Detection with Automatic Object Key Part Discovery

An improved deep learning-based optimal object detection system from images

Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training

A Comparative Analysis of Modern Object Detection Algorithms: YOLO vs. SSD vs. Faster R-CNN

Cascade R-CNN: Delving into High Quality Object Detection

Corner Proposal Network for Anchor-Free, Two-Stage Object Detection

Towards Discriminative and Transferable One-Stage Few-Shot Object Detectors

Parallel Cascade R-CNN for Object Detection in Remote Sensing Imagery

Oriented R-CNN for Object Detection

Recent advances in deep learning for object detection