SAFE: Simultaneous Alignment of Features and Predictions for Dense Object Detectors

Xuesong Guo,Shuo Wang,Jiahao Chang,Zehui Chen,Feng Zhao
DOI: https://doi.org/10.1109/ICME55011.2023.00060
2023-01-01
Abstract:Dense detectors have gained increasing attention due to their simplicity and efficiency. However, there are two inherent misalignments lying in the one-stage architecture that greatly inhibit the performance. One is the misalignment between features and predicted boxes, the other is the spatial prediction misalignment between classification and regression branches. In this work, we propose a Simultaneous Alignment of Features and prEdictions (SAFE) for dense object detectors to mitigate both issues. Regarding of the misalignment between features and corresponding boxes, we design an Adaptive Feature Alignment module that leverages the location information to align features in the classification branch. As for the inconsistency of spatial prediction, we introduce a Weighted Average of Predictions module to refine the predicted sub-optimal coordinates by autonomously selecting higher-quality predicted ones in the surrounding area. Extensive experiments validate the persistent improvement of our approach. Our best model SAFE-S achieves state-of-the-art performance (56.5 mAP) on MS-COCO.
What problem does this paper attempt to address?