Abstract:In the field of computer vision, general single-stage object detection methods employ two individual subnets within detection head, serving classification and localization purposes respectively. However, the lack of explicit modeling for distinctions and associations poses challenges for aligning the spatial feature perception of these two tasks, consequently leading to sub-optimal detection performance. Although some methods utilize classification to evaluate localization, it is a compromise rather than multi-task optimization. In this paper, we propose a Task-coordinated Single-stage Object Detector (TSOD) to enhance the coordination of multiple tasks. Firstly, we introduce a Task-decoupled Feature Alignment Mechanism (TFAM), which adaptively provides compatible features for different tasks by decoupling spatial information. For classification and localization, the network adaptively samples from category-sensitive regions and boundary-separable regions, respectively. Secondly, we propose a Task-interactive Enhancement Mechanism (TEM), which explicitly combines different task-sensitive features for joint classification score prediction and selects samples with high task consistency for training. Through this interaction mechanism, consistency between tasks is bolstered. We conduct extensive experiments on the COCO, Cityscapes, CrowdHuman and WiderFace datasets to evaluate the performance of TSOD. The results demonstrate that our model outperforms several state-of-the-art detectors, achieving a 2.0 AP improvement over the baseline on COCO minival and a remarkable 50.4 AP at single-model single-scale testing on COCO test-dev. Additionally, our model, equipped with ResNet-50, performs significantly better than other representative detectors on the Cityscapes, CrowdHuman, and WiderFace datasets, showcasing its robustness and generalizability. Our study contributes a new perspective to the design of single-stage object detectors by emphasizing the importance of decoupling and interaction, which is crucial for task coordination. The experimental results validate the effectiveness of our proposed TSOD and its potential as a leading approach in the field. Codes are available at https://github.com/Majiawei/tsod-complete .

Combining Different Interesting Point Detectors for Object Categorization

Inference Fusion with Associative Semantics for Unseen Object Detection

Creating Efficient Visual Codebook Ensembles for Object Categorization

Constructing Vocabulary Ensembles by Different Clustering Algorithms for Object Categorization

Ensemble of Part Detectors for Simultaneous Classification and Localization.

Combining different visual vocabularies with different sizes for image categorization

Combining generic and class-specific codebooks for object categorization and detection

Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding

Evaluating Feature Combination in Object Classification.

Category Aggregation Among Region Proposals for Object Detection.

LCNet: Location Combination for Object Detection.

Improvements in image categorization using codebook ensembles

Decoupling and Interaction: Task Coordination in Single-Stage Object Detection

Mixture Models for Object Detection.

Multiclass Object Detection by Combining Local Appearances and Context

Scene Categorization Through Combining Lbp and Sift Features Effectively

Ensembles of Feature Subspaces for Object Detection

Anno-incomplete Multi-dataset Detection

Branch Aware Assignment for Object Detection

S-CNN: Subcategory-Aware Convolutional Networks for Object Detection

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement