Abstract:In the field of computer vision, general single-stage object detection methods employ two individual subnets within detection head, serving classification and localization purposes respectively. However, the lack of explicit modeling for distinctions and associations poses challenges for aligning the spatial feature perception of these two tasks, consequently leading to sub-optimal detection performance. Although some methods utilize classification to evaluate localization, it is a compromise rather than multi-task optimization. In this paper, we propose a Task-coordinated Single-stage Object Detector (TSOD) to enhance the coordination of multiple tasks. Firstly, we introduce a Task-decoupled Feature Alignment Mechanism (TFAM), which adaptively provides compatible features for different tasks by decoupling spatial information. For classification and localization, the network adaptively samples from category-sensitive regions and boundary-separable regions, respectively. Secondly, we propose a Task-interactive Enhancement Mechanism (TEM), which explicitly combines different task-sensitive features for joint classification score prediction and selects samples with high task consistency for training. Through this interaction mechanism, consistency between tasks is bolstered. We conduct extensive experiments on the COCO, Cityscapes, CrowdHuman and WiderFace datasets to evaluate the performance of TSOD. The results demonstrate that our model outperforms several state-of-the-art detectors, achieving a 2.0 AP improvement over the baseline on COCO minival and a remarkable 50.4 AP at single-model single-scale testing on COCO test-dev. Additionally, our model, equipped with ResNet-50, performs significantly better than other representative detectors on the Cityscapes, CrowdHuman, and WiderFace datasets, showcasing its robustness and generalizability. Our study contributes a new perspective to the design of single-stage object detectors by emphasizing the importance of decoupling and interaction, which is crucial for task coordination. The experimental results validate the effectiveness of our proposed TSOD and its potential as a leading approach in the field. Codes are available at https://github.com/Majiawei/tsod-complete .

Object Correlation Matrix for Two-Stage Object Detection Network

One-stage Object Detection with Graph Convolutional Networks

Feature Transform Correlation Network for Object Detection.

Global Correlation Network: End-to-End Joint Multi-Object Detection and Tracking

Feature Correlation-Steered Capsule Network for Object Detection.

IoU-aware Single-stage Object Detector for Accurate Localization

Co-occurrence matrix analysis-based semi-supervised training for object detection

Global Contextual Dependency Network for Object Detection

Learning Correlation for Online Multiple Object Tracking.

Multiple Scale Canonical Correlation Analysis Networks For Two-View Object Recognition

MatrixNets: A New Scale and Aspect Ratio Aware Architecture for Object Detection

Corner Proposal Network for Anchor-Free, Two-Stage Object Detection

Multi-Correlation Siamese Transformer Network with Dense Connection for 3D Single Object Tracking

Multi-scale Context Enhancement Network for Object Detection

Decoupling and Interaction: Task Coordination in Single-Stage Object Detection

Correlation-Aware Deep Tracking

Global-and-Local Collaborative Learning for Co-Salient Object Detection

Co-Occurring of Object Detection and Identification towards unlabeled object discovery

Multi-scale coupled attention for visual object detection

Relation Networks for Object Detection

Single Stage Class Agnostic Common Object Detection: A Simple Baseline