Abstract:Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers. (c) 2020 Elsevier B.V. All rights reserved. Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers.

ATCC: Accurate tracking by criss-cross location attention

SCATT: Transformer tracking with symmetric cross-attention

TICNet: A Target-Insight Correlation Network for Object Tracking

Adaptive distractor-aware for siamese tracking via enhancement confidence evaluator

Target-Aware Tracking with Long-term Context Attention

When Correlation Filters Meet Siamese Networks for Real-Time Complementary Tracking.

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Toward Accurate Pixelwise Object Tracking via Attention Retrieval

CRTrack: Learning Correlation-Refine network for visual object tracking

CSART: Channel and Spatial Attention-Guided Residual Learning for Real-Time Object Tracking.

Correlation filter tracking algorithm based on spatial-temporal regularization and context awareness

Distillation, Ensemble and Selection for building a Better and Faster Siamese based Tracker

Distractor-aware visual tracking using hierarchical correlation filters adaptive selection

Correlation Filter Tracker with Siamese: A Robust and Real-Time Object Tracking Framework.

Improved C-COT based on feature channels confidence for visual tracking

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Accurate target estimation with image contents for visual tracking

CMAT: Integrating Convolution Mixer and Self-Attention for Visual Tracking

SiamRCSC: Robust siamese network with channel and spatial constraints for visual object tracking

Accurate 3D Single Object Tracker With Local-to-Global Feature Refinement

CorrFormer: Context-aware tracking with cross-correlation and transformer