Abstract:Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers. (c) 2020 Elsevier B.V. All rights reserved. Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers.

Dual Attention Mechanism Object Tracking Algorithm Based on Fully-convolutional Siamese Network

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

Siamese Tracking Network with Multi-attention Mechanism

SiamCAM: A Real-Time Siamese Network for Object Tracking with Compensating Attention Mechanism

Object-Aware Adaptive Convolution Kernel Attention Mechanism in Siamese Network for Visual Tracking

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Siamese Network Object Tracking Algorithm Combining Attention Mechanism and Correlation Filter Theory

Target Tracking Algorithm Based on Siamese Network of Feature Optimization Model

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Improved Fully Convolutional Siamese Networks for Visual Object Tracking Based on Response Behaviour Analysis.

Siamese Tracking Network with Spatial-Semantic-Aware Attention and Flexible Spatiotemporal Constraint

Adaptive Multi-Feature Fusion Visual Target Tracking Based on Siamese Neural Network with Cross-Attention Mechanism

Visual Tracking With Siamese Network Based on Fast Attention Network

Enhancement: SiamFC Tracker Algorithm Performance Based on Convolutional Hyperparameters Optimization and Low Pass Filter

CTT: CNN Meets Transformer for Tracking

Siamese Attentive Graph Tracking.

Evolution of Siamese Visual Tracking with Slot Attention

Graph Attention Tracking

CSART: Channel and Spatial Attention-Guided Residual Learning for Real-Time Object Tracking.

SiamAtt: Siamese Attention Network for Visual Tracking.