Abstract:Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers. (c) 2020 Elsevier B.V. All rights reserved. Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers.

Spatial and Channel Attention Mechanism Method for Object Tracking

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

Siamese anchor-free object tracking with multiscale spatial attentions

Tracking by Joint Local and Global Search: A Target-Aware Attention-Based Approach

CSART: Channel and Spatial Attention-Guided Residual Learning for Real-Time Object Tracking.

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Online Multi-Object Tracking Using CNN-based Single Object Tracker with Spatial-Temporal Attention Mechanism

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Learning Transform-Aware Attentive Network for Object Tracking

Spatial graph attention network-based object tracking with adaptive cosine window

Siamese Network Object Tracking Algorithm Combining Attention Mechanism and Correlation Filter Theory

Siamese Tracking Network with Multi-attention Mechanism

Exploiting Weak Mask Representation with Convolutional Neural Networks for Accurate Object Tracking.

Object-Aware Adaptive Convolution Kernel Attention Mechanism in Siamese Network for Visual Tracking

SiamRCSC: Robust siamese network with channel and spatial constraints for visual object tracking

Online Tracking With Convolutional Neural Networks

Object Tracking Using Local Multiple Features And A Posterior Probability Measure

Learning Spatial-Frequency Transformer for Visual Object Tracking

Target Tracking Algorithm Based on Siamese Network of Feature Optimization Model