Abstract:Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers. (c) 2020 Elsevier B.V. All rights reserved. Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers.

Spatial graph attention network-based object tracking with adaptive cosine window

SiamSGA: Siamese Symmetric Graph Attention Tracking

Graph Attention Tracking

Graph Attention Network for Context-Aware Visual Tracking

Object Tracking Based on Siamese Network with 3D Attention and Multiple Graph Attention

Siamese Graph Attention Networks for Robust Visual Object Tracking.

Siamese Network with Multi-Scale Fusion Attention for Visual Tracking

Siamese anchor-free object tracking with multiscale spatial attentions

Siamese Tracking Network with Spatial-Semantic-Aware Attention and Flexible Spatiotemporal Constraint

SGAT: Shuffle and graph attention based Siamese networks for visual tracking

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

SiamCAM: A Real-Time Siamese Network for Object Tracking with Compensating Attention Mechanism

Tracking by Joint Local and Global Search: A Target-Aware Attention-Based Approach

Siamese-Based Twin Attention Network for Visual Tracking

Siamese Tracking Network with Multi-attention Mechanism

CSART: Channel and Spatial Attention-Guided Residual Learning for Real-Time Object Tracking.

Spatial and Channel Attention Mechanism Method for Object Tracking

Siamese Attentive Graph Tracking.

Central Attention with Sliding Window for Efficient Visual Tracking

A Spatial-Aware Tracker