Abstract:Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers. (c) 2020 Elsevier B.V. All rights reserved. Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers.

LSNT: A Lightweight Siamese Network Based Tracker

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

Light Siamese Network for Long-Term Onboard Aerial Tracking

Lightweight Full-Convolutional Siamese Tracker

NCSiam: Reliable Matching Via Neighborhood Consensus for Siamese-Based Object Tracking.

A Spatial-Aware Tracker

Siamese Network Tracking Based on Feature Enhancement

Siamese Tracking Network with Spatial-Semantic-Aware Attention and Flexible Spatiotemporal Constraint

CSART: Channel and Spatial Attention-Guided Residual Learning for Real-Time Object Tracking.

Siamese Tracking Network with Multi-attention Mechanism

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Adaptive Siamese Tracking with a Compact Latent Network

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

Improving Siamese Based Trackers with Light or No Training through Multiple Templates and Temporal Network

Hierarchical correlation siamese network for real-time object tracking

Learning Bi-Grained Cross-Correlation Siamese Networks for Visual Tracking

Local to Global Tracker: A Siamese Network for Long-term Tracking

Learning Deep Lucas-Kanade Siamese Network for Visual Tracking

MFST: Multi-Features Siamese Tracker

Siamese Attentional Keypoint Network for High Performance Visual Tracking