Abstract:Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers. (c) 2020 Elsevier B.V. All rights reserved. Siamese networks have achieved great success in object tracking due to the balance of precision and speed. However, Siamese trackers usually utilize the local feature of the last layer, which may degrade tracking performance in some difficult scenarios. In this paper, we propose a novel Channel and Spatial Attention-guided Residual learning framework for Tracking, referred to as CSART, which can improve feature representation of Siamese networks by exploiting self-attention mechanism to capture powerful contextual information. Specifically, to be efficient and seamless integration, different kinds of self-attention are appended on the template and search branches of Siamese networks respectively, that model global semantic inter-dependencies in channel and spatial dimensions. To avoid representation degradation, we consider to adaptively aggregate basic feature and its attention-weighted features with residual learning. Furthermore, a joint loss consisting of classic logistic loss as well as focal softmax loss is designed to emphasize difficult samples and guide the learning process of the whole model. Benefiting from the above scheme, CSART alleviates the over-fitting problem to some extent and enhances the discriminability. Extensive experiments on six popular tracking datasets indicate that the proposed tracker achieves better performance with a speed of 65 fps than other state-of-the-art trackers.

Adaptive Update Siamese Network Tracking Algorithm with Efficient Channel Attention

An Improved Siamese Tracking Network Based on Self-Attention and Cross-Attention

Siamese Network with Multi-Scale Fusion Attention for Visual Tracking

SiamDA: Dual Attention Siamese Network for Real-Time Visual Tracking

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

SiamRAAN: Siamese Residual Attentional Aggregation Network for Visual Object Tracking

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

Siamese Visual Tracking with Dual-Pipeline Correlated Fusion Network

Siamese Centerness Prediction Network for Real-Time Visual Object Tracking

SiamAPN++: Siamese Attentional Aggregation Network for Real-Time UAV Tracking

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Adaptive distractor-aware for siamese tracking via enhancement confidence evaluator

Siamese Tracking Network with Spatial-Semantic-Aware Attention and Flexible Spatiotemporal Constraint

ACSiamRPN: Adaptive Context Sampling for Visual Object Tracking

Siamese Block Attention Network for Online Update Object Tracking

Visual Tracking With Siamese Network Based on Fast Attention Network

CSART: Channel and Spatial Attention-Guided Residual Learning for Real-Time Object Tracking.

Target Tracking Based on SE-CNN and SiameseNet

Deformable Siamese Attention Networks for Visual Object Tracking

A Novel Target Tracking Scheme Based on Attention Mechanism in Complex Scenes

Siamese Tracking Network with Multi-attention Mechanism