Abstract:Advanced Siamese visual object tracking architectures are jointly trained using pair-wise input images to perform target classification and bounding box regression. They have achieved promising results in recent benchmarks and competitions. However, the existing methods suffer from two limitations: First, though the Siamese structure can estimate the target state in an instance frame, provided the target appearance does not deviate too much from the template, the detection of the target in an image cannot be guaranteed in the presence of severe appearance variations. Second, despite the classification and regression tasks sharing the same output from the backbone network, their specific modules and loss functions are invariably designed independently, without promoting any interaction. Yet, in a general tracking task, the centre classification and bounding box regression tasks are collaboratively working to estimate the final target location. To address the above issues, it is essential to perform target-agnostic detection so as to promote cross-task interactions in a Siamese-based tracking framework. In this work, we endow a novel network with a target-agnostic object detection module to complement the direct target inference, and to avoid or minimise the misalignment of the key cues of potential template-instance matches. To unify the multi-task learning formulation, we develop a cross-task interaction module to ensure consistent supervision of the classification and regression branches, improving the synergy of different branches. To eliminate potential inconsistencies that may arise within a multi-task architecture, we assign adaptive labels, rather than fixed hard labels, to supervise the network training more effectively. The experimental results obtained on several benchmarks, i.e., OTB100, UAV123, VOT2018, VOT2019, and LaSOT, demonstrate the effectiveness of the advanced target detection module, as well as the cross-task interaction, exhibiting superior tra- king performance as compared with the state-of-the-art tracking methods.

End-to-end multitask Siamese network with residual hierarchical attention for real-time object tracking

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

SiamOHOT: A Lightweight Dual Siamese Network for Onboard Hyperspectral Object Tracking Via Joint Spatial-Spectral Knowledge Distillation

Multitarget Tracking Using Siamese Neural Networks

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

Residual Attention SiameseRPN for Visual Tracking

Siamese Residual Network for Efficient Visual Tracking

Learning reinforced attentional representation for end-to-end visual tracking

Hierarchical correlation siamese network for real-time object tracking

Multi-Stream Siamese and Faster Region-Based Neural Network for Real-Time Object Tracking

Siamese Tracking Network with Spatial-Semantic-Aware Attention and Flexible Spatiotemporal Constraint

SiamCAM: A Real-Time Siamese Network for Object Tracking with Compensating Attention Mechanism

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Siamese-Based Attention Learning Networks for Robust Visual Object Tracking

Siamese Network Object Tracking Algorithm Combining Attention Mechanism and Correlation Filter Theory

Object-Aware Adaptive Convolution Kernel Attention Mechanism in Siamese Network for Visual Tracking

Real-time object tracking in the wild with Siamese network

Siamese Tracking Network with Multi-attention Mechanism

Mutual Learning and Feature Fusion Siamese Networks for Visual Object Tracking

Toward Robust Visual Object Tracking With Independent Target-Agnostic Detection and Effective Siamese Cross-Task Interaction

Hierarchical Spatial-aware Siamese Network for Thermal Infrared Object Tracking