Abstract:Siamese networks have found applications in various fields, notably object tracking, due to their remarkable speed and accuracy. Siamese tracking networks rely on cross-correlation to obtain the similarity score between the target template and the search region. However, since cross-correlation is a local matching operation, it cannot effectively capture the global context information. While the Transformer for feature fusion can better capture long-range dependencies and obtain more semantic information, more localized edge information is needed to distinguish the target from the background. Cross-correlation fusion and Transformer fusion have their advantages. They can complement each other, so we combine them and propose a dual feature fusion tracker (SiamCT) to obtain the local correlations and global dependencies between the target and the search region. Specifically, we construct two parallel feature fusion paths based on cross-correlation and Transformer. Among them, for cross-correlation fusion, we adopt the more efficient two-dimension pixel-wise cross-correlation (TDPC), which performs correlation operations from both spatial and channel dimensions, and the interaction of multidimensional information helps to realize more accurate feature fusion. Subsequently, the fused features are augmented by coordinate attention (CA) for orientation-dependent positional information. For Transformer fusion, we introduce cos-based linear attention(ClA) to improve Transformer’s ability to acquire global context information. Our SiamCT outperforms existing leading methods in GOT-10k, LaSOT, TrackingNet, and OTB100 benchmarks based on extensive experiments. In particular, the AO score on the GOT-10k benchmark is 70.6%, and the ${SR_{0.5}}$ and ${SR_{0.75}}$ scores are 80.5%, 65.9%, respectively, achieving state-of-the-art performance.

Staged Depthwise Correlation and Feature Fusion for Siamese Object Tracking

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

DCFNet++: More Advanced Correlation Filters Network for Real-Time Object Tracking

SiamDCFF: Dynamic Cascade Feature Fusion for Vision Tracking

End-to-End Correlation Tracking With Enhanced Multi-Level Feature Fusion

ACSiam: Asymmetric Convolution Structures for Visual Tracking with Siamese Network

Siamese Networks with Discriminant Correlation Filters and Channel Attention.

DCF-ASN: Coarse-to-fine Real-time Visual Tracking via Discriminative Correlation Filter and Attentional Siamese Network

Dual Feature Fusion Tracking with Combined Cross-Correlation and Transformer

When Correlation Filters Meet Siamese Networks for Real-Time Complementary Tracking.

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

Adaptive Weighted CNN Features Integration for Correlation Filter Tracking.

Siamese Network with Multi-Scale Fusion Attention for Visual Tracking

Mutual Learning and Feature Fusion Siamese Networks for Visual Object Tracking

Siamese Visual Tracking with Dual-Pipeline Correlated Fusion Network

Learning Spatial Fusion and Matching for Visual Object Tracking.

Multiple Convolutional Features in Siamese Networks for Object Tracking

CorrFormer: Context-aware tracking with cross-correlation and transformer

Deep Siamese Network with Co-channel and Cr-Spatial Attention for Object Tracking.

End-to-end Feature Fusion Siamese Network for Adaptive Visual Tracking.

Siamese Network Based Features Fusion For Adaptive Visual Tracking