Abstract:Siamese networks have found applications in various fields, notably object tracking, due to their remarkable speed and accuracy. Siamese tracking networks rely on cross-correlation to obtain the similarity score between the target template and the search region. However, since cross-correlation is a local matching operation, it cannot effectively capture the global context information. While the Transformer for feature fusion can better capture long-range dependencies and obtain more semantic information, more localized edge information is needed to distinguish the target from the background. Cross-correlation fusion and Transformer fusion have their advantages. They can complement each other, so we combine them and propose a dual feature fusion tracker (SiamCT) to obtain the local correlations and global dependencies between the target and the search region. Specifically, we construct two parallel feature fusion paths based on cross-correlation and Transformer. Among them, for cross-correlation fusion, we adopt the more efficient two-dimension pixel-wise cross-correlation (TDPC), which performs correlation operations from both spatial and channel dimensions, and the interaction of multidimensional information helps to realize more accurate feature fusion. Subsequently, the fused features are augmented by coordinate attention (CA) for orientation-dependent positional information. For Transformer fusion, we introduce cos-based linear attention(ClA) to improve Transformer’s ability to acquire global context information. Our SiamCT outperforms existing leading methods in GOT-10k, LaSOT, TrackingNet, and OTB100 benchmarks based on extensive experiments. In particular, the AO score on the GOT-10k benchmark is 70.6%, and the ${SR_{0.5}}$ and ${SR_{0.75}}$ scores are 80.5%, 65.9%, respectively, achieving state-of-the-art performance.

Mutual Learning and Feature Fusion Siamese Networks for Visual Object Tracking

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

Siamese Network with Multi-Scale Fusion Attention for Visual Tracking

Siamese Network Based Features Fusion For Adaptive Visual Tracking

Learning Spatial Fusion and Matching for Visual Object Tracking.

Anchor-free Siamese Network Based on Visual Tracking

End-to-end Feature Fusion Siamese Network for Adaptive Visual Tracking.

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

Siamese-Based Twin Attention Network for Visual Tracking

Visual Tracking Based on Siamese Network of Fused Score Map

SiamCCF: Siamese Visual Tracking Via Cross‐layer Calibration Fusion

Learning Siamese Network with Top-Down Modulation for Visual Tracking

Multiple Convolutional Features in Siamese Networks for Object Tracking

Fully Convolutional Siamese Fusion Networks for Object Tracking

Siamese Tracking Network with Multi-attention Mechanism

Deep Adaptive Discriminate Siamese Network with Multi-Level Response for Visual Object Tracking

Hyper-Siamese Network for Robust Visual Tracking

Dual Feature Fusion Tracking with Combined Cross-Correlation and Transformer

Deep Feature Based Siamese Network for Visual Object Tracking

CTT: CNN Meets Transformer for Tracking

Adaptive Multi-Feature Fusion Visual Target Tracking Based on Siamese Neural Network with Cross-Attention Mechanism