Abstract:Conducting reliable feature interaction plays a critical role in the visual tracking community, especially in recent dominated Siamese-based tracking paradigm. In general, there are two primary approaches for fusing representations from template and search area in the Siamese setting, i.e. , cross-correlation and transformer modeling. The former provides a straightforward interaction solution, which may have limitations in handling complex scenarios, such as appearance variations and occlusion. While the latter offers an effective interaction mechanism, albeit with higher computation complexity and model cost. In contrast to traditional Siamese-based trackers which rely on two mentioned feature cross-correlation operators, this paper proposes a novel Correlation-Refine network to address the issue of lacking semantic information caused by local linear matching in correlation, from both spatial and channel perspectives. Correlation-Refine network (named CR) is solely built on top of fully convolutional layers, without employing intricate transformer mechanisms or complex methods to fuse features from multiple scales. Moreover, we present a concise yet effective convolutional tracking framework based on the correlation-refine network. CR network can increase the discriminative ability of semantic information in a coarse-to-fine manner: it gradually learns the semantic features of the target to be tracked and suppresses interference from similar objects by stacking multiple CR layers. Extensive experiments and comparisons with recent competitive trackers in challenging large-scale benchmarks demonstrate that, our tracker outperforms all previous convolutional trackers and has competitive results with transformer-based method. The code will be made available.

Efficient correlation information mixer for visual object tracking

High-speed Tracking with Multi-Templates Correlation Filters

Collaborative Correlation Filters for Real-Time Tracking with Spatial Constraint.

Robust Estimation of Similarity Transformation for Visual Object Tracking

CRTrack: Learning Correlation-Refine network for visual object tracking

SCSTCF: Spatial-Channel Selection and Temporal Regularized Correlation Filters for visual tracking

SiamS3C: spatial-channel cross-correlation for visual tracking with centerness-guided regression

Learning Temporal-Correlated and Channel- Decorrelated Siamese Networks for Visual Tracking

A Scale Adaptive Kernel Correlation Filter Tracker With Feature Integration

An object tracking framework with recapture based on correlation filters and Siamese networks

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

A novel kernelized correlation filter by fusing multiple feature response maps, enhanced target re-detection, and improved model updating for visual tracking

Visual Tracking with Long-Short Term Based Correlation Filter

CorrFormer: Context-aware tracking with cross-correlation and transformer

Multi-hierarchical Independent Correlation Filters for Visual Tracking

Visual object tracking with discriminative correlation filtering and hybrid color feature

A Collaborative Visual Tracking Architecture for Correlation Filter and Convolutional Neural Network Learning

Correlation Filters Based on Multi-Expert and Game Theory for Visual Object Tracking

SiamCMN: Jointing Cycle Memory and Correlation Network for Siamese Object Tracking

Multi-cue Correlation Filters for Robust Visual Tracking

A Hybrid Visual Tracking Algorithm Based on SOM Network and Correlation Filter