Abstract:Conducting reliable feature interaction plays a critical role in the visual tracking community, especially in recent dominated Siamese-based tracking paradigm. In general, there are two primary approaches for fusing representations from template and search area in the Siamese setting, i.e. , cross-correlation and transformer modeling. The former provides a straightforward interaction solution, which may have limitations in handling complex scenarios, such as appearance variations and occlusion. While the latter offers an effective interaction mechanism, albeit with higher computation complexity and model cost. In contrast to traditional Siamese-based trackers which rely on two mentioned feature cross-correlation operators, this paper proposes a novel Correlation-Refine network to address the issue of lacking semantic information caused by local linear matching in correlation, from both spatial and channel perspectives. Correlation-Refine network (named CR) is solely built on top of fully convolutional layers, without employing intricate transformer mechanisms or complex methods to fuse features from multiple scales. Moreover, we present a concise yet effective convolutional tracking framework based on the correlation-refine network. CR network can increase the discriminative ability of semantic information in a coarse-to-fine manner: it gradually learns the semantic features of the target to be tracked and suppresses interference from similar objects by stacking multiple CR layers. Extensive experiments and comparisons with recent competitive trackers in challenging large-scale benchmarks demonstrate that, our tracker outperforms all previous convolutional trackers and has competitive results with transformer-based method. The code will be made available.

CFNN: Correlation Filter Neural Network for Visual Object Tracking

High-speed Tracking with Multi-Templates Correlation Filters

A Collaborative Visual Tracking Architecture for Correlation Filter and Convolutional Neural Network Learning

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

Visual Tracking with Long-Short Term Based Correlation Filter

Visual object tracking based on residual network and cascaded correlation filters

Efficient object tracking using hierarchical convolutional features model and correlation filters

CRTrack: Learning Correlation-Refine network for visual object tracking

Learning background-aware and spatial-temporal regularized correlation filters for visual tracking

Robust Estimation of Similarity Transformation for Visual Object Tracking

Object Tracking Via ImageNet Classification Scores

Residual Compression Network for Faster Correlation Tracking.

Learning salient features to prevent model drift for correlation tracking

Efficient Multi-level Correlating for Visual Tracking

A Scale Adaptive Kernel Correlation Filter Tracker With Feature Integration

Correlation Filter Correlation Filter ( a ) Unsupervised Learning Motivation Template Patch Search Patch Search Patch Template Patch Forward Tracking using Initial Label Backward Tracking using Pseudo Label Consistency

Real-Time Correlation Tracking via Joint Model Compression and Transfer

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

A novel kernelized correlation filter by fusing multiple feature response maps, enhanced target re-detection, and improved model updating for visual tracking

Learning Local–Global Multiple Correlation Filters for Robust Visual Tracking with Kalman Filter Redetection

Parallel Correlation Filters for Real-Time Visual Tracking