Abstract:Abstract Siamese-based trackers have been widely studied for their high accuracy and speed. Both the feature extraction and feature fusion are two important components in Siamese-based trackers. Siamese-based trackers obtain fine local features by traditional convolution. However, some important channel information and global information are lost when enhancing local features. In the feature fusion process, cross-correlation-based feature fusion between the template and search region feature ignores the global spatial context information and does not make the best of the spatial information. In this paper, to solve the above problem, we design a novel feature extraction sub-network based on batch-free normalization re-parameterization convolution, which scales the features in the channel dimension and increases the receptive field. Richer channel information is obtained and powerful target features are extracted for the feature fusion. Furthermore, we learn a feature fusion network (FFN) based on feature filter. The FFN fuses the template and search region features in a global spatial context to obtain high-quality fused features by enhancing important features and filtering redundant features. By jointly learning the proposed feature extraction sub-network and FFN, the local and global information are fully exploited. Then, we propose a novel tracking algorithm based on the designed feature extraction sub-network and FFN with re-parameterization convolution and feature filter, referred to as RCFT. We evaluate the proposed RCFT tracker and some recent state-of-the-art (SOTA) trackers on OTB100, VOT2018, LaSOT, GOT-10k, UAV123 and the visual-thermal dataset VOT-RGBT2019 datasets, which achieves superior tracking performance with 45 FPS tracking speed.

HCDC-SRCF tracker: Learning an adaptively multi-feature fuse tracker in spatial regularized correlation filters framework

High-speed Tracking with Multi-Templates Correlation Filters

SCSTCF: Spatial-Channel Selection and Temporal Regularized Correlation Filters for visual tracking

Robust Visual Tracking with Deep Feature Fusion

A Scale Adaptive Kernel Correlation Filter Tracker With Feature Integration

Adaptive feature fusion for visual object tracking

Exploiting multi-scale hierarchical feature representation for visual tracking

Visual tracking with pyramidal feature fusion and transformer based model predictor

Distractor-aware visual tracking using hierarchical correlation filters adaptive selection

RCFT: re-parameterization convolution and feature filter for object tracking

Multi-Channel Feature Dimension Adaption for Correlation Tracking

Adaptive multi-branch correlation filters for robust visual tracking

Multi-cue Correlation Filters for Robust Visual Tracking

CorrFormer: Context-aware tracking with cross-correlation and transformer

Learning a Dynamic Feature Fusion Tracker for Object Tracking

Real-time tracking based on deep feature fusion

Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Tracking

Long-Term Tracking Algorithm with the Combination of Multi-feature Fusion and YOLO.

Multi-hierarchical Independent Correlation Filters for Visual Tracking

Hierarchical Convolutional Features Fusion for Visual Tracking

A novel kernelized correlation filter by fusing multiple feature response maps, enhanced target re-detection, and improved model updating for visual tracking