Abstract:Visual tracking has always been an important research topic in the field of computer vision. During tracking, cluttered backgrounds, deformations, and occasional occlusion inevitably cause unpredictable appearance changes in the target, making the task very challenging. Traditional methods often tackle this problem using fixed central region constraints, simple combinations of features and independent classifiers. However, existing constraints are not very accurate; the simple mechanism of combining features lacks descriptive robustness, and the independent classifiers require complex additional training. Therefore, in this paper, we propose a correlation filter tracker called the feature adaptation-based multipeak-redetection spatial-aware correlation filter (FMCF) to accurately track targets that often change in appearance. In this tracker, the correlation filter has a dynamic spatial constraint that effectively reduces the response of the filter to the cluttered background area. To address target deformation, a new feature adaptation-based training method is designed, and the final response is a combination of the correlation filter and an independent statistical color model. Finally, a multipeak-redetection scheme, which can find the missing targets within multiple peaks of the final response map, is proposed to handle occlusion. In particular, the statistical color model is employed in the spatial-aware filter construction, the final response calculation, and the multipeak-redetection procedure to improve the robustness of the tracker, because of its ability to generate pixel-level color probabilities. Extensive experimental results on public tracking datasets prove that our proposed tracker can perform better than state-of-the-art trackers. Moreover, compared to the baseline tracker, the precision rate and success rate of FMCF are increased by 6.5% and 4.8% on the OTB100 benchmark and by 12.7% and 8.2% on the TC128 benchmark, respectively.

Learning Modality Residual Regularized Correlation Filter for Real Time RGB-T Tracking

Learning Discriminative Update Adaptive Spatial-Temporal Regularized Correlation Filter for RGB-T Tracking

Robust RGB-T Tracking Via Adaptive Modality Weight Correlation Filters and Cross-modality Learning

Spatial-temporal Regularized Multi-modality Correlation Filters for Tracking with Re-detection

RGB-T Long-Term Tracking Algorithm Via Local Sampling and Global Proposals

Deep Correlation Filter based Real-Time Tracker

Towards Modalities Correlation for RGB-T Tracking

Residual Learning-Based Two-Stream Network for RGB-T Object Tracking

CIRNet: an Improved RGBT Tracking Via Cross-Modality Interaction and Re-Identification

Online Learning Samples and Adaptive Recovery for Robust RGB-T Tracking

Robust and Real-Time Visual Tracking Based on Complementary Learners.

RGB-T tracking by modality difference reduction and feature re-selection

Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking

Long-Term Real-Time Correlation Filter Tracker For Mobile Robot

Learning background-aware and spatial-temporal regularized correlation filters for visual tracking

Learning Soft-Consistent Correlation Filters for RGB-T Object Tracking.

Breaking Modality Gap in RGBT Tracking: Coupled Knowledge Distillation

Feature Adaptation-Based Multipeak-Redetection Spatial-Aware Correlation Filter for Object Tracking

Temporal Adaptive RGBT Tracking with Modality Prompt

Learning Modality Complementary Features with Mixed Attention Mechanism for RGB-T Tracking

An RGB-T Object Tracking Method for Solving Camera Motion Based on Correlation Filter