Abstract:The feature models used by existing Thermal InfraRed (TIR) tracking methods are usually learned from RGB images due to the lack of a large-scale TIR image training dataset. However, these feature models are less effective in representing TIR objects and they are difficult to effectively distinguish distractors because they do not contain fine-grained discriminative information. To this end, we propose a dual-level feature model containing the TIR-specific discriminative feature and fine-grained correlation feature for robust TIR object tracking. Specifically, to distinguish inter-class TIR objects, we first design an auxiliary multi-classification network to learn the TIR-specific discriminative feature. Then, to recognize intra-class TIR objects, we propose a fine-grained aware module to learn the fine-grained correlation feature. These two kinds of features complement each other and represent TIR objects in the levels of inter-class and intra-class respectively. These two feature models are constructed using a multi-task matching framework and are jointly optimized on the TIR object tracking task. In addition, we develop a large-scale TIR image dataset to train the network for learning TIR-specific feature patterns. To the best of our knowledge, this is the largest TIR tracking training dataset with the richest object class and scenario. To verify the effectiveness of the proposed dual-level feature model, we propose an offline TIR tracker (MMNet) and an online TIR tracker (ECO-MM) based on the feature model and evaluate them on three TIR tracking benchmarks. Extensive experimental results on these benchmarks demonstrate that the proposed algorithms perform favorably against the state-of-the-art methods.

Learning Diverse Fine-Grained Features for Thermal Infrared Tracking.

Learning Dual-Level Deep Representation for Thermal Infrared Tracking

A Fourier-Transform-Based Framework with Asymptotic Attention for Mobile Thermal InfraRed Object Detection

Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

Enhancing Discriminative Appearance Model for Visual Tracking.

Efficient thermal infrared tracking with cross-modal compress distillation

Two-Stage Spatio-Temporal Feature Correlation Network for Infrared Ground Target Tracking

Infrared Object Tracking Algorithm with Temporal Features Fusion Siamese Network

Thermal infrared object tracking via unsupervised deep correlation filters

Strengthened Local Feature-based Spatial-Temporal Tensor Model for Infrared Dim and Small Target Detection

Hierarchical Spatial-aware Siamese Network for Thermal Infrared Object Tracking

Target-distractor Aware Deep Tracking with Discriminative Enhancement Learning Loss

Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection

RGB-T tracking by modality difference reduction and feature re-selection

Feature enhancement and coarse-to-fine detection for RGB-D tracking

Multi-Level Fusion for Robust RGBT Tracking via Enhanced Thermal Representation

Coordinate-Aware Thermal Infrared Tracking Via Natural Language Modeling

Synthetic Data Generation for End-to-End Thermal Infrared Tracking

In defense and revival of Bayesian filtering for thermal infrared object tracking

Refocus the Attention for Parameter-Efficient Thermal Infrared Object Tracking