Abstract:In recent years, visual object tracking, as a prominent research area in computer vision, has garnered significant attention. To bolster the robustness of trackers across a spectrum of complex scenarios, researchers actively explore the synergistic potential of visible and thermal infrared images, aiming to design more potent tracking systems. This paper presents a comprehensive review of target tracking technology based on visible and thermal infrared information, encompassing three key aspects. Firstly, we categorize existing RGBT tracking methods into two main categories: traditional-based methods and deep learning-based methods. This classification facilitates a systematic understanding and comparison of the strengths and weaknesses of different approaches, providing a solid foundation for future research. Secondly, we focus on the evolution of RGBT datasets and analyze the performance of diverse tracking methods on these datasets. Research in this domain aids in evaluating the applicability of existing methods in real-world scenarios and offers guidance for future dataset construction. Finally, we delve into future research directions from multiple perspectives, including model design and dataset construction. In terms of model design, researchers are encouraged to explore more efficient feature extraction methods and innovative model fusion structures to further enhance tracker performance. Regarding dataset construction, increased attention should be given to ensure diversity in real-world scenarios, guaranteeing optimal tracker performance across a variety of complex conditions. In conclusion, this review makes a comprehensive analysis of the development of RGBT tracking from different perspectives, and provides a valuable reference for researchers in related fields such as multi-modal tracking and image fusion. By systematically classifying and analyzing existing research while outlining future research prospects, this review aims to foster the continued development of this field and inspire the emergence of more innovative work.

RGB-T image analysis technology and application: A survey

Human Body Parsing in Thermal InfraRed Domain

Multi-objects Real Time Recognition Based on Color Information

RGB-T salient object detection via CNN feature and result saliency map fusion

Review and Analysis of RGBT Single Object Tracking Methods: A Fusion Perspective

RGBT Tracking: A Comprehensive Review

A Comprehensive Review of RGBT Tracking

Recent advances in 3D object detection based on RGB-D: A survey

RGB-T Long-Term Tracking Algorithm Via Local Sampling and Global Proposals

RGB-D And Thermal Sensor Fusion: A Systematic Literature Review

RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods

RGB-T Object Tracking:Benchmark and Baseline

UAV applications in intelligent traffic: RGBT image feature registration and complementary perception

RGB-T Image Saliency Detection via Collaborative Graph Learning

Review on Infrared Imaging Technology

RGBD Object Tracking: An In-depth Review

RGB-D salient object detection: A survey

RGB-T Salient Object Detection Via Fusing Multi-level CNN Features.

Improving RGB-Infrared Object Detection by Reducing Cross-Modality Redundancy

A brief survey on RGB-D semantic segmentation using deep learning