Abstract:Thermal infrared (TIR) target tracking is an important topic in the computer vision area. The TIR images are not affected by ambient light and have strong environmental adaptability, making them widely used in battlefield perception, video surveillance, and assisted driving. However, TIR target tracking faces problems such as relatively insufficient information and lack of target texture information, which significantly affects the tracking accuracy of the TIR tracking methods. To solve the above problems, we propose a TIR target tracking method based on a Siamese network with a hierarchical attention mechanism (called: SiamHAN). Specifically, the CIoU Loss is introduced to make full use of the regression box information to calculate the loss function more accurately. The global context network (GCNet) attention mechanism is introduced to reconstruct the feature extraction structure of fine-grained information for the fine-grained information of TIR images. Meanwhile, for the feature information of the hierarchical backbone network of the Siamese network, the ECANet attention mechanism is used for hierarchical feature fusion, so that it can fully utilize the feature information of the multilayer backbone network to represent the target. On the LSOTB-TIR, the hierarchical attention Siamese network achieved a 2.9% increase in success rate and a 4.3% increase in precision relative to the baseline tracker. Experiments show that the proposed SiamHAN method has achieved competitive tracking results on the TIR testing datasets.

Hierarchical Convolution Fusion-Based Adaptive Siamese Network for Infrared Target Tracking

Infrared Object Tracking Algorithm with Temporal Features Fusion Siamese Network

Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

Hierarchical Attention Siamese Network for Thermal Infrared Target Tracking

Siamese Network with Multi-Scale Fusion Attention for Visual Tracking

Hierarchical Spatial-aware Siamese Network for Thermal Infrared Object Tracking

SiamFT: an RGB-Infrared Fusion Tracking Method Via Fully Convolutional Siamese Networks

MHASiam: Mixed High-Order Attention Siamese Network for Real-Time Visual Tracking

UAV infrared target tracking algorithm based on feature fusion and channel awareness

Enhanced Target Tracking Algorithm for Autonomous Driving Based on Visible and Infrared Image Fusion

Object Fusion Tracking Based on Visible and Infrared Images Using Fully Convolutional Siamese Networks

DSiamMFT: An RGB-T fusion tracking method via dynamic Siamese networks using multi-layer feature fusion

Siamese Network Based Features Fusion For Adaptive Visual Tracking

End-to-end Feature Fusion Siamese Network for Adaptive Visual Tracking.

Adaptive Multi-Feature Fusion Visual Target Tracking Based on Siamese Neural Network with Cross-Attention Mechanism

A Cross-Fusion of Non-Local Attention Network for Infrared Small Target Tracking

SiamCAF: Complementary Attention Fusion-Based Siamese Network for RGBT Tracking

Scale and Appearance Variation Enhanced Siamese Network for Thermal Infrared Target Tracking

Deep Convolutional Neural Networks for Thermal Infrared Object Tracking

SiamCCF: Siamese Visual Tracking Via Cross‐layer Calibration Fusion

Learning Spatial Fusion and Matching for Visual Object Tracking.