SiamITO: A Lightweight Siamese Network for Infrared Tiny Object Tracking

Zhicheng Lv,Jun Wang,Yulian Li,Jingbo Yuan
DOI: https://doi.org/10.1109/CAC57257.2022.10055103
2022-11-25
Abstract:Siamese networks have developed rapidly and achieved great results in the field of object tracking. However, most Siamese-based trackers focus on tracking generic object and little research has been done on tracking infrared tiny object (ITO). ITO has very few pixels in the infrared image and lacks appearance information, which makes ITO tracking a challenging task. To track single ITO, we propose an efficient Siamese-based network, dubbed as SiamITO. SiamITO contains three mainly modules: feature extraction backbone, feature fusion module and multi-attention module. Feature extraction backbone contains several convolution layers and residual connections to ensure the effective extraction of features and retention appearance information. Feature fusion module uses multiple layers of output to integrate multi-level information. The multi-attention module computes self-attention of ego-branch and cross-attention of each-branch to learn contextual information for better distinguishing the object from background. To demonstrate the effectiveness of SiamITO, some experimental analyses have been carried out in a series of real ITO video sequences. Compared with many SOTA methods of single generic object tracking, the proposed method significantly improves tracking accuracy of ITO while maintaining high inference speed.
Engineering,Computer Science
What problem does this paper attempt to address?