SiamHOT: Siamese High-Order Transformer for Aerial Tracking
Qiqi Chen,Yujia Zuo,Bo Wang,Jinghong Liu,Chenglong Liu
DOI: https://doi.org/10.1109/lgrs.2024.3381181
IF: 5.343
2024-04-09
IEEE Geoscience and Remote Sensing Letters
Abstract:As an important branch of remote sensing detection, aerial tracking has been widely used in many fields. However, due to the unique aviation perspective, aerial tracking faces more challenges than general tracking. To achieve accurate and robust aerial tracking, many trackers choose transformer structure to improve the performance of the network. However, the high amount of computation of transformer does not meet the lightweight requirements of aerial tracking. Therefore, this letter designs a lightweight high-order transformer (HOT). The proposed HOT includes an encoder and a decoder. The encoder uses efficient recursive convolution to realize high-order interaction of information and improve the feature extraction ability of the network while greatly reducing the amount of computation. The decoder designs multiple cross correlation structure to perform the deep fusion of the template branch and search branch. We integrate the proposed HOT into the Siamese-based network (SiamHOT) for aerial tracking. Finally, we evaluate the proposed SiamHOT in three aerial tracking benchmarks, such as UAV20L, UAV123@10fps, and DTB70, and the results show that the proposed SiamHOT achieves superior performance compared to the state-of-the-art (SOTA) trackers. Besides, we conducted the speed evaluation on RTX3060Ti, and the results show that the proposed SiamHOT achieves 116fps running speed, which is better than the comparison trackers.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics