DSP-Net: A Dynamic Spectral–Spatial Joint Perception Network for Hyperspectral Target Tracking
Xuguang Zhu,Haorui Zhang,Bin Hu,Kunpeng Huang,Pattathal V. Arun,Xiuping Jia,Dong Zhao,Qing Wang,Huixin Zhou,Shuowen Yang
DOI: https://doi.org/10.1109/lgrs.2023.3324967
IF: 5.343
2023-10-28
IEEE Geoscience and Remote Sensing Letters
Abstract:In order to effectively utilize spectral and object spatial information to improve tracking performance, we design a hyperspectral video (HSV) tracker, namely DSP-Net, to integrate the various prior information. The gradient difference between spectral vectors is explored to develop a clustering technique. The approach generates a binary mask containing target spectral information and appearance clues. A feature cache is introduced to store historical information. Additionally, the channel shift operation is used on the timing to capture the trajectory clues of the target. With the help of the nonlocal mechanism, the trajectory clues, appearance clues, and spectral information of the target are finally integrated, using the designed spectral–spatial joint perception module (SSPM) to enhance the expression of the target. Experimental results show that DSP-Net outperforms state-of-the-art HSV trackers on existing dataset.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics