Transfer Learning of Spatial Features From High-Resolution RGB Images for Large-Scale and Robust Hyperspectral Remote Sensing Target Detection
Yuanfeng Wu,Zijin Li,Boya Zhao,Yuhang Song,Bing Zhang
DOI: https://doi.org/10.1109/tgrs.2024.3355184
IF: 8.2
2024-02-02
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Target detection is a critical task in interpreting hyperspectral remote sensing images. Small target (such as airplanes) detection is challenging, especially in large-scale complex scenes with high spectral variability of different land cover types. In this article, we propose a transfer learning-based, large-scale, robust hyperspectral target detector (TLH2TD) to improve the accuracy of hyperspectral target detection (HTD) in large-scale complex scenes. TLH2TD learns the spatial features of hyperspectral targets from high-resolution remote sensing images and achieves high-precision HTD with fused spatial–spectral features. It comprises three parts. First, the coupled target-background sample expansion (CTBSE) module is designed to expand the labeled hyperspectral target and background samples with sufficient high-resolution, labeled RGB images, and a few labeled hyperspectral samples. Second, the hard positive and negative example mining (HPNEM) module trains the hard positive and negative samples to enhance the discriminative ability of the network, addressing the problem of inadequate sample training in large-scale hyperspectral images (HSIs). Third, the spatial–spectral weighted subspace (SSWS) module is designed to fuse the spatial features extracted from the target detection network and the spectral features based on the Mahalanobis distance. The results show that: 1) the TLH2TD achieves average area under the curve (AUC) values of 0.96, 0.96, and 0.93 on small-, medium-, and large-sized HSIs, respectively, achieving the highest accuracy compared with other HTD algorithms; 2) the TLH2TD exhibits the highest detection time efficiency for medium- and large-sized HSIs; and 3) for large-sized HSIs, when most HTD algorithms fail, TLH2TD exhibits significantly higher accuracy and time efficiency than other methods. This is an important achievement in meeting the robust target detection tasks of large-scale hyperspectral remote sensing images.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics