Re-Equipping Residual Networks for Few-Shot Hyperspectral Image Classification
Weihua Shen,Xinyu Li,Louying Fan,Xiahua Chen,Chunzhi Li
DOI: https://doi.org/10.1109/lgrs.2024.3406137
IF: 5.343
2024-06-15
IEEE Geoscience and Remote Sensing Letters
Abstract:Convolutional neural network (CNN) is used broadly for hyperspectral image classification (HIC). However, the existing CNN-based methods that usually oversimplify even distort the factual relationships between underlying characteristics in actual scenes. To this end, we employ the oblique rotation factor (ORF) analyses to build a robust framework for few-shot HIC. Under the guidance of ORF, double-branch 3-D CNNs (3DCNNs) are restructured via discarding all the batch normalization (BN) units to model the factual relationship among the latent characteristics, and two separate progressive attention schemes are embedded, respectively, in the double-branch 3DCNNs to exploit the spatial/spectral details fully. To alleviate the issue of model degradation, the double-branch 3DCNNs are formed with the residual connections. Then, to refine the features further and improve the efficiency by preventing overfitting, we restructure 2DCNN by employing the dropout to replace the pooling layers. Finally, the restructured double-branch 3DCNNs and 2DCNN are assembled to form an effective framework for the task of few-shot HIC. The proposed framework is validated on the datasets Loukia, Trento, and Kennedy Space Center (KSC), respectively; 6%, 1%, and 6% samples are employed to train, and the overall accuracy still achieves 88.84%, 97.8%, and 99.39%. It indicates that the constructed framework has advantages in few-shot learning.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics