Few-shot Hyperspectral Image Classification Using Relational Generative Adversarial Network
Wei,Lei Tong,Baoqing Guo,Jun Zhou,Chuangbai Xiao
DOI: https://doi.org/10.1109/tgrs.2024.3490537
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Hyperspectral image (HSI) classification is an essential task in remote sensing, but its performance is greatly affected by limited labeled samples. Currently, generative adversarial networks (GANs) based methods can generate the virtue samples to augment the training set. However, with limited labeled data, GANs perform poorly in capturing features during sample generation. Very few relation networks (RN) and few-shot learning methods considered data augmentation to enhance performance. To address this challenge, we propose FSHyperRGAN, a few-shot HSI classification method based on relational generative adversarial network, which uses GANs to augment the training samples for relation networks, while leveraging relation feature extraction to guide the generation of specific class samples. FSHyperRGAN comprises four modules: a data processing module converting the HSI data to 1D and 3D features, an adversarial generation module synthesizing virtual samples conditioned on labels, a data embedding and reconstruction module encoding latent spaces for accurate sample reconstruction while preserving category characteristics, and a relation computation module computing relation scores across generated, reconstructed, and original samples. In addition, a relational feature matching scheme is also applied, which can use virtual samples to guide classification. Two FSHyperRGAN frameworks are designed, 1D-FSHyperRGAN and 3D-FSHyperRGAN, which can be utilized for 1D spectral or 3D spatial-spectral classification. Experiments on widely used HSI data sets illustrate that the proposed method outperforms several state-of-the-art methods and achieves overall accuracies of 92.64%, 86.82%, 83.64%, and 84.57% on KSC, PaviaU, Houston, and WHU-Hi-HongHu data sets, respectively.