Dual-stream GNN fusion network for hyperspectral classification

Weiming Li,Qikang Liu,Shuaishuai Fan,Cong’an Xu,Hongyang Bai
DOI: https://doi.org/10.1007/s10489-023-04960-3
IF: 5.3
2023-08-26
Applied Intelligence
Abstract:Semi-supervised Graph Neural Networks (GNNs), as an effective data representation learning framework, have been applied to hyperspectral image (HSI) classification. Although GNNs can quickly capture the structural information of HSIs, traditional GNN-based methods use the entire graph as input, which consumes huge computational resources. Moreover, using a single form of GNN variant cannot effectively extract the correlation between two different dimensions, leading to insufficient improvement in the impact of noise and spectral differences in HSIs. To address these issues, a Dual-Stream GNN Fusion Network (named DGFNet) is proposed in this paper. This end-to-end network uses subcubes as input to reduce computational costs. The spatial branch uses Graph Attention Network (GAT) to capture the inherent relationships within the HSIs, and the risk of overfitting is reduced by combining a novel graph pooling and local guidance module to preserve important features in subcubes. The spectral branch weights the correlations among bands to obtain more reasonable spectral features. Finally, these spatial, spectral, and structural features are fused and classified using linear layers. Extensive comparative experiments on four benchmark datasets have demonstrated that our model achieves competitive performance, and its low computational cost advantage makes it more feasible and practical compared to most GNN-based methods.
computer science, artificial intelligence
What problem does this paper attempt to address?