Hyperspectral Image Classification Based on Double-hop Graph Attention Multi-view Fusion Network

Ying Cui,Li Luo,Lu Wang,Liwei Chen,Shan Gao,Chunhui Zhao,Cheng Tang
DOI: https://doi.org/10.1109/jstars.2024.3486283
IF: 4.715
2024-01-01
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Abstract:Hyperspectral image (HSI) is pivotal in ground object classification, owing to its rich spatial and spectral information. Recently, Convolutional neural networks (CNNs) and Graph Neural Networks (GNNs) have become hotspots in HSI classification. Although various methods have been developed, the problem of detail loss may still exist when extracting complex features within homogenous regions. To solve this issue, we proposed a double-hop graph attention multi-view fusion network (DGAT-MFN). This model is adept at pinpointing precise attention features by integrating a double-hop graph with the graph attention network (GAT), thereby enhancing the aggregation of multi-level node information and surmounting the limitations of a restricted receptive field. Further, the spectralcoordinate attention module (SCAM) is presented to seize more nuanced spectral and spatial attention features. SCAM harnesses coordinate attention mechanisms for in-depth pixel-level global spectral-spatial view. Coupled with the multi-scale Gabor texture view, we forge a multi-view fusion network (MFN) that meticulously highlights edge details across varying scales and captures beneficial features. Our experimental validation across four renowned benchmark HSI datasets showcases our model's superiority, outstripping comparative methods in classification accuracy with limited labeled samples.
What problem does this paper attempt to address?