Hyperspectral Image Classification Based on Dual-Channel Network with Spectral-Spatial Fusion Attention

Jing Liu,Meiyi Wu,Yinqiao Li,Zhuolan Wang,Yi Liu
DOI: https://doi.org/10.1109/icnc-fskd64080.2024.10702324
2024-01-01
Abstract:Convolutional neural network (CNN) can extract intricate features from hyperspectral image (HSI) and demonstrate outstanding performance in HSI classification. However, as the depth of the CNN architectures expands, the size of the feature maps decreases, which can lead to the loss of some detail information and a decrease in resolution, ultimately leading to a deterioration in model performance. To tackle these issues, this paper proposes a dual-channel network with spatial-spectral fusion attention (DC-SSFA). Firstly, the SSFA module aims to highlight important spectral spatial features and improve the network of utilization of global information in HSI. Secondly, to comprehensively extract the multi-scale feature information of HSI, the dual-branch fusion (DBF) module and the dilated convolutional fusion (DCF) module are proposed, and features with multiple receptive fields are fused to obtain different resolutions so as to enhance the representational capability of the dual-channel. Finally, residual module is introduced to realize the fusion of local and multi-scale information of HSI. Experiments are carried on three measured HSI datasets, compared with ClusterCNN, SSRN, HybridSN, and FC-3DCNN methods. The experimental results indicate that the DC-SSFA network provides promising classification performance.
What problem does this paper attempt to address?