Hyperspectral image classification based on channel perception mechanism and hybrid deformable convolution network

Yunji Zhao,Zhihao Zhang,Wenming Bao,Xiaozhuo Xu,Zhifang Gao
DOI: https://doi.org/10.1007/s12145-023-01216-z
2024-01-10
Earth Science Informatics
Abstract:Recently, deep models based on convolutional neural networks (CNNs) have achieved an impressive performance in hyperspectral image (HSI) classification. However, under the premise of the limited number of samples, the redundant information between HIS data will increase the difficulty of deep feature extraction and also affect the model classification effect. Because of this, this paper proposes an HSI classification method based on a channel perception mechanism and a hybrid deformed convolutional network (CPM-HDCN). Specifically, a channel perception mechanism (CPM) based on regression loss function and ranking loss function is designed for multi-channel feature screening. Then, a foreground-background image for each category sample is constructed to highlight foreground image features. By combining the channel perception mechanism and the pre-trained model, multi-channel-aware features with both strong resolution and sensitivity to scale variations are obtained from multiple foreground background images. Finally, a hybrid deformable convolutional network (HDCN) is utilized to classify the HSI after channel-aware feature extraction. Experimental validation is performed on three publicly available HSI datasets, and the results show that the proposed method is effective and outperforms some state-of-the-art (SOTA) HSI classification methods.
geosciences, multidisciplinary,computer science, interdisciplinary applications
What problem does this paper attempt to address?