A Lightweight Hybrid Convolutional Neural Network for Hyperspectral Image Classification.

Xiaohu Ma,Xudong Kang,Huawei Qin,Wuli Wang,Guangbo Ren,Jianbu Wang,Baodi Liu
DOI: https://doi.org/10.1109/tgrs.2023.3282247
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Recent studies have demonstrated the potential of hybrid convolutional models that combine 3-D and 2-D convolutional neural networks (CNNs) for hyperspectral image (HSI) classification. However, these models do not fully utilize the benefits of hybrid convolution due to inefficient connections between the two types of CNNs. Moreover, most CNNs, including hybrid models, require a significant number of parameters and computational resources for accurate classification, which increases the need for labeled samples and computational cost. Although the common lightweight strategies, such as depthwise separable convolution (DSC), can reduce parameters and computation compared with normal convolution (NC), they often compromise accuracy. To address these challenges, we propose a lightweight hybrid convolutional neural network (Lite-HCNet) for HSI classification with minimal model parameters and computational effort. First, we design a novel channel attention module (NCAM) and combine it with a convolutional kernel decomposition (CKD) strategy to propose a lightweight and efficient DSC (LE-DSC) deployed in Lite-HCNet. The LE-DSC not only reduces the DSC volume further, but also enhances its performance. Second, a lightweight and efficient hybrid convolutional layer (LE-HCL) is designed in Lite-HCNet to explore the efficient connection structure between 3-D CNNs and 2-D CNNs. Experiments show that the Lite-HCNet reduces the required computational cost and practical deployment difficulty while offering advanced performance with a small number of training samples. Furthermore, abundant ablation experiments confirm the superior performance of the designed LE-DSC.
What problem does this paper attempt to address?