An Ultralightweight Hybrid CNN Based on Redundancy Removal for Hyperspectral Image Classification

Xiaohu Ma,Wuli Wang,Wei Li,Jianbu Wang,Guangbo Ren,Peng Ren,Baodi Liu
DOI: https://doi.org/10.1109/tgrs.2024.3356524
IF: 8.2
2024-02-07
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Convolutional neural network (CNN)-based hyperspectral image (HSI) classification models often exhibit high volume and complexity. This not only poses challenges in deploying them on mobile and embedded devices due to storage and power constraints, but also introduces a dilemma between the growing demand for labeled samples and the high cost associated with manual labeling. To address these challenges, we propose an ultralightweight hybrid CNN based on redundancy removal (ULite-R2HCN), specifically designed for HSI classification in scenarios with limited samples. To reduce computational costs and enhance feature extraction effectiveness, we focus on optimizing the widely used depthwise convolution (DW-Conv) and pointwise convolution (PW-Conv) in the lightweight HSI classification model. For DW-Conv, we design a spatial convolution with redundancy removal (R2Spatial-Conv). This involves the design of multiscale 3-D convolution kernels with specific structures instead of 2-D convolution kernels, aiming to reduce redundant convolution kernels and extract multiscale spatial features. Simultaneously, for PW-Conv, we design a spectral convolution with redundancy removal (R2Spectral-Conv). This utilizes a "copy-splicing-grouping" structure to extract spectral features within arbitrary range intervals, effectively reducing redundant spectral extractions and capturing long-range spectral relationships. Numerous experiments have shown that the proposed ULite-R2HCN achieves higher classification accuracy with an ultralight volume for a few training samples. In addition, sufficient ablation experiments also verified the advanced performance of the designed R2Spatial-Conv and R2Spectral-Conv.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?