Abstract:Hyperspectral images are widely used for classification due to its rich spectral information along with spatial information. To process the high dimensionality and high nonlinearity of hyperspectral images, deep learning methods based on convolutional neural network (CNN) are widely used in hyperspectral classification applications. However, most CNN structures are stacked vertically in addition to using a onefold size of convolutional kernels or pooling layers, which cannot fully mine the multiscale information on the hyperspectral images. When such networks meet the practical challenge of a limited labeled hyperspectral image dataset—i.e., “small sample problem”—the classification accuracy and generalization ability would be limited. In this paper, to tackle the small sample problem, we apply the semantic segmentation function to the pixel-level hyperspectral classification due to their comparability. A lightweight, multiscale squeeze-and-excitation pyramid pooling network (MSPN) is proposed. It consists of a multiscale 3D CNN module, a squeezing and excitation module, and a pyramid pooling module with 2D CNN. Such a hybrid 2D-3D-CNN MSPN framework can learn and fuse deeper hierarchical spatial–spectral features with fewer training samples. The proposed MSPN was tested on three publicly available hyperspectral classification datasets: Indian Pine, Salinas, and Pavia University. Using 5%, 0.5%, and 0.5% training samples of the three datasets, the classification accuracies of the MSPN were 96.09%, 97%, and 96.56%, respectively. In addition, we also selected the latest dataset with higher spatial resolution, named WHU-Hi-LongKou, as the challenge object. Using only 0.1% of the training samples, we could achieve a 97.31% classification accuracy, which is far superior to the state-of-the-art hyperspectral classification methods.

Consecutive multiscale feature learning-based image classification model

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Multi-scale Unified Network for Image Classification

Multi-scale Matching Networks for Semantic Correspondence

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Scene Classification Based on Multiscale Convolutional Neural Network.

Subpixel Multilevel Scale Feature Learning and Adaptive Attention Constraint Fusion for Hyperspectral Image Classification

Multiscale Low-Frequency Memory Network for Improved Feature Extraction in Convolutional Neural Networks

Weight-sharing Multi-Stage Multi-Scale Ensemble Convolutional Neural Network.

Scalenet: A Convolutional Network to Extract Multi-Scale and Fine-Grained Visual Features

Multi-Channel and Multi-Scale Mid-Level Image Representation for Scene Classification

Multiscale Densely-Connected Fusion Networks for Hyperspectral Images Classification

Multiscale Feature-Learning with a Unified Model for Hyperspectral Image Classification

Multi-Scale Dense Networks for Resource Efficient Image Classification

Cyclic CNN: Image Classification With Multiscale and Multilocation Contexts

Multiscale Information Fusion for Hyperspectral Image Classification Based on Hybrid 2D-3D CNN

AMFF-net: Adaptive Multi-Modal Feature Fusion Network for Image Classification

Multiscale Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification

Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images

Multiscale Curvelet Scattering Network

Multi-scale skip-connection network for image super-resolution