Abstract:Deep learning-based hyperspectral image (HSI) classification has attracted more and more attention because of its excellent classification ability. Generally, the outstanding performance of these methods mainly depends on a large number of labeled samples. Therefore, it still remains an ongoing challenge how to integrate spatial structure information into these frameworks to classify the HSI with limited training samples. In this study, an effective spectral-spatial HSI classification scheme is proposed based on superpixel pooling convolutional neural network with transfer learning (SP-CNN). The suggested method includes three stages. The first part consists of convolution and pooling operation, which is a down-sampling process to extract the main spectral features of an HSI. The second part is composed of up-sampling and superpixel (homogeneous regions with adaptive shape and size) pooling to explore the spatial structure information of an HSI. Finally, the hyperspectral data with each superpixel as a basic input rather than a pixel are fed to fully connected neural network. In this method, the spectral and spatial information is effectively fused by using superpixel pooling technique. The use of popular transfer learning technology in the proposed classification framework significantly improves the training efficiency of SP-CNN. To evaluate the effectiveness of the SP-CNN, extensive experiments were conducted on three common real HSI datasets acquired from different sensors. With 30 labeled pixels per class, the overall classification accuracy provided by this method on three benchmarks all exceeded 93%, which was at least 4.55% higher than that of several state-of-the-art approaches. Experimental and comparative results prove that the proposed algorithm can effectively classify the HSI with limited training labels.

CSPS: An Adaptive Pooling Method for Image Classification

Learning Class-Specific Pooling Shapes for Image Classification.

Generalized regular spatial pooling for image classification

Image Classification by Hierarchical Spatial Pooling with Partial Least Squares Analysis.

Wasserstein Pooling for Image Classification

Adaptive Salience Preserving Pooling for Deep Convolutional Neural Networks

Fast Low Rank Representation Based Spatial Pyramid Matching for Image Classification.

Image Classification via Object-Aware Holistic Superpixel Selection

Adaptive Bilinear Pooling for Fine-grained Representation Learning.

CSPP-IQA: a multi-scale spatial pyramid pooling-based approach for blind image quality assessment

ASPCNet: Deep adaptive spatial pattern capsule network for hyperspectral image classification

Blind Image Quality Assessment Based on Multi-scale Spatial Pyramid Pooling.

Deep Superpixel Convolutional Network for Image Recognition

Considering The Spatial Layout Information Of Bag Of Features (Bof) Framework For Image Classification

Performance Comparison Of Two Pooling Strategies For Remote Sensing Image Scene Classification

Learning Relative Features Through Adaptive Pooling for Image Classification

Bag of Shape Features with a Learned Pooling Function for Shape Recognition

Weakly supervised sparse coding with geometric consistency pooling

Global Weighted Average Pooling Bridges Pixel-level Localization and Image-level Classification

Shift Pooling PSPNet: Rethinking PSPNet for Building Extraction in Remote Sensing Images from Entire Local Feature Pooling

Hyperspectral Image Classification Based on Superpixel Pooling Convolutional Neural Network with Transfer Learning