Abstract:Classification is a common objective when analyzing hyperspectral images, where each pixel is assigned to a predefined label. Deep learning-based algorithms have been introduced in the remote-sensing community successfully in the past decade and have achieved significant performance improvements compared with conventional models. However, research on the extraction of sequential features utilizing a single image, instead of multi-temporal images still needs to be further investigated. In this paper, a novel strategy for constructing sequential features from a single image in long short-term memory (LSTM) is proposed. Two pixel-wise-based similarity measurements, including pixel-matching (PM) and block-matching (BM), are employed for the selection of sequence candidates from the whole image. Then, the sequential structure of a given pixel can be constructed as the input of LSTM by utilizing the first several matching pixels with high similarities. The resulting PM-based LSTM and BM-based LSTM are appealing, as all pixels in the whole image are taken into consideration when calculating the similarity. In addition, BM-based LSTM also utilizes local spectral-spatial information that has already shown its effectiveness in hyperspectral image classification. Two common distance measures, Euclidean distance and spectral angle mapping, are also investigated in this paper. Experiments with two benchmark hyperspectral images demonstrate that the proposed methods achieve marked improvements in classification performance relative to the other state-of-the-art methods considered. For instance, the highest overall accuracy achieved on the Pavia University image is 96.20% (using both BM-based LSTM and spectral angle mapping), which is an improvement compared with 84.45% overall accuracy generated by 1D convolutional neural networks.

Spectral-spatial classification of hyperspectral imagery based on recurrent neural networks

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Multiscanning Strategy-Based Recurrent Neural Network for Hyperspectral Image Classification

Spectral–spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks

SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION

Hyperspectral Classification Based on Spectral-Spatial Convolutional Neural Networks

Pixel DAG-Recurrent Neural Network for Spectral-Spatial Hyperspectral Image Classification

Hyperspectral Image Classification Using Similarity Measurements-Based Deep Recurrent Neural Networks

Random Convolutional Network for Hyperspectral Image Classification.

Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework

Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network

Shorten Spatial-spectral RNN with Parallel-GRU for Hyperspectral Image Classification

Scalable recurrent neural network for hyperspectral image classification

Hyperspectral Image Classification With Deep Learning Models

Spatial–Spectral Feature Extraction via Deep ConvLSTM Neural Networks for Hyperspectral Image Classification

Multiscale DenseNet Meets With Bi-RNN for Hyperspectral Image Classification

Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification

Deep Spectral Spatial Inverted Residual Network for Hyperspectral Image Classification

Hyper-S3NN: Spatial–spectral Spiking Neural Network for Hyperspectral Image Classification

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

Deep Neural Network Based Hyperspectral Pixel Classification With Factorized Spectral-Spatial Feature Representation