Abstract:The classification of hyperspectral images (HSIs) using convolutional neural networks (CNNs) has recently drawn significant attention. However, it is important to address the potential overfitting problems that CNN-based methods suffer when dealing with HSIs. Unlike common natural images, HSIs are essentially three-order tensors which contain two spatial dimensions and one spectral dimension. As a result, exploiting both spatial and spectral information is very important for HSI classification. This paper proposes a new hand-crafted feature extraction method, based on multiscale covariance maps (MCMs), that is specifically aimed at improving the classification of HSIs using CNNs. The proposed method has the following distinctive advantages. First, with the use of covariance maps, the spatial and spectral information of the HSI can be jointly exploited. Each entry in the covariance map stands for the covariance between two different spectral bands within a local spatial window, which can absorb and integrate the two kinds of information (spatial and spectral) in a natural way. Second, by means of our multiscale strategy, each sample can be enhanced with spatial information from different scales, increasing the information conveyed by training samples significantly. To verify the effectiveness of our proposed method, we conduct comprehensive experiments on three widely used hyperspectral data sets, using a classical 2-D CNN (2DCNN) model. Our experimental results demonstrate that the proposed method can indeed increase the robustness of the CNN model. Moreover, the proposed MCMs+2DCNN method exhibits better classification performance than other CNN-based classification strategies and several standard techniques for spectral-spatial classification of HSIs.

Characterizing Markov Random Fields and Coefficient of Variations as Measures of Spatial Distributions for Hyperspectral Image Classification

Markov random field based spectral-spatial fusion network for hyperspectral image classification

Spatial-spectral Classification of Hyperspectral Images: a Deep Learning Framework with Markov Random Fields Based Modelling

Hyperspectral Image Classification with Markov Random Fields and a Convolutional Neural Network

Markov Random Fields Integrating Adaptive Interclass-Pair Penalty and Spectral Similarity for Hyperspectral Image Classification

Spectral-Spatial Hyperspectral Image Classification Via Robust Low-Rank Feature Extraction and Markov Random Field.

Combining of Markov Random Field and Convolutional Neural Networks for Hyper/Multispectral Image Classification.

CMR-CNN: Cross-Mixing Residual Network for Hyperspectral Image Classification

Spectral–Spatial Hyperspectral Image Classification Using Cascaded Markov Random Fields

Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery

Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images Via Convolutional Neural Networks

Locally Homogeneous Covariance Matrix Representation for Hyperspectral Image Classification

Integration of 3-dimensional discrete wavelet transform and Markov random field for hyperspectral image classification.

Nearest regularized subspace based hyperspectral image classification with adaptive Markov Random Field and high confidence index rule

Superpixel-based Markov Random Field for Classification of Hyperspectral Images

Robust Regression-Based Markov Random Field for Hyperspectral Image Classification.

Representation-based Classifications with Markov Random Field Model for Hyperspectral Urban Data

Feature Extraction with Multiscale Covariance Maps for Hyperspectral Image Classification

MRF-Based Multiple Classifier System for Hyperspectral Remote Sensing Image Classification.

A Markov Random Field Integrating Spectral Dissimilarity and Class Co-Occurrence Dependency for Remote Sensing Image Classification Optimization

CDC-MRF for Hyperspectral Data Classification