Abstract:Hyperspectral images (HSIs) can provide abundant and diverse features which are helpful for classification, such as spectral, texture, and shape features. Combining these features can enhance the ability to describe the characteristics of different classes of land covers. However, most of the existing methods usually stack features from multiple views to construct high-dimensional data and then learn information from it which may waste information inherent in different feature spaces. In this letter, we proposed a multiview spectral–spatial feature extraction (FE) and fusion framework for the analysis and classification of the HSIs. First, different and complementary spatial features extracted by extended multiattribute profiles (EMAPs), gray-level cooccurrence matrix (GLCM), and Gabor from the original HSI are, respectively, stacked with the spectral bands to construct multiview data set for one single scene of HSI. Thus, each sample can be represented in different spectral–spatial domains. Then, a semisupervised FE method, which combines local fisher discriminant analysis (LFDA) that explores discriminative information from limited labeled samples and the improved neighborhood preserving embedding (NPE) that aims at maintaining the local neighborhood structure from a global perspective, is applied on the multiview data set to eliminate redundant information and obtain multiview spectral–spatial features. Note that the improved NPE which adds spatial interpixel correlations to similarity measure between samples is applied on all the samples rather than unlabeled samples, and hence, the best spatial nearby neighbors for each sample could be found from the whole data. Finally, we integrate these multiview features with diversity and complementarity to construct the intact feature representation for each sample. The experimental results show that the proposed method outperforms the state-of-the-art multiview FE methods for HSI classification.

Multiview Spectral Embedding

M-Sne: Multiview Stochastic Neighbor Embedding.

Multi-view Heterogeneous Fusion and Embedding for Categorical Attributes on Mixed Data.

Mmfe: Multitask Multiview Feature Embedding

Adaptive Similarity Embedding for Unsupervised Multi-View Feature Selection

Sparse Unsupervised Dimensionality Reduction for Multiple View Data.

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features

Generalized Multi-view Embedding for Visual Recognition and Cross-modal Retrieval

Multi-view visual semantic embedding for cross-modal image–text retrieval

Multi-View Embedding Learning for Incompletely Labeled Data.

Subspace-based self-weighted multiview fusion for instance retrieval

Multi-View Multi-Task Feature Extraction For Web Image Classification

A Multiview Spectral–Spatial Feature Extraction and Fusion Framework for Hyperspectral Image Classification

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Double embedding-transfer-based multi-view spectral clustering

Binary Spectral Clustering for Multi-view Data

Flexible Multi-View Unsupervised Graph Embedding

Pairwise constraints based multiview features fusion for scene classification

Kernelized Multiview Subspace Analysis By Self-Weighted Learning

Ensemble Manifold Regularized Sparse Low-Rank Approximation for Multiview Feature Embedding.