Abstract:In this paper, we propose a new spectral-spatial classification strategy to enhance the classification performances obtained on hyperspectral images by integrating rotation forests and Markov random fields (MRFs). First, rotation forests are performed to obtain the class probabilities based on spectral information. Rotation forests create diverse base learners using feature extraction and subset features. The feature set is randomly divided into several disjoint subsets; then, feature extraction is performed separately on each subset, and a new set of linear extracted features is obtained. The base learner is trained with this set. An ensemble of classifiers is constructed by repeating these steps several times. The weak classifier of hyperspectral data, classification and regression tree (CART), is selected as the base classifier because it is unstable, fast, and sensitive to rotations of the axes. In this case, small changes in the training data of CART lead to a large change in the results, generating high diversity within the ensemble. Four feature extraction methods, including principal component analysis (PCA), neighborhood preserving embedding (NPE), linear local tangent space alignment (LLTSA), and linearity preserving projection (LPP), are used in rotation forests. Second, spatial contextual information, which is modeled by MRF prior, is used to refine the classification results obtained from the rotation forests by solving a maximum a posteriori problem using the α-expansion graph cuts optimization method. Experimental results, conducted on three hyperspectral data with different resolutions and different contexts, reveal that rotation forest ensembles are competitive with other strong supervised classification methods, such as support vector machines. Rotation forests with local feature extraction methods, including NPE, LLTSA, and LPP, can lead to higher classification accuracies than that achieved by PCA. With the help of MRF, the proposed algorithms can improve the classification accuracies significantly, confirming the importance of spatial contextual information in hyperspectral spectral-spatial classification.

Metric forests based on Gaussian mixture model for visual image classification

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

LAM3L: Locally Adaptive Maximum Margin Metric Learning for Visual Data Classification

Hyperspectral Image Classification with Deep Metric Learning and Conditional Random Field

Metric learning for weather image classification

Fréchet random forests for metric space valued regression with non euclidean predictors

Gaussian mixture model and Markov random fields for hyperspectral image classification

A spatial Gaussian process method for hyperspectral remote sensing imagery classification

Probabilistic Deep Metric Learning for Hyperspectral Image Classification

A Novel Hyperspectral Remote Sensing Images Classification Using Gaussian Processes with Conditional Random Fields

Randomized Distribution Feature for Image Classification.

Metric networks for enhanced perception of non-local semantic information

Visual Explanation for Deep Metric Learning

Head Pose Estimation Based on Random Forests for Multiclass Classification

Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests with Local Feature Extraction and Markov Random Fields

Framework of Randomized Distribution Features for Visual Representation and Categorization.

Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detection

Image classification with multi-view multi-instance metric learning

Classification of Hyperspectral Imagery Based on Spectral Gradient, SVM and Spatial Random Forest

Comparison Between Classification Algorithms: Gaussian Mixture Model - GMM and Random Forest - RF, for Landsat 8 Images

Metric Distribution to Vector: Constructing Data Representation via Broad-Scale Discrepancies