Abstract:Spectral-spatial processing has been increasingly explored in remote sensing hyperspectral image classification. While extensive studies have focused on developing methods to improve the classification accuracy, experimental setting and design for method evaluation have drawn little attention. In the scope of supervised classification, we find that traditional experimental designs for spectral processing are often improperly used in the spectral-spatial processing context, leading to unfair or biased performance evaluation. This is especially the case when training and testing samples are randomly drawn from the same image—a practice that has been commonly adopted in the experiments. Under such setting, the dependence caused by overlap between the training and testing samples may be artificially enhanced by some spatial information processing methods, such as spatial filtering and morphological operation. Such enhancement of dependence in return amplifies the classification accuracy, leading to an improper evaluation of spectral-spatial classification techniques. Therefore, the widely adopted pixel-based random sampling strategy is not always suitable to evaluate spectral-spatial classification algorithms, because it is difficult to determine whether the improvement of classification accuracy is caused by incorporating spatial information into classifier or by increasing the overlap between training and testing samples. To tackle this problem, we propose a novel controlled random sampling strategy for spectral-spatial methods. It can greatly reduce the overlap between training and testing samples and provides more objective and accurate evaluation.

Semi-random Subspace Sampling for Classification

Importance Feature Sampling in Random Subspace

Stratified sampling for feature subspace selection in random forests for high dimensional data

Random Subspace Based Semi-Supervised Feature Selection.

Semi-supervised Classifier Ensemble Model for High-Dimensional Data.

Random Subspace Sampling for Classification with Missing Data

On the Sampling Strategies for Evaluation of Joint Spectral-Spatial Information Based Classifiers

Enriching the random subspace method with margin theory – a solution for the high-dimensional classification task

Classification Via Semi-Supervised Multi-Random Subspace Sparse Representation

Multi-Classifier Ensemble Based on Random Feature Subspace

Semi-supervised Classification Based on Subspace Sparse Representation

Semi-supervised Sentiment Classification with Random Feature Subspace Method

Image Classification:A Random Semi-Supervised Sampling Approach

Random subspace evidence classifier

Classifying Very High-Dimensional Data with Random Forests Built from Small Subspaces

On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification

A Novel Feature Subspace Selection Method in Random Forests for High Dimensional Data.

An Empirical Study on Feature Subsampling-Based Ensembles

New margin-based subsampling iterative technique in modified random forests for classification.

Joint Semi-Supervised Feature Selection and Classification Through Bayesian Approach

Semi-supervised Classification Based on Random Subspace Dimensionality Reduction