Abstract:High-dimensional small-size data seriously affects the performance of classifiers. By combining classifiers, ensemble learning obtains higher accuracy and more robust predictions. However, these classifier ensemble methods suffer from several limitations: 1) ensemble with sample space suffers from noise and redundant features; 2) constructing sample subspace on small-size data leads to an insufficient description of sample space; 3) ensemble with random feature subspace leads to information loss, which will degrade the performance of classifiers; 4) most ensemble methods implement directly on the original feature space, which is defective in high-dimensional data with redundant and noisy features. To overcome the above limitations, a new classifier ensemble method based on subspace enhancement (CESE) is proposed for high-dimensional data classification. First, a superior subspace enhancement scheme (SSE) is designed to effectively implement feature selection and transformation for high-dimensional data, followed by generating multiple superior feature subspaces with diversity and discrimination, which enhances the representative ability of features. Second, we develop a mixed space enhancement process (MSE) based on multiscale rotation reconstruction and various subspace enhanced features of SSE. By using MSE, an effective feature fusion is constructed to obtain more diverse features. Furthermore, to improve the capability of our method, we design various feature combination strategies for enhanced features from both SSE and MSE. Comparative results on 33 high-dimensional data sets indicate that our approach CESE outperforms different mainstream integrated systems.

Random subspace evidence classifier

Random Subspace Ensemble With Enhanced Feature for Hyperspectral Image Classification

Enriching the random subspace method with margin theory – a solution for the high-dimensional classification task

A Sparse Reconstructive Evidential -Nearest Neighbor Classifier for High-dimensional Data

Performing classification using all kinds of distances as evidences

K-Ns: A Classifier by the Distance to the Nearest Subspace.

A quick evidential classification algorithm based on k-nearest neighbor rule

A Sparse Reconstructive Evidential K-Nearest Neighbor Classifier for High-Dimensional Data

An Improved Random Subspace Method And Its Application To Eeg Signal Classification

Multi-Classifier Ensemble Based on Random Feature Subspace

Semi-random Subspace Sampling for Classification

Importance Feature Sampling in Random Subspace

Random Subspace-Based K-Nearest Class Collaborative Representation for Hyperspectral Image Classification

Random Subspace Ensemble for Target Recognition of Ladar Range Image

Subspace Ensembles for Classification

A Novel Classifier Ensemble Method Based on Subspace Enhancement for High-Dimensional Data Classification.

K Nearest Neighbor Based Local Sparse Representation Classifier

A Neighborhood Rough Classification with Dempster-Shafer Evidence Theory

Image Recognition Via Two-Dimensional Random Projection and Nearest Constrained Subspace

Combining Neighborhood Separable Subspaces for Classification Via Sparsity Regularized Optimization

Random Subspace Based Ensemble Sparse Representation