Abstract:High-dimensional small-size data seriously affects the performance of classifiers. By combining classifiers, ensemble learning obtains higher accuracy and more robust predictions. However, these classifier ensemble methods suffer from several limitations: 1) ensemble with sample space suffers from noise and redundant features; 2) constructing sample subspace on small-size data leads to an insufficient description of sample space; 3) ensemble with random feature subspace leads to information loss, which will degrade the performance of classifiers; 4) most ensemble methods implement directly on the original feature space, which is defective in high-dimensional data with redundant and noisy features. To overcome the above limitations, a new classifier ensemble method based on subspace enhancement (CESE) is proposed for high-dimensional data classification. First, a superior subspace enhancement scheme (SSE) is designed to effectively implement feature selection and transformation for high-dimensional data, followed by generating multiple superior feature subspaces with diversity and discrimination, which enhances the representative ability of features. Second, we develop a mixed space enhancement process (MSE) based on multiscale rotation reconstruction and various subspace enhanced features of SSE. By using MSE, an effective feature fusion is constructed to obtain more diverse features. Furthermore, to improve the capability of our method, we design various feature combination strategies for enhanced features from both SSE and MSE. Comparative results on 33 high-dimensional data sets indicate that our approach CESE outperforms different mainstream integrated systems.

Adaptive Classifier Ensemble Method Based on Spatial Perception for High-Dimensional Data Classification

A Novel Classifier Ensemble Method Based on Subspace Enhancement for High-Dimensional Data Classification.

Adaptive Semi-Supervised Classifier Ensemble for High Dimensional Data Classification

A New Ensemble Method with Feature Space Partitioning for High-Dimensional Data Classification

Adaptive Subspace Optimization Ensemble Method for High-Dimensional Imbalanced Data Classification

Ensemble Method for Classification of High-Dimensional Data.

Subspace Ensembles for Classification

Rotation-Based Ensemble Classifiers For High-Dimensional Data

Semi-supervised Classifier Ensemble Model for High-Dimensional Data.

Adaptive Random Subspace Ensemble Classification Aided by X-means Clustering

Adaptive Ensemble Method Based on Spatial Characteristics for Classifying Imbalanced Data

Improved Contraction-Expansion Subspace Ensemble for High-Dimensional Imbalanced Data Classification

Spectral-Spatial Hyperspectral Image Classification With Dual Spatial Ensemble Learning

A Subspace Ensemble Framework for Classification with High Dimensional Missing Data

Subspace Selective Ensemble Algorithm Based on Feature Clustering

Bagging-AdaTSK: An Ensemble Fuzzy Classifier for High-Dimensional Data

Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images

An Ensemble Model for 2D-Data Classification Based on Classical & Deep Learning Classifier

Dynamic Ensemble of Ensembles in Nonstationary Environments

Ensemble Alignment Subspace Adaptation Method for Cross-Scene Classification.

Progressive Subspace Ensemble Learning