Abstract:Ensemble methods use multiple classifiers to achieve better decisions than could be achieved using any of the constituent classifiers alone. However, both theoretical and experimental evidence have shown that very large ensembles are not necessarily superior, and small ensembles can often achieve better results. In this paper, we show how to combine a set of weak classifiers into a robust ensemble by using a joint sparse representation method, which assigns a sparse coefficient vector to the decision of each classifier. The sparse vector contains many zero entries, and thus the final ensemble only employs a small number of classifiers, corresponding to non-zero entries. Training data are partitioned into several sub-groups to generate sub-underdetermined systems. The joint sparse method enables these sub-groups to then share their information about individual classifiers, to obtain an improved overall classification. Partitioning the training dataset into subgroups makes the proposed joint sparse ensemble method parallelizable, making it suitable for large scale problems. In contrast, previous work on sparse approaches to ensemble learning was limited to datasets smaller than the number of classifiers. Two different strategies are described for generating the sub-underdetermined systems, and experiments show these to be effective when tested with two different data manipulation methods. Experiments evaluate the performance of the joint sparse ensemble learning method in comparison to five other state-of-the-art methods from the literature, each designed to train small and efficient ensembles. Results suggest that joint sparse ensemble learning outperforms other algorithms on most datasets.

Supervised multi-view classification via the sparse learning joint the weighted elastic loss

Re-weighting Regression and Sparsity Regularization for Multi-View Classification

Weighted Feature Selection Via Discriminative Sparse Multi-View Learning

Multi-view hyperspectral image classification via weighted sparse representation

Weighted Multi-View Common Subspace Learning Method

Sparse robust multiview feature selection via adaptive-weighting strategy

Embedding Regularizer Learning for Multi-View Semi-Supervised Classification.

Structured Sparse Multi-View Feature Selection Based on Weighted Hinge Loss

Weighted hybrid fusion with rank consistency

Block-based multi-view classification via view-based ??<sub>2,??</sub>sparse representation and adaptive view fusion

Retargeted Multi-View Classification Via Structured Sparse Learning

Scalable Multi-View Semi-Supervised Classification Via Adaptive Regression

Robust Supervised Multi-View Feature Selection with Weighted Shared Loss and Maximum Margin Criterion

Multi-view Semi-Supervised Classification Via Auto-Weighted Submarkov Random Walk

Multi-view Clustering Via Clusterwise Weights Learning

When Multi-View Classification Meets Ensemble Learning

Joint Sparse Learning for Classification Ensemble.

Multi-View Clustering and Feature Learning via Structured Sparsity.

Multi-view learning methods with the LINEX loss for pattern classification

Joint learning of latent representation and global similarity for multi-view image clustering

Joint Consensus and Diversity for Multi-View Semi-Supervised Classification