Abstract:Nonlinear classifiers (i.e., kernel support vector machines (SVMs)) are effective for nonlinear data classification. However, nonlinear classifiers are usually prohibitively expensive when dealing with large nonlinear data. Ensembles of linear classifiers have been proposed to address this inefficiency, which is called the ensemble linear classifiers for nonlinear data problem. In this article, a new iterative learning approach is introduced that involves two steps at each iteration: partitioning the data into clusters according to Gaussian mixture models with local consistency and then training basic classifiers (i.e., linear SVMs) for each cluster. The two divide-and-conquer steps are combined into a graphical model. Meanwhile, with training, each classifier is regarded as a task; clustered multitask learning is employed to capture the relatedness among different tasks and avoid overfitting in each task. In addition, two novel extensions are introduced based on the proposed approach. First, the approach is extended for quality-aware web data classification. In this problem, the types of web data vary in terms of information quality. The ignorance of the variations of information quality of web data leads to poor classification models. The proposed approach can effectively integrate quality-aware factors into web data classification. Second, the approach is extended for listwise learning to rank to construct an ensemble of linear ranking models, whereas most existing listwise ranking methods construct a solely linear ranking model. Experimental results on benchmark datasets show that our approach outperforms state-of-the-art algorithms. During prediction for nonlinear classification, it also obtains comparable classification performance to kernel SVMs, with much higher efficiency.

Learning to Rank with Ensemble Ranking SVM

Ensemble Ranking SVM for learning to rank

Cost-Sensitive learning of SVM for ranking

Joint Sparse Learning for Classification Ensemble.

Reranking For Stacking Ensemble Learning

Improvement Classification Performance by the Support Vector Machine Ensemble

A Novel SVM Ensemble Approach Using Clustering Analysis

Designing Ensemble Learning Algorithms Using Kernel Methods

From Kernel Machines to Ensemble Learning

Iteratively Divide-and-Conquer Learning for Nonlinear Classification and Ranking

A Robust Semi-Supervised SVM Via Ensemble Learning

Study of Ensemble Algorithm and Its Application

A Novel Bagging Ensemble Approach for Variable Ranking and Selection for Linear Regression Models

Constructing effective SVM ensembles for image classification

Irank: A Rank-Learn-combine Framework for Unsupervised Ensemble Ranking.

Support vector machine ensemble using rough sets theory

Classifier Ensemble by Exploring Supplementary Ordering Information

Generalized Ambiguity Decomposition for Ranking Ensemble Learning

RankBrushers: Interactive Analysis of Temporal Ranking Ensembles

Ensemble Learning from Crowds

Active Learning to Rank using Pairwise Supervision.