Abstract:Recently, the research on semi-supervised support vector machine (S3VM) has received much attention, and many S3VM algorithms have been proposed. Existing studies have shown that S3VM is effective especially in the situations where labeled data is scarce. Nevertheless, most of existing S3VM algorithms belong to centralized learning, that is, all the data is stored and processed at a fusion center. In many real-world applications, data may be horizontally or vertically distributed over multiple nodes (parties). Besides, from the concerns of privacy and security, each node would not like to share its original data with the others. On the other hand, considering that the data is usually sequentially generated, online processing is preferred. In this paper, we propose two online distributed S3VM (dS3VM) algorithms, which are respectively used for horizontally and vertically partitioned data classification. In these two algorithms, to get a fully decentralized implementation, we propose a new form of manifold regularization defined on some anchor points that are adaptively selected by an online strategy. Besides, we use the sparse random feature map to approximate the kernel feature map. In this manner, the model parameters can be collaboratively estimated without transmitting the original data between neighbors. The convergence performances of the proposed algorithms are analyzed. Simulations on several data sets are performed. Results show that the proposed dS3VM algorithms achieve good classification performance even when there is only a small portion of labeled data.

On Constructing and Pruning Svm Ensembles

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Constructing effective SVM ensembles for image classification

Constructing Support Vector Machine Ensembles for Cancer Classification Based on Proteomic Profiling

Empirical analysis of support vector machine ensemble classifiers

Fast Pruning Superfluous Support Vectors in SVMs

Support vector machine ensemble using rough sets theory

PRUNE SUPPORT VECTOR MACHINES BY AN ITERATIVE PROCESS

A New Method to Construct Reduced Vector Sets for Simplifying Support Vector Machines

Least squares support vector machine ensemble

Margin-Based Pareto Ensemble Pruning: an Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles.

A Robust Semi-Supervised SVM Via Ensemble Learning

Prune the training samples and support vectors

Ensemble Pruning Via Individual Contribution Ordering

Distributed Online Semi-Supervised Support Vector Machine

A Probabilistic Ensemble Pruning Algorithm

Optimizing Subspace Svm Ensemble for Hyperspectral Imagery Classification

Multi-objective Evolutionary Ensemble Pruning Guided by Margin Distribution

K-Nearest Neighbor Based Bagging Svm Pruning

An empirical comparison of ensemble classification algorithms with support vector machines

From Kernel Machines to Ensemble Learning