Abstract:Recently, the research on semi-supervised support vector machine (S3VM) has received much attention, and many S3VM algorithms have been proposed. Existing studies have shown that S3VM is effective especially in the situations where labeled data is scarce. Nevertheless, most of existing S3VM algorithms belong to centralized learning, that is, all the data is stored and processed at a fusion center. In many real-world applications, data may be horizontally or vertically distributed over multiple nodes (parties). Besides, from the concerns of privacy and security, each node would not like to share its original data with the others. On the other hand, considering that the data is usually sequentially generated, online processing is preferred. In this paper, we propose two online distributed S3VM (dS3VM) algorithms, which are respectively used for horizontally and vertically partitioned data classification. In these two algorithms, to get a fully decentralized implementation, we propose a new form of manifold regularization defined on some anchor points that are adaptively selected by an online strategy. Besides, we use the sparse random feature map to approximate the kernel feature map. In this manner, the model parameters can be collaboratively estimated without transmitting the original data between neighbors. The convergence performances of the proposed algorithms are analyzed. Simulations on several data sets are performed. Results show that the proposed dS3VM algorithms achieve good classification performance even when there is only a small portion of labeled data.

Generalization Capacity of Multi-class SVM Based on Markovian Resampling

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

OAA-SVM-MS: A fast and efficient multi-class classification algorithm

A Multi-Class Large Margin Classifier

A new improved support vector machine: QGA-SVM

Improved support vector machine for multi-class classification problems

MMSVC: an Efficient Unsupervised Learning Approach for Large-Scale Datasets.

Novel One-Vs-rest Classifier Based on SVM and Multi-Spheres

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

MK-MSMCR: An efficient multiple kernel approach to multi-class classification

SVM-Boosting based on Markov resampling: Theory and algorithm

Multi-sphere Classification Algorithm Based on 1-SVM

Generalization Performance Analysis of M-SVMs

Learning Performance of Weighted Distributed Learning With Support Vector Machines

Efficacy of Regularized Multitask Learning Based on SVM Models.

Distributed Online Semi-Supervised Support Vector Machine

Scalable Semisupervised GMM for Big Data Quality Prediction in Multimode Processes.

One-against-all Multi-Class SVM Classification Using Reliability Measures

Probabilistic Classification Vector Machine for Multi-Class Classification

Learning performance of regularized regression with multiscale kernels based on Markov observations

A Class-Incremental Learning Method Based on One Class Support Vector Machine