Abstract:Recently, the research on semi-supervised support vector machine (S3VM) has received much attention, and many S3VM algorithms have been proposed. Existing studies have shown that S3VM is effective especially in the situations where labeled data is scarce. Nevertheless, most of existing S3VM algorithms belong to centralized learning, that is, all the data is stored and processed at a fusion center. In many real-world applications, data may be horizontally or vertically distributed over multiple nodes (parties). Besides, from the concerns of privacy and security, each node would not like to share its original data with the others. On the other hand, considering that the data is usually sequentially generated, online processing is preferred. In this paper, we propose two online distributed S3VM (dS3VM) algorithms, which are respectively used for horizontally and vertically partitioned data classification. In these two algorithms, to get a fully decentralized implementation, we propose a new form of manifold regularization defined on some anchor points that are adaptively selected by an online strategy. Besides, we use the sparse random feature map to approximate the kernel feature map. In this manner, the model parameters can be collaboratively estimated without transmitting the original data between neighbors. The convergence performances of the proposed algorithms are analyzed. Simulations on several data sets are performed. Results show that the proposed dS3VM algorithms achieve good classification performance even when there is only a small portion of labeled data.

Separating Hypersurfaces of SVMs in Input Spaces.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Asymmetrical support vector machine based on moving optimal separating hyperplane

Support Vector Classification Using Hypersphere

Construction methods for H-SVMs

New type of support vector machine by moving separating hyperplane

Entire Solution Path for Support Vector Machine for Positive and Unlabeled Classification

A New Method for SVM Hyper-parameters Optimization

Learning Isometric Separation Maps

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

Fuzzy Support Vector Machine For Regression Estimation

Support vector machines and Radon's theorem

Relationship Between Support Vector Set and Kernel Functions in SVM

On the proliferation of support vectors in high dimensions

Distributed Online Semi-Supervised Support Vector Machine

A Large Dimensional Analysis of Least Squares Support Vector Machines

Convex Relaxation for Solving Large-Margin Classifiers in Hyperbolic Space

A Rough Margin Based Support Vector Machine.

Infinite SVM: a Dirichlet Process Mixture of Large-margin Kernel Machines.

Learning concepts from large scale imbalanced data sets using support cluster machines.

Minimal Sample Subspace Learning: Theory and Algorithms