Abstract:Recently, the research on semi-supervised support vector machine (S3VM) has received much attention, and many S3VM algorithms have been proposed. Existing studies have shown that S3VM is effective especially in the situations where labeled data is scarce. Nevertheless, most of existing S3VM algorithms belong to centralized learning, that is, all the data is stored and processed at a fusion center. In many real-world applications, data may be horizontally or vertically distributed over multiple nodes (parties). Besides, from the concerns of privacy and security, each node would not like to share its original data with the others. On the other hand, considering that the data is usually sequentially generated, online processing is preferred. In this paper, we propose two online distributed S3VM (dS3VM) algorithms, which are respectively used for horizontally and vertically partitioned data classification. In these two algorithms, to get a fully decentralized implementation, we propose a new form of manifold regularization defined on some anchor points that are adaptively selected by an online strategy. Besides, we use the sparse random feature map to approximate the kernel feature map. In this manner, the model parameters can be collaboratively estimated without transmitting the original data between neighbors. The convergence performances of the proposed algorithms are analyzed. Simulations on several data sets are performed. Results show that the proposed dS3VM algorithms achieve good classification performance even when there is only a small portion of labeled data.

Robust Unsupervised and Semi-Supervised Bounded V - Support Vector Machines

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

M-estimator Based Support Vector Machine and Its Application

A support vector domain classification algorithm with gray information

A Robust Semi-Supervised SVM Via Ensemble Learning

Optimization meets Machine Learning: An Exact Algorithm for Semi-Supervised Support Vector Machines

Support Vector Machines for Classification Problems

Distributed Online Semi-Supervised Support Vector Machine

Convex large margin training techniques: unsupervised, semi-supervised, and robust support vector machines

Unsupervised and Semi-supervised Support Vector Machines

Robust SVM with Adaptive Graph Learning.

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

Bounded quantile loss for robust support vector machines-based classification and regression

An Overview on Semi-Supervised Support Vector Machine

Two New Decomposition Algorithms for Training Bound-Constrained Support Vector Machines

A Confident Majority Voting Strategy for Parallel and Modular Support Vector Machines

S4VM: Safe Semi-Supervised Support Vector Machine

An uncertain support vector machine based on soft margin method

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems