Abstract:Recently, the research on semi-supervised support vector machine (S3VM) has received much attention, and many S3VM algorithms have been proposed. Existing studies have shown that S3VM is effective especially in the situations where labeled data is scarce. Nevertheless, most of existing S3VM algorithms belong to centralized learning, that is, all the data is stored and processed at a fusion center. In many real-world applications, data may be horizontally or vertically distributed over multiple nodes (parties). Besides, from the concerns of privacy and security, each node would not like to share its original data with the others. On the other hand, considering that the data is usually sequentially generated, online processing is preferred. In this paper, we propose two online distributed S3VM (dS3VM) algorithms, which are respectively used for horizontally and vertically partitioned data classification. In these two algorithms, to get a fully decentralized implementation, we propose a new form of manifold regularization defined on some anchor points that are adaptively selected by an online strategy. Besides, we use the sparse random feature map to approximate the kernel feature map. In this manner, the model parameters can be collaboratively estimated without transmitting the original data between neighbors. The convergence performances of the proposed algorithms are analyzed. Simulations on several data sets are performed. Results show that the proposed dS3VM algorithms achieve good classification performance even when there is only a small portion of labeled data.

Developments of Two Supervised Maximum Variance Unfolding Algorithms for Process Classification

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Nonlinear Process Monitoring Based on Maximum Variance Unfolding Projections.

Multilevel MVU Models with Localized Construction for Monitoring Processes with Large Scale Data

Multi-manifold learning based on kernel matrix learning

Relaxed Maximum-Variance Unfolding

Multiscale Classification and Its Application to Process Monitoring

A Novel Scalable Semi-supervised GMM and Its Application for Multimode Process Quality Prediction with Big Data

A Linear Maximum Variance Unfolding Algorithm and Its Application in Image Recognition

Fault Diagnosis Method Based on Dynamic Maximum Variance Unfolding and One-Class Support Vector Machine

Scalable Semisupervised GMM for Big Data Quality Prediction in Multimode Processes.

Non-Gaussian process monitoring and fault reconstruction and diagnosis based on SVDD

Learning Isometric Separation Maps

Novel Multimode Process Soft Sensing Methods Based on the Dynamic Mixture Variational Autoencoder Regression Model

Distributed Online Semi-Supervised Support Vector Machine

Unfolding-Model-Based Visualization: Theory, Method and Applications

Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey

Nonlinear Process Monitoring Based on Improved KPCA and Extended MVU

On the convergence of maximum variance unfolding

General multi-view semi-supervised least squares support vector machines with multi-manifold regularization

Learning High Dimensional Correspondences Based on Maximum Variance Unfolding