Abstract:In this paper, we propose two manifold regularization (MR) based distributed semi-supervised learning (DSSL) algorithms using the random vector functional link (RVFL) network and alternating direction method of multipliers (ADMM) strategy. In DSSL problems, training data consisting of labeled and unlabeled samples are often large-scale or high-dimension and split across samples or features. These distributed data separately stored over a communication network where each node has only access to its own data and can only communicate with its neighboring nodes. In many scenarios, centralized algorithms cannot be applied to solve DSSL problems. In our previous work, we proposed a MR based DSSL algorithm, denoted as the D-LapWNN algorithm, to solve DSSL problems with distributed samples. It has been proved that the D-LapWNN algorithm, combining the wavelet neural network (WNN) with the zero-gradient-sum (ZGS) strategy, is an efficient DSSL algorithm with distributed samples or horizontally partitioned data. The drawback of the D-LapWNN algorithm is that the loss function of each node or agent over the communication network must be twice continuously differentiable. In order to extend our previous work and settle the corresponding drawback, we propose a horizontally DSSL (HDSSL) algorithm to solve DSSL problems with distributed samples. Then, we novelly propose a vertically DSSL (VDSSL) algorithm to solve DSSL problems with distributed features or vertically partitioned data. As far as we know, the VDSSL algorithm is the first work focusing on DSSL problems with distributed features. During the learning process of the proposed algorithms, nodes over the communication network only exchange coefficients rather than raw data. It means that the proposed algorithms are privacy-preserving methods. Finally, some simulations are given to show the efficiency of the proposed algorithms.

Distributed Semi-supervised Regression Learning with Coefficient Regularization

Distributed Estimation on Semi-Supervised Generalized Linear Model.

Distributed Semi-Supervised Learning with Kernel Ridge Regression

Efficient Distributed Semi-Supervised Learning using Stochastic Regularization over Affinity Graphs

Learning Theory of Distributed Regression with Bias Corrected Regularization Kernel Network

Distributed Learning with Indefinite Kernels

Debiased distributed learning for sparse partial linear models in high dimensions

Distributed Semi-Supervised Metric Learning.

Coded Distributed Graph-Based Semi-Supervised Learning

Distributed Online Semi-Supervised Support Vector Machine

Distributed Semi-Supervised Sparse Statistical Inference

Distributed Learning with Multi-Penalty Regularization

Semi-supervised Distribution Learning

Distributed Censored Regression over Networks

Coefficient-based regularized distribution regression

Distributed semi-supervised learning algorithms for random vector functional-link networks with distributed data splitting across samples and features

Distributed Linear Regression with Compositional Covariates

Distributed Continual Learning With CoCoA in High-Dimensional Linear Regression

Semi-supervised Learning Using Copula-Based Regression and Model Averaging

A distributed block coordinate descent method for training $l_1$ regularized linear classifiers

Decentralised Learning with Random Features and Distributed Gradient Descent