Abstract:Inthis paper, a distributed semi-supervised partial multi-label learning (dS2PML) algorithm is proposed, which can be used to address the problem of distributed classification of partially multi-labeled data and unlabeled data. In this algorithm, we utilize the multi-kernel function together with the label correlation term to construct the discriminant function. In addition, to obtain a decentralized implementation, we design a reconstructed error on the labeling confidence based on globally common basic data that are selected by a distributed strategy. By exploiting the similarity structure among feature and label spaces under the sparsity constraint, the labeling confidences of partially multi-labeled and unlabeled data are estimated in a decentralized manner. Meanwhile, by using the sparse random feature map to approximate the kernel feature map, the multi-label classifier can be trained under the supervision of the estimated labeling confidence. Experiments on multiple real datasets are conducted to evaluate the learning performance of the proposed approach. According to the experimental results, the average ranks of all the comparison algorithms evaluated on five evaluation metrics are computed. The ranking results show that the average ranks of our algorithm in terms of hamming loss, one error, average precision, ranking loss, and coverage are 3.16, 2.27, 2.15, 2.38, and 2.18, respectively. The average ranks of the dS2PML are second only to the corresponding centralized S2PML (cS2PML) algorithms and higher than other existing comparison algorithms in five evaluation metrics. The average rank differences in terms of Hamming loss, one error, average precision, ranking loss, and coverage between our proposed algorithm and the closest comparison algorithm are 0.28, 1.67, 1.80, 1.15, and 1.62, respectively. Additionally, owing to the distributed storage and decentralized processing of training data, our proposed dS2PML algorithm reduces CPU time by more than 65% and memory consumption by more than 6% compared to the centralized comparison algorithms. The experimental results indicate that our proposed algorithm outperforms the other state-of-the-art algorithms in classification accuracy, CPU time, and memory consumption.

A Distributed Algorithm for Graph Semi-Supervised Learning

Graph Learning on Millions of Data in Seconds: Label Propagation Acceleration on Graph Using Data Distribution

Efficient Distributed Semi-Supervised Learning using Stochastic Regularization over Affinity Graphs

Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive

Distributed Online Semi-Supervised Support Vector Machine

Distributed Semi-Supervised Metric Learning.

Distributionally Robust Semi-Supervised Learning Over Graphs

Semi-Supervised Learning with Close-Form Label Propagation Using a Bipartite Graph

Efficient And Robust Semi-Supervised Learning Over A Sparse-Regularized Graph

Graph-based Semi-supervised Learning: A Comprehensive Review

A Graph Neural Network Based Decentralized Learning Scheme

Semi-Supervised Learning Through Label Propagation on Geodesics

Large Margin Graph Construction For Semi-Supervised Learning

Scalable and Inductive Semi-supervised Classifier with Sample Weighting Based on Graph Topology

Distributed Semi-Supervised Partial Multi-Label Learning over Networks

Decoupled Self-supervised Learning for Non-Homophilous Graphs

Semi-supervised label distribution learning via projection graph embedding

From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisited

Graph-based Semi-Supervised Learning by Mixed Label Propagation with a Soft Constraint.

Distributed Semi-supervised Regression Learning with Coefficient Regularization

Semi-supervised Learning on Graphs with Generative Adversarial Nets