Abstract:Inthis paper, a distributed semi-supervised partial multi-label learning (dS2PML) algorithm is proposed, which can be used to address the problem of distributed classification of partially multi-labeled data and unlabeled data. In this algorithm, we utilize the multi-kernel function together with the label correlation term to construct the discriminant function. In addition, to obtain a decentralized implementation, we design a reconstructed error on the labeling confidence based on globally common basic data that are selected by a distributed strategy. By exploiting the similarity structure among feature and label spaces under the sparsity constraint, the labeling confidences of partially multi-labeled and unlabeled data are estimated in a decentralized manner. Meanwhile, by using the sparse random feature map to approximate the kernel feature map, the multi-label classifier can be trained under the supervision of the estimated labeling confidence. Experiments on multiple real datasets are conducted to evaluate the learning performance of the proposed approach. According to the experimental results, the average ranks of all the comparison algorithms evaluated on five evaluation metrics are computed. The ranking results show that the average ranks of our algorithm in terms of hamming loss, one error, average precision, ranking loss, and coverage are 3.16, 2.27, 2.15, 2.38, and 2.18, respectively. The average ranks of the dS2PML are second only to the corresponding centralized S2PML (cS2PML) algorithms and higher than other existing comparison algorithms in five evaluation metrics. The average rank differences in terms of Hamming loss, one error, average precision, ranking loss, and coverage between our proposed algorithm and the closest comparison algorithm are 0.28, 1.67, 1.80, 1.15, and 1.62, respectively. Additionally, owing to the distributed storage and decentralized processing of training data, our proposed dS2PML algorithm reduces CPU time by more than 65% and memory consumption by more than 6% compared to the centralized comparison algorithms. The experimental results indicate that our proposed algorithm outperforms the other state-of-the-art algorithms in classification accuracy, CPU time, and memory consumption.

Stacked Co-Training for Semi-Supervised Multi-Label Learning

Semi-Stacking for Semi-supervised Sentiment Classification.

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Dual Enhancement for Multi-Label Learning with Missing Labels

Semi-Supervised Learning with Multi-Head Co-Training

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Multi-head Co-Training: an Uncertainty-Aware and Robust Semi-Supervised Learning Framework

Partial Multi-label Learning with Label and Feature Collaboration

Graph-Based Semi-Supervised Learning with Multi-Label

Semi-supervised Multi-task Learning for Semantics and Depth

Improving Semi-Supervised Text Classification with Dual Meta-Learning

Diverse Cotraining Makes Strong Semi-Supervised Segmentor

Semi-supervised regression via embedding space mapping and pseudo-label smearing

MixLab: An Informative Semi-supervised Method for Multi-label Classification

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Partial multi-label learning via semi-supervised subspace collaboration

Learning From Semi-Supervised Weak-Label Data

Semi-Supervised Regression with Co-Training Style Algorithms

Distributed Information-Theoretic Semisupervised Learning for Multilabel Classification

Distributed Semi-Supervised Partial Multi-Label Learning over Networks

Semi-Supervised Partial Multi-Label Classification via Consistency Learning