Abstract:Inthis paper, a distributed semi-supervised partial multi-label learning (dS2PML) algorithm is proposed, which can be used to address the problem of distributed classification of partially multi-labeled data and unlabeled data. In this algorithm, we utilize the multi-kernel function together with the label correlation term to construct the discriminant function. In addition, to obtain a decentralized implementation, we design a reconstructed error on the labeling confidence based on globally common basic data that are selected by a distributed strategy. By exploiting the similarity structure among feature and label spaces under the sparsity constraint, the labeling confidences of partially multi-labeled and unlabeled data are estimated in a decentralized manner. Meanwhile, by using the sparse random feature map to approximate the kernel feature map, the multi-label classifier can be trained under the supervision of the estimated labeling confidence. Experiments on multiple real datasets are conducted to evaluate the learning performance of the proposed approach. According to the experimental results, the average ranks of all the comparison algorithms evaluated on five evaluation metrics are computed. The ranking results show that the average ranks of our algorithm in terms of hamming loss, one error, average precision, ranking loss, and coverage are 3.16, 2.27, 2.15, 2.38, and 2.18, respectively. The average ranks of the dS2PML are second only to the corresponding centralized S2PML (cS2PML) algorithms and higher than other existing comparison algorithms in five evaluation metrics. The average rank differences in terms of Hamming loss, one error, average precision, ranking loss, and coverage between our proposed algorithm and the closest comparison algorithm are 0.28, 1.67, 1.80, 1.15, and 1.62, respectively. Additionally, owing to the distributed storage and decentralized processing of training data, our proposed dS2PML algorithm reduces CPU time by more than 65% and memory consumption by more than 6% compared to the centralized comparison algorithms. The experimental results indicate that our proposed algorithm outperforms the other state-of-the-art algorithms in classification accuracy, CPU time, and memory consumption.

Distributed Information-Theoretic Semisupervised Learning for Multilabel Classification

Distributed Semi-supervised Multi-label Classification with Quantized Communication

Distributed Semi-Supervised Partial Multi-Label Learning over Networks

Distributed Semi-Supervised Metric Learning.

Scalable Label Distribution Learning for Multi-Label Classification

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Distributed Online Semi-Supervised Support Vector Machine

A semi-supervised label distribution learning model with label correlations and data manifold exploration

A survey of multi-label classification based on supervised and semi-supervised learning

Semi-Supervised Label Distribution Learning with Co-regularization

Dual Relation Semi-Supervised Multi-Label Learning.

Semi-supervised Multi-Label Learning with Missing Labels via Correlation Information

Dual-Decoupling Learning and Metric-Adaptive Thresholding for Semi-Supervised Multi-Label Learning

Label distribution for multimodal machine learning

Semi-supervised Partial Multi-Label Classification with Low-Rank and Manifold Constraints

Semi-Supervised Partial Multi-Label Classification via Consistency Learning

Efficient multi-class unlabeled constrained semi-supervised SVM.

Correlation-Induced Label Prior for Semi-Supervised Multi-Label Learning

Semi-Supervised Multi-Label Linear Discriminant Analysis

MixLab: An Informative Semi-supervised Method for Multi-label Classification

Multi-Label Classification with Unlabeled Data: an Inductive Approach.