Abstract:Inthis paper, a distributed semi-supervised partial multi-label learning (dS2PML) algorithm is proposed, which can be used to address the problem of distributed classification of partially multi-labeled data and unlabeled data. In this algorithm, we utilize the multi-kernel function together with the label correlation term to construct the discriminant function. In addition, to obtain a decentralized implementation, we design a reconstructed error on the labeling confidence based on globally common basic data that are selected by a distributed strategy. By exploiting the similarity structure among feature and label spaces under the sparsity constraint, the labeling confidences of partially multi-labeled and unlabeled data are estimated in a decentralized manner. Meanwhile, by using the sparse random feature map to approximate the kernel feature map, the multi-label classifier can be trained under the supervision of the estimated labeling confidence. Experiments on multiple real datasets are conducted to evaluate the learning performance of the proposed approach. According to the experimental results, the average ranks of all the comparison algorithms evaluated on five evaluation metrics are computed. The ranking results show that the average ranks of our algorithm in terms of hamming loss, one error, average precision, ranking loss, and coverage are 3.16, 2.27, 2.15, 2.38, and 2.18, respectively. The average ranks of the dS2PML are second only to the corresponding centralized S2PML (cS2PML) algorithms and higher than other existing comparison algorithms in five evaluation metrics. The average rank differences in terms of Hamming loss, one error, average precision, ranking loss, and coverage between our proposed algorithm and the closest comparison algorithm are 0.28, 1.67, 1.80, 1.15, and 1.62, respectively. Additionally, owing to the distributed storage and decentralized processing of training data, our proposed dS2PML algorithm reduces CPU time by more than 65% and memory consumption by more than 6% compared to the centralized comparison algorithms. The experimental results indicate that our proposed algorithm outperforms the other state-of-the-art algorithms in classification accuracy, CPU time, and memory consumption.

A study based on distributed supervised machine learning system for text classification

Distributed Online Semi-Supervised Support Vector Machine

Distributed Model Reuse with Multiple Classifiers

Coded Distributed Graph-Based Semi-Supervised Learning

SSXCS:Semi-supervised learning classifier system

Distributed Information-Theoretic Semisupervised Learning for Multilabel Classification

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

Communication‐efficient distributed large‐scale sparse multinomial logistic regression

Distributed Learning Strategy Based On Chips For Classification With Large-Scale Dataset

Distributed Semi-Supervised Metric Learning.

Distributed Semi-Supervised Partial Multi-Label Learning over Networks

Xcsc: a Novel Approach to Clustering with Extended Classifier System.

DiSMEC - Distributed Sparse Machines for Extreme Multi-label Classification

Highly Accurate Distributed Classification Of Web Documents

A Survey From Distributed Machine Learning to Distributed Deep Learning

Text Classification Using Hybrid Machine Learning Algorithms on Big Data

MSML: A Novel Multilevel Semi-Supervised Machine Learning Framework for Intrusion Detection System.

A distributed approach for large-scale classifier training and image classification

Scalable Label Distribution Learning for Multi-Label Classification

A Distributed Dynamical Classification System for Data Grid and Its Application in Breast Cancer Grid

Exploiting Distributional Semantics to Benefit Machine Learning in Automated Classification of Chinese Clinical Text.