Abstract:Multi-label learning for large-scale data is a grand challenge because of a large number of labels with a complex data structure. Hence, the existing large-scale multi-label methods either have unsatisfactory classification performance or are extremely time-consuming for training utilizing a massive amount of data. A broad learning system (BLS), a flat network with the advantages of succinct structures, is appropriate for addressing large-scale tasks. However, existing BLS models are not directly applicable for large-scale multi-label learning due to the large and complex label space. In this work, a novel multi-label classifier based on BLS (called BLS-MLL) is proposed with two new mechanisms: kernel-based feature reduction module and correlation-based label thresholding. The kernel-based feature reduction module contains three layers, namely, the feature mapping layer, enhancement nodes layer, and feature reduction layer. The feature mapping layer employs elastic network regularization to solve the randomness of features in order to improve performance. In the enhancement nodes layer, the kernel method is applied for high-dimensional nonlinear conversion to achieve high efficiency. The newly constructed feature reduction layer is used to further significantly improve both the training efficiency and accuracy when facing high-dimensionality with abundant or noisy information embedded in large-scale data. The correlation-based label thresholding enables BLS-MLL to generate a label-thresholding function for effective conversion of the final decision values to logical outputs, thus, improving the classification performance. Finally, experimental comparisons among six state-of-the-art multi-label classifiers on ten datasets demonstrate the effectiveness of the proposed BLS-MLL. The results of the classification performance show that BLS-MLL outperforms the compared algorithms in 86% of cases with better training efficiency in 90% of cases.

Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization

A Bayesian Network nearest k-labels method for Multi-label classification

A label distance maximum-based classifier for multi-label learning

ML-KNN: A lazy learning approach to multi-label learning

MLGN:A Multi-Label Guided Network for Improving Text Classification

Hierarchical Multi-Granularity Attention- Based Hybrid Neural Network for Text Classification.

Partial Multi-label Learning with Label and Feature Collaboration

KeNet:Knowledge-enhanced Doc-Label Attention Network for Multi-label text classification

Neural Networks for Multi-Instance Learning

Deep Multimodal Network for Multi-Label Classification.

A New multi-instance multi-label learning approach for image and text classification

A K-Nearest Neighbor Based Algorithm for Multi-Label Classification.

Accurate and Efficient Large-Scale Multi-Label Learning With Reduced Feature Broad Learning System Using Label Correlation

Learning Bayesian Multinets from Labeled and Unlabeled Data for Knowledge Representation.

Hierarchical Multilabel Text Classification Via Multitask Learning.

Multi-label Classification using Labels as Hidden Nodes

A Review on Multi-Label Learning Algorithms

Gated Neural Network with Regularized Loss for Multi-label Text Classification.

Multi-label Text Categorization with Joint Learning Predictions-as-Features Method

Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification.