Abstract:Multi-label learning for large-scale data is a grand challenge because of a large number of labels with a complex data structure. Hence, the existing large-scale multi-label methods either have unsatisfactory classification performance or are extremely time-consuming for training utilizing a massive amount of data. A broad learning system (BLS), a flat network with the advantages of succinct structures, is appropriate for addressing large-scale tasks. However, existing BLS models are not directly applicable for large-scale multi-label learning due to the large and complex label space. In this work, a novel multi-label classifier based on BLS (called BLS-MLL) is proposed with two new mechanisms: kernel-based feature reduction module and correlation-based label thresholding. The kernel-based feature reduction module contains three layers, namely, the feature mapping layer, enhancement nodes layer, and feature reduction layer. The feature mapping layer employs elastic network regularization to solve the randomness of features in order to improve performance. In the enhancement nodes layer, the kernel method is applied for high-dimensional nonlinear conversion to achieve high efficiency. The newly constructed feature reduction layer is used to further significantly improve both the training efficiency and accuracy when facing high-dimensionality with abundant or noisy information embedded in large-scale data. The correlation-based label thresholding enables BLS-MLL to generate a label-thresholding function for effective conversion of the final decision values to logical outputs, thus, improving the classification performance. Finally, experimental comparisons among six state-of-the-art multi-label classifiers on ten datasets demonstrate the effectiveness of the proposed BLS-MLL. The results of the classification performance show that BLS-MLL outperforms the compared algorithms in 86% of cases with better training efficiency in 90% of cases.

Boosting Adaptive Weighted Broad Learning System for Multi-Label Learning

Boosting label weighted extreme learning machine for classifying multi-label imbalanced data

Dual Enhancement for Multi-Label Learning with Missing Labels

Accurate and Efficient Large-Scale Multi-Label Learning With Reduced Feature Broad Learning System Using Label Correlation

Class-Imbalanced Complementary-Label Learning via Weighted Loss

A Dual-Branch Learning Model with Gradient-Balanced Loss for Long-Tailed Multi-Label Text Classification

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Weak Labeled Multi-Label Active Learning for Image Classification

Multi-label Classification: Dealing with Imbalance by Combining Labels

Semi-automatic Labeling with Active Learning for Multi-label Image Classification.

Discriminative elastic-net broad learning systems for visual classification

Effective Multi-Label Active Learning for Text Classification

Balancing Efficiency vs. Effectiveness and Providing Missing Label Robustness in Multi-Label Stream Classification

Scalable Label Distribution Learning for Multi-Label Classification

Multi-label classification with weak labels by learning label correlation and label regularization

Weak-Labeled Active Learning with Conditional Label Dependence for Multilabel Image Classification

A Robust Semi-Supervised Broad Learning System Guided by Ensemble-Based Self-Training

Rebalancing Multi-Label Class-Incremental Learning

Broad learning system with manifold regularized sparse features for semi-supervised classification

Evolutionary Weighted Broad Learning and Its Application to Fault Diagnosis in Self-Organizing Cellular Networks

A Label-Specific Attention-Based Network with Regularized Loss for Multi-label Classification