Abstract:Multi-label learning for large-scale data is a grand challenge because of a large number of labels with a complex data structure. Hence, the existing large-scale multi-label methods either have unsatisfactory classification performance or are extremely time-consuming for training utilizing a massive amount of data. A broad learning system (BLS), a flat network with the advantages of succinct structures, is appropriate for addressing large-scale tasks. However, existing BLS models are not directly applicable for large-scale multi-label learning due to the large and complex label space. In this work, a novel multi-label classifier based on BLS (called BLS-MLL) is proposed with two new mechanisms: kernel-based feature reduction module and correlation-based label thresholding. The kernel-based feature reduction module contains three layers, namely, the feature mapping layer, enhancement nodes layer, and feature reduction layer. The feature mapping layer employs elastic network regularization to solve the randomness of features in order to improve performance. In the enhancement nodes layer, the kernel method is applied for high-dimensional nonlinear conversion to achieve high efficiency. The newly constructed feature reduction layer is used to further significantly improve both the training efficiency and accuracy when facing high-dimensionality with abundant or noisy information embedded in large-scale data. The correlation-based label thresholding enables BLS-MLL to generate a label-thresholding function for effective conversion of the final decision values to logical outputs, thus, improving the classification performance. Finally, experimental comparisons among six state-of-the-art multi-label classifiers on ten datasets demonstrate the effectiveness of the proposed BLS-MLL. The results of the classification performance show that BLS-MLL outperforms the compared algorithms in 86% of cases with better training efficiency in 90% of cases.

An efficient stacking model with label selection for multi-label classification

An Efficient Stacking Model of Multi-Label Classification Based on Pareto Optimum

Learning Label Specific Features for Multi-label Classification.

Enhancing Binary Relevance For Multi-Label Learning With Controlled Label Correlations Exploitation

Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification

Label Selection Algorithm Based on Boolean Interpolative Decomposition with Sequential Backward Selection for Multi-label Classification

Stacking Model of Multi-Label Classification Based on Pruning Strategies

Semi-Supervised Dual Relation Learning for Multi-Label Classification

LabCor: Multi-label Classification Using a Label Correction Strategy

Correlation-based pruning of dependent binary relevance models for Multi-label classification

Label Selection Algorithm Based on Ant Colony Optimization and Reinforcement Learning for Multi-label Classification.

Classifier chains for multi-label classification

Enhancing binary classification: A new stacking method via leveraging computational geometry

Partial Classifier Chains with Feature Selection by Exploiting Label Correlation in Multi-Label Classification

A hybrid principal label space transformation-based ridge regression and decision tree for multi-label classification

Multi-label classification with weighted classifier selection and stacked ensemble

Stacking Multi-View Broad Learning System with Residual Structures for Classification

Label Specific Features-Based Classifier Chains for Multi-Label Classification.

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

An Improved Classifier Chain Algorithm for Multi-label Classification of Big Data Analysis

Accurate and Efficient Large-Scale Multi-Label Learning With Reduced Feature Broad Learning System Using Label Correlation