Abstract:Multi-label learning for large-scale data is a grand challenge because of a large number of labels with a complex data structure. Hence, the existing large-scale multi-label methods either have unsatisfactory classification performance or are extremely time-consuming for training utilizing a massive amount of data. A broad learning system (BLS), a flat network with the advantages of succinct structures, is appropriate for addressing large-scale tasks. However, existing BLS models are not directly applicable for large-scale multi-label learning due to the large and complex label space. In this work, a novel multi-label classifier based on BLS (called BLS-MLL) is proposed with two new mechanisms: kernel-based feature reduction module and correlation-based label thresholding. The kernel-based feature reduction module contains three layers, namely, the feature mapping layer, enhancement nodes layer, and feature reduction layer. The feature mapping layer employs elastic network regularization to solve the randomness of features in order to improve performance. In the enhancement nodes layer, the kernel method is applied for high-dimensional nonlinear conversion to achieve high efficiency. The newly constructed feature reduction layer is used to further significantly improve both the training efficiency and accuracy when facing high-dimensionality with abundant or noisy information embedded in large-scale data. The correlation-based label thresholding enables BLS-MLL to generate a label-thresholding function for effective conversion of the final decision values to logical outputs, thus, improving the classification performance. Finally, experimental comparisons among six state-of-the-art multi-label classifiers on ten datasets demonstrate the effectiveness of the proposed BLS-MLL. The results of the classification performance show that BLS-MLL outperforms the compared algorithms in 86% of cases with better training efficiency in 90% of cases.

Takagi-Sugeno-Kang Fuzzy Systems for High-Dimensional Multi-Label Classification

Multi-Label Takagi-Sugeno-Kang Fuzzy System

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Scalable Label Distribution Learning for Multi-Label Classification

Multi-task Joint Feature Selection for Multi-label Classification

Multi-Dimensional Classification Via Class Space Fusion and Comprehensive Label Correlations

Multi-Label Hyperspectral Classification with Discriminative Features.

Joint Feature Selection and Classification for Multilabel Learning

Multi-dimensional Multi-Label Classification: Towards Encompassing Heterogeneous Label Spaces and Multi-Label Annotations

Fuzzy Mutual Information-Based Multilabel Feature Selection with Label Dependency and Streaming Labels

A Robust Multilabel Method Integrating Rule-based Transparent Model, Soft Label Correlation Learning and Label Noise Resistance

A Label Information Aware Model for Multi-label Text Classification

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

Improving Multi-Label Classification with Missing Labels by Learning Label-Specific Features

Accurate and Efficient Large-Scale Multi-Label Learning With Reduced Feature Broad Learning System Using Label Correlation

Feature Selection for Multi-Label Learning Based on Variable-Degree Multi-Granulation Decision-Theoretic Rough Sets

A hybrid principal label space transformation-based ridge regression and decision tree for multi-label classification

Exploiting Inconsistency Problem in Multi-label Classification Via Metric Learning

Fuzzy rough discrimination and label weighting for multi-label feature selection

Intuitionistic fuzzy least squares MLTSVM for noisy label data using label-specific features and local label correlation

TSK Fuzzy System Towards Few Labeled Incomplete Multi-View Data Classification