Abstract:The broad learning system (BLS) featuring lightweight, incremental extension, and strong generalization capabilities has been successful in its applications. Despite these advantages, BLS struggles in multitask learning (MTL) scenarios with its limited ability to simultaneously unravel multiple complex tasks where existing BLS models cannot adequately capture and leverage essential information across tasks, decreasing their effectiveness and efficacy in MTL scenarios. To address these limitations, we proposed an innovative MTL framework explicitly designed for BLS, named group sparse regularization for broad multitask learning system using related task-wise (BMtLS-RG). This framework combines a task-related BLS learning mechanism with a group sparse optimization strategy, significantly boosting BLS's ability to generalize in MTL environments. The task-related learning component harnesses task correlations to enable shared learning and optimize parameters efficiently. Meanwhile, the group sparse optimization approach helps minimize the effects of irrelevant or noisy data, thus enhancing the robustness and stability of BLS in navigating complex learning scenarios. To address the varied requirements of MTL challenges, we presented two additional variants of BMtLS-RG: BMtLS-RG with sharing parameters of feature mapped nodes (BMtLS-RGf), which integrates a shared feature mapping layer, and BMtLS-RGf and enhanced nodes (BMtLS-RGfe), which further includes an enhanced node layer atop the shared feature mapping structure. These adaptations provide customized solutions tailored to the diverse landscape of MTL problems. We compared BMtLS-RG with state-of-the-art (SOTA) MTL and BLS algorithms through comprehensive experimental evaluation across multiple practical MTL and UCI datasets. BMtLS-RG outperformed SOTA methods in 97.81% of classification tasks and achieved optimal performance in 96.00% of regression tasks, demonstrating its superior accuracy and robustness. Furthermore, BMtLS-RG exhibited satisfactory training efficiency, outperforming existing MTL algorithms by 8.04-42.85 times.

Universal Target Learning: an Efficient and Effective Technique for Semi-Naive Bayesian Learning.

Target Learning: A Novel Framework to Mine Significant Dependencies for Unlabeled Data

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

Evolutionary Lazy Learning for Naive Bayes Classification

Discriminatory Target Learning: Mining Significant Dependence Relationships from Labeled and Unlabeled Data.

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Learning Balanced Bayesian Classifiers from Labeled and Unlabeled Data

Semi-supervised Learning for K-Dependence Bayesian Classifiers

Cumulative Dual-Branch Network Framework for Long-Tailed Multi-Class Classification

Tree-Like Branching Network for Multi-class Classification

Touch the Core: Exploring Task Dependence Among Hybrid Targets for Recommendation

Hierarchical Independence Thresholding for Learning Bayesian Network Classifiers.

Label-Driven Learning Framework: Towards More Accurate Bayesian Network Classifiers Through Discrimination of High-Confidence Labels

Discriminative Structure Learning of Bayesian Network Classifiers from Training Dataset and Testing Instance.

Deep Bayesian Multi-Target Learning for Recommender Systems

Target-Based Temporal Difference Learning

Probability Knowledge Acquisition from Unlabeled Instance Based on Dual Learning

Broad Multitask Learning System With Group Sparse Regularization

An Efficient Transfer Learning Method with Auxiliary Information

Structure Learning of Bayesian Network Based on Adaptive Thresholding

A Bayesian Approach to (Online) Transfer Learning: Theory and Algorithms