Abstract:The broad learning system (BLS) featuring lightweight, incremental extension, and strong generalization capabilities has been successful in its applications. Despite these advantages, BLS struggles in multitask learning (MTL) scenarios with its limited ability to simultaneously unravel multiple complex tasks where existing BLS models cannot adequately capture and leverage essential information across tasks, decreasing their effectiveness and efficacy in MTL scenarios. To address these limitations, we proposed an innovative MTL framework explicitly designed for BLS, named group sparse regularization for broad multitask learning system using related task-wise (BMtLS-RG). This framework combines a task-related BLS learning mechanism with a group sparse optimization strategy, significantly boosting BLS's ability to generalize in MTL environments. The task-related learning component harnesses task correlations to enable shared learning and optimize parameters efficiently. Meanwhile, the group sparse optimization approach helps minimize the effects of irrelevant or noisy data, thus enhancing the robustness and stability of BLS in navigating complex learning scenarios. To address the varied requirements of MTL challenges, we presented two additional variants of BMtLS-RG: BMtLS-RG with sharing parameters of feature mapped nodes (BMtLS-RGf), which integrates a shared feature mapping layer, and BMtLS-RGf and enhanced nodes (BMtLS-RGfe), which further includes an enhanced node layer atop the shared feature mapping structure. These adaptations provide customized solutions tailored to the diverse landscape of MTL problems. We compared BMtLS-RG with state-of-the-art (SOTA) MTL and BLS algorithms through comprehensive experimental evaluation across multiple practical MTL and UCI datasets. BMtLS-RG outperformed SOTA methods in 97.81% of classification tasks and achieved optimal performance in 96.00% of regression tasks, demonstrating its superior accuracy and robustness. Furthermore, BMtLS-RG exhibited satisfactory training efficiency, outperforming existing MTL algorithms by 8.04-42.85 times.

Better Together: Using Multi-task Learning to Improve Feature Selection within Structural Datasets

MTLComb: multi-task learning combining regression and classification tasks for joint feature selection

Multitask Sparse Bayesian Learning with Applications in Structural Health Monitoring

Multi-task Sparse Structure Learning

Multi-Task Sparse Bayesian Learning for Model Updating in Structural Health Monitoring

On Better Exploring and Exploiting Task Relationships in Multitask Learning: Joint Model and Feature Learning.

Multitask Feature Learning Meets Robust Tensor Decomposition for EEG Classification

When is an SHM problem a Multi-Task-Learning problem?

Traffic Flow and Speed Forecasting Through a Bayesian Deep Multi-Linear Relationship Network.

Multi-Task Learning with Group-Specific Feature Space Sharing

Multi-task Model and Feature Joint Learning

Multi-Task Cooperative Learning via Searching for Flat Minima

Semi-supervised Feature Selection with Exploiting Shared Information among Multiple Tasks

CFS-MTL: A Causal Feature Selection Mechanism for Multi-task Learning Via Pseudo-intervention

Towards Better Multi-task Learning: A Framework for Optimizing Dataset Combinations in Large Language Models

Multiple Task Learning Using Iteratively Reweighted Least Square.

Broad Multitask Learning System With Group Sparse Regularization

Robust Multi-Task Feature Learning

Sparse Multi-kernel Based Multi-task Learning for Joint Prediction of Clinical Scores and Biomarker Identification in Alzheimer's Disease.

Multitask Feature Selection by Graph-Clustered Feature Sharing

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs