Abstract:The broad learning system (BLS) featuring lightweight, incremental extension, and strong generalization capabilities has been successful in its applications. Despite these advantages, BLS struggles in multitask learning (MTL) scenarios with its limited ability to simultaneously unravel multiple complex tasks where existing BLS models cannot adequately capture and leverage essential information across tasks, decreasing their effectiveness and efficacy in MTL scenarios. To address these limitations, we proposed an innovative MTL framework explicitly designed for BLS, named group sparse regularization for broad multitask learning system using related task-wise (BMtLS-RG). This framework combines a task-related BLS learning mechanism with a group sparse optimization strategy, significantly boosting BLS's ability to generalize in MTL environments. The task-related learning component harnesses task correlations to enable shared learning and optimize parameters efficiently. Meanwhile, the group sparse optimization approach helps minimize the effects of irrelevant or noisy data, thus enhancing the robustness and stability of BLS in navigating complex learning scenarios. To address the varied requirements of MTL challenges, we presented two additional variants of BMtLS-RG: BMtLS-RG with sharing parameters of feature mapped nodes (BMtLS-RGf), which integrates a shared feature mapping layer, and BMtLS-RGf and enhanced nodes (BMtLS-RGfe), which further includes an enhanced node layer atop the shared feature mapping structure. These adaptations provide customized solutions tailored to the diverse landscape of MTL problems. We compared BMtLS-RG with state-of-the-art (SOTA) MTL and BLS algorithms through comprehensive experimental evaluation across multiple practical MTL and UCI datasets. BMtLS-RG outperformed SOTA methods in 97.81% of classification tasks and achieved optimal performance in 96.00% of regression tasks, demonstrating its superior accuracy and robustness. Furthermore, BMtLS-RG exhibited satisfactory training efficiency, outperforming existing MTL algorithms by 8.04-42.85 times.

Incremental Multi-Layer Broad Learning System with Stochastic Configuration Algorithm for Regression

TKS-BLS: Temporal Kernel Stationary Broad Learning System for Enhanced Modeling, Anomaly Detection, and Incremental Learning with Application to Ironmaking Processes

Stochastic configuration broad learning system and its approximation capability analysis

Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture

Incremental Bayesian broad learning system and its industrial application

Analysis and Variants of Broad Learning System

Stacked Broad Learning System: From Incremental Flatted Structure to Deep Model

Robust Incremental Broad Learning System for Data Streams of Uncertain Scale

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

Adaptive Deep Spiking Neural Network with Global-Local Learning Via Balanced Excitatory and Inhibitory Mechanism

Broad Minimax Probability Learning System and its Application in Regression Modeling

An Incremental-Self-Training-Guided Semi-Supervised Broad Learning System

Stochastic Configuration Networks: Fundamentals and Algorithms

Broad Learning With Reinforcement Learning Signal Feedback: Theory and Applications

Deeper Insights into Learning Performance of Stochastic Configuration Networks

Recurrent Broad Learning Systems for Time Series Prediction

ConvBLS: An Effective and Efficient Incremental Convolutional Broad Learning System for Image Classification

SPRBF-ABLS: a novel attention-based broad learning systems with sparse polynomial-based radial basis function neural networks

Broad learning system based ensemble deep model

Broad Multitask Learning System With Group Sparse Regularization

Enhancing Deep Stochastic Configuration Networks: Efficient Training via Low-Rank Matrix Approximation