Abstract:The original Broad Learning System (BLS) on new added nodes and its existing efficient implementation both assume the ridge parameter lambda -> 0 in the ridge inverse to approximate the generalized inverse, and compute the generalized inverse solution for the output weights. In this paper, we propose two ridge solutions for the output weights in the BLS on added nodes, where lambda -> 0 is no longer assumed, and lambda can be any positive real number. One of the proposed ridge solutions computes the output weights from the inverse Cholesky factor, which is updated efficiently by extending the existing inverse Cholesky factorization. The other proposed ridge solution computes the output weights from the ridge inverse, and updates the ridge inverse by extending the Greville's method that is a classical tool to compute the generalized inverse of partitioned matrices. For the proposed efficient ridge solution based on the inverse Cholesky factor, we also develop another implementation that is numerically more stable when the ridge parameter lambda is very small. The proposed ridge solution based on the ridge inverse and the numerically more stable implementation of the proposed efficient ridge solution require the same complexity as the original BLS and the existing efficient BLS, respectively. Moreover, the speedups of the proposed efficient ridge solution to the original BLS and the existing efficient BLS are 3 and more than 1.67 respectively, when the computational complexities for each update are compared, and the speedups are 1.99 - 2.52 and 1.31 - 1.58, respectively, when the total training time is compared by numerical experiments. On the other hand, our numerical experiments show that both the proposed ridge solutions for BLS achieve better testing accuracies than the original BLS and the existing efficient BLS.

Two Ridge Solutions for the Incremental Broad Learning System on Added Nodes

Reducing the Computational Complexity of Pseudoinverse for the Incremental Broad Learning System on Added Inputs

Robust Incremental Broad Learning System for Data Streams of Uncertain Scale

Pseudo inverse versus iterated projection: Novel learning approach and its application on broad learning system

Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture

Broad Learning System Based on Maximum Correntropy Criterion

Efficient Decremental Learning Algorithms for Broad Learning System

Incremental Bayesian broad learning system and its industrial application

A Pseudoinversion-Free Method for Weight Updating in Broad Learning System

A Population-Based Incremental Learning Method for Robust Optimal Solutions

An Improved Population-Based Incremental Learning Method For Inverse Problems

Analysis and Variants of Broad Learning System

Recursion-Free Online Multiple Incremental/Decremental Analysis Based on Ridge Support Vector Learning

Broad Learning With Reinforcement Learning Signal Feedback: Theory and Applications

An improved asynchronous batch gradient method for ridge polynomial neural network

Learning to Branch: Accelerating Resource Allocation in Wireless Networks

Stacked Broad Learning System: From Incremental Flatted Structure to Deep Model

Broad Minimax Probability Learning System and its Application in Regression Modeling

Tree Broad Learning System for Small Data Modeling

Factorization of Broad Expansion for Broad Learning System

Incremental Multi-Layer Broad Learning System with Stochastic Configuration Algorithm for Regression