Abstract:Recently, a novel learning algorithm called the broad learning system (BLS) has been established by using the theory of pseudoinverse and compressed sensing technology. As an alternative to deep learning, BLS has gained extensive attention in data analytics. Unlike the existing deep structures based learning tools (such as deep neural networks), it is able to rapidly achieve incremental learning, and does not require tedious retraining to remodel the system. However, given image data modeling tasks, 1-D BLS requires a conventional vectorization operation, the dimension of input will be quite large for high resolution image. This operation may result in huge computational complexity, thereby increasing the time of model construction. To resolve this issue, a 2-D version of BLS, namely 2-D-BLS, is first proposed to fast construct randomized learner models by using matrix inputs. Specifically, the proposed method employs left and right projecting vectors to replace the usual high dimensional input weight. Moreover, the theoretical analyses on the superiority of 2-D-BLS against BLS are presented in terms of the algorithm complexity and the difference of random parameter space. Empirical results on MNIST dataset, NORB 3-D object image recognition dataset, ORL dataset, YaleB dataset, and handwritten digit dataset demonstrate that the proposed 2-D-BLS outperforms the existing extensions of BLS and state-of-the-art 2-D machine learning methods in terms of the learning efficiency, showing good potential of 2-D-BLS for image data analytics. Impact Statementas a novel learning tool, BLS has achieved great success in many fields. Image recognition is one of the most widely used fields of artificial intelligence. But, BLS is a 1-D model, the vectorization operation is necessary to convert matrix input data into a row or a column vector. This operation will lead to explosion of dimensionality and increase the time of model construction when it is coming to image data analytic with 2-D input. This article first proposes a 2-D extension of BLS for high resolution image data analytic. The proposed method can not only avoid the explosion of dimensionality, but also construct the whole structure with matrix-inputs rapidly and dynamically. The improvement of this method is expected to provide a novel and great choice for the field of image recognition, such as face recognition, industrial inspection, behavior recognition, etc., in the future.

Pseudo inverse versus iterated projection: Novel learning approach and its application on broad learning system

Fast Inverse-Free Generalized Sparse Bayesian Iearning Algorithm

TKS-BLS: Temporal Kernel Stationary Broad Learning System for Enhanced Modeling, Anomaly Detection, and Incremental Learning with Application to Ironmaking Processes

Reducing the Computational Complexity of Pseudoinverse for the Incremental Broad Learning System on Added Inputs

A Real Coded Population-Based Incremental Learning for Inverse Problems in Continuous Space

Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture

An Improved Population-Based Incremental Learning Method For Inverse Problems

A Pseudoinversion-Free Method for Weight Updating in Broad Learning System

Robust Incremental Broad Learning System for Data Streams of Uncertain Scale

A Population-Based Incremental Learning Method for Robust Optimal Solutions

A New Robust Projection Distributed Broad Learning Under Redundant Samples and Noisy Environment

Incremental Bayesian broad learning system and its industrial application

Two-Dimensional Broad Learning System for Data Analytic

Two Ridge Solutions for the Incremental Broad Learning System on Added Nodes

Adaptive operator learning for infinite-dimensional Bayesian inverse problems

Analysis and Variants of Broad Learning System

Broad Learning With Reinforcement Learning Signal Feedback: Theory and Applications

Broad Learning System Based on Maximum Correntropy Criterion

Iterative Relaxing Gradient Projection for Continual Learning

What's in a Prior? Learned Proximal Networks for Inverse Problems

Faster Projection-free Online Learning