Abstract:This paper investigates the construction of sparse radial basis function neural networks (RBFNNs) for classification problems. An efficient two-phase construction algorithm (which is abbreviated as TPCLR1 for simplicity) is proposed by using L1 regularization. In the first phase, an improved maximum data coverage (IMDC) algorithm is presented for the initialization of RBF centers and widths. Then a specialized Orthant-Wise Limited-memory Quasi-Newton (sOWL-QN) method is employed to perform simultaneous network pruning and parameter optimization in the second phase. The advantages of TPCLR1 lie in that better generalization performance is guaranteed with higher model sparsity, and the required storage space and testing time are much reduced. Besides these, only the regularization parameter and the maximum number of function evaluations are required to be prescribed, then the entire construction procedure becomes automatic. The learning algorithm is verified by several classification benchmarks with different levels of complexity. The experimental results show that an appropriate value of the regularization parameter is easy to find without using costly cross validation, and the proposed TPCLR1 offers an efficient procedure to construct sparse RBFNN classifiers with good generalization performance.

Two-stage Partial Least Squares Regression for Constructing Radial Basis Function Networks

Constructing radial basis function networks based on partial least squares modeling method

Pls Algorithm For Radial Basis Function Networks

An Improved Generalized Predictive Control in a Robust Dynamic Partial Least Square Framework

A Nonlinear Adaptive Controller Based on RBF Networks

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

A two-level learning hierarchy for the radial basis function networks

An On-Line Learning Radial Basis Function Network and Its Application

A Hybrid Model of Partial Least Squares and Rbf Neural Networks for System Identification

A Novel Radial Basis Function Neural Network For Approximation

Approximation of Function by Adaptively Growing Radial Basis Function Neural Networks.

Fast Backward Elimination Algorithm for Radial Basis Function Networks Pruning

A Novel Two Stage Algorithm for Construction of RBF Neural Models Based on A-optimality Criterion

Proposal of Adaptive T-S Fuzzy Radial Basis Function Network

An intelligent PID controller based on variable structure radial basis function network

Efficient Construction of Sparse Radial Basis Function Neural Networks Using L-1-Regularization

A Linear Quadratic Regulation Controller Based on Radial Basis Function Network Approximation

Radial Basis Function Networks Based on Adaptive Projective Learning Algorithm and Its Applications

Near-Optimal Tracking Control of Partially Unknown Discrete-Time Nonlinear Systems Based on Radial Basis Function Neural Network

Adaptive Pseudo Linear Rbf Model for Process Control

Self-tuning and approximation via RBF neural networks