Abstract:The radial basis function (RBF) neural network is a type of universal approximator, and has been widely used in various fields. Improving the training speed and compactness of RBF networks are critical for promoting their applications. In the present study, we propose a simple, fast, and effective RBF networks training method, which is based on the residual extreme points and their neighborhoods (thus called the REN method for short in this paper). The REN method calculates RBF centers and widths through a two-level iterative process, and realizes two main functionalities, namely 1) adding multiple centers within one pass through the whole data set, and 2) calculating RBF widths specifically for each center. The use of this algorithm does not need any parameter adjustments, and the models for approximation or classification can be obtained by only one run. The performance of the proposed REN algorithm is compared with the classic and powerful orthogonal least squares (OLS) algorithm. By reaching the same accuracies, the REN algorithm trains RBF networks 50 and 320 times faster, in the chirp (0 50 Hz, 2 s, 1 kHz, 2001 samples) and two-dimensional peaks (2401 samples) signal approximation tasks respectively, than the OLS algorithm does, and the number of centers obtained by the REN algorithm is reduced by half. When incorporating the same number of centers, the REN algorithm achieves accuracies up to 3 orders of magnitude higher than the best results obtained by the OLS algorithm. In the classification task of a real discrete breast cancer data, both methods result in accuracies comparable to many existent methods, but the REN algorithm has the advantages of fast training speeds and no requirements for parameter adjustments. The REN algorithm proposed in this study may potentially be used for tasks with large scale of data or applications that require high model performances.

An Online Modeling Approach Based Upon Improved Self-Organizing Radial Basis Function Neural Network

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

Splicing System Based Genetic Algorithms for Developing Rbf Networks Models

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

A new on-line modeling approach to nonlinear dynamic systems

Nonlinear System Modeling Using a Self-Organizing Recurrent Radial Basis Function Neural Network

Online Modeling with Tunable Rbf Network

An Online Adjusting RBF Neural Network for Nonlinear System Modeling

Research on an Online Self-Organizing Radial Basis Function Neural Network

Function Approximation Based on Self-Adaptive RBF Neural Network with Combined Clustering Algorithm

A Self-Organizing RBF Neural Network Based on Distance Concentration Immune Algorithm.

Optimizing Radial Basis Function Neural Network Based on Rough Sets and Affinity Propagation Clustering Algorithm

RBF design method based on center clustering and PSO

An Incremental Neuronal-Activity-based RBF Neural Network for Nonlinear System Modeling.

Using self-organizing incremental neural network (SOINN) For radial basis function networks

Self-organization of a Recurrent RBF Neural Network Using an Information-Oriented Algorithm.

Self-growing RBF Neural Networks and Parameters Optimization

Identification and modeling of nonlinear dynamical systems using a novel self-organizing RBF-based approach

A Forecasting Method Based on Online Self-Correcting Single Model RBF Neural Network

A Brand-New Simple, Fast, and Effective Residual-Based Method for Radial Basis Function Neural Networks Training

Self-creating and Adaptive Learning of RBF Networks: Merging Soft-Competition Clustering Algorithm with Network Growth Technique