Abstract:The radial basis function (RBF) neural network is a type of universal approximator, and has been widely used in various fields. Improving the training speed and compactness of RBF networks are critical for promoting their applications. In the present study, we propose a simple, fast, and effective RBF networks training method, which is based on the residual extreme points and their neighborhoods (thus called the REN method for short in this paper). The REN method calculates RBF centers and widths through a two-level iterative process, and realizes two main functionalities, namely 1) adding multiple centers within one pass through the whole data set, and 2) calculating RBF widths specifically for each center. The use of this algorithm does not need any parameter adjustments, and the models for approximation or classification can be obtained by only one run. The performance of the proposed REN algorithm is compared with the classic and powerful orthogonal least squares (OLS) algorithm. By reaching the same accuracies, the REN algorithm trains RBF networks 50 and 320 times faster, in the chirp (0 50 Hz, 2 s, 1 kHz, 2001 samples) and two-dimensional peaks (2401 samples) signal approximation tasks respectively, than the OLS algorithm does, and the number of centers obtained by the REN algorithm is reduced by half. When incorporating the same number of centers, the REN algorithm achieves accuracies up to 3 orders of magnitude higher than the best results obtained by the OLS algorithm. In the classification task of a real discrete breast cancer data, both methods result in accuracies comparable to many existent methods, but the REN algorithm has the advantages of fast training speeds and no requirements for parameter adjustments. The REN algorithm proposed in this study may potentially be used for tasks with large scale of data or applications that require high model performances.

Construction of radial basis function neural networks via a minimization of its localized generalization error

Radial Basis Function Network Learning Using Localized Generalization Error Bound

Norm-Based Localized Generalization Error Model And Its Derivation For Radial Basis Function Neural Networks

Localized Generalization Error Model and Its Application to Architecture Selection for Radial Basis Function Neural Network

Localized generalization error and its application to RBFNN training

A Novel Learning Objective Function Using Localized Generalization Error Bound For Rbf Network

Sensitivity Analysis Applied to the Construction of Radial Basis Function Networks

Construction engineering decision support enabled by minimization of localized generalization error of RBFNN

Image Classification with the Use of Radial Basis Function Neural Networks and the Minimization of the Localized Generalization Error.

A Novel Rbf Neural Network With Fast Training And Accurate Generalization

A Novel Radial Basis Function Neural Network For Approximation

Empirical study on the architecture selection of RBFNN using L-GEM for multi-class problems.

Radial Basis Function Network Pruning by Sensitivity Analysis

Efficient Construction of Sparse Radial Basis Function Neural Networks Using L-1-Regularization

A Novel Radial Basis Function Neural Network with High Generalization Performance for Nonlinear Process Modelling

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

Classification and Prediction of Neural Network Based on Generalized Radial Basis Function

An Experimental Study on the Selection of Q-value for the L-GEM

Localized generalization error model for Multilayer Perceptron Neural Networks

A Brand-New Simple, Fast, and Effective Residual-Based Method for Radial Basis Function Neural Networks Training