Abstract:In the construction process of radial basis function (RBF) networks, two common crucial issues arise: the selection of RBF centers and the effective utilization of the given source without encountering the overfitting problem. Another important issue is the fault tolerant capability. That is, when noise or faults exist in a trained network, it is crucial that the network's performance does not undergo significant deterioration or decrease. However, without employing a fault tolerant procedure, a trained RBF network may exhibit significantly poor performance. Unfortunately, most existing algorithms are unable to simultaneously address all of the aforementioned issues. This paper proposes fault tolerant training algorithms that can simultaneously select RBF nodes and train RBF output weights. Additionally, our algorithms can directly control the number of RBF nodes in an explicit manner, eliminating the need for a time-consuming procedure to tune the regularization parameter and achieve the target RBF network size. Based on simulation results, our algorithms demonstrate improved test set performance when more RBF nodes are used, effectively utilizing the given source without encountering the overfitting problem. This paper first defines a fault tolerant objective function, which includes a term to suppress the effects of weight faults and weight noise. This term also prevents the issue of overfitting, resulting in better test set performance when more RBF nodes are utilized. With the defined objective function, the training process is designed to solve a generalized M-sparse problem by incorporating an ℓ0-norm constraint. The ℓ0-norm constraint allows us to directly and explicitly control the number of RBF nodes. To address the generalized M-sparse problem, we introduce the noise-resistant iterative hard thresholding (NR-IHT) algorithm. The convergence properties of the NR-IHT algorithm are subsequently discussed theoretically. To further enhance performance, we incorporate the momentum concept into the NR-IHT algorithm, referring to the modified version as "NR-IHT-Mom". Simulation results show that both the NR-IHT algorithm and the NR-IHT-Mom algorithm outperform several state-of-the-art comparison algorithms.

Realization of Generalized RBF Network.

Splicing System Based Genetic Algorithms for Developing Rbf Networks Models

Estimation of catalyst activity using improved RBFN

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

DNA-NSGA-Ⅱ Nonlinear Dynamic System Modeling Approach Using RBF Neural Networks

Training Radial Basis Function Classifiers with Gaussian Kernel Clustering and Fuzzy Decision Technique

A New Method for Decision on the Structure of RBF Neural Network

Parameter Optimization of RBF Networks Based on Evolutionary Model

A Genetic Algorithm for Parameter Optimization of RBF Network

A novel hybrid GA/RBFNN technique for protein sequences classification.

Fuzzy RBF Neural Network Based Function Approximation

Debiased Batch Normalization Via Gaussian Process for Generalizable Person Re-identification

A Clustering Method And Its Application To The Modeling Of Rbf Networks

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

GA-Based RBFNN and its application in simultaneous determination of Fe, Mn, Cu and Zn

Generalized M-sparse algorithms for constructing fault tolerant RBF networks

Multi-Kernel Fusion for RBF Neural Networks

Radial basis function neural networks: a topical state-of-the-art survey

A Novel Algorithm for Global Optimization of RBF Neural Networks

Self-tuning and approximation via RBF neural networks