Abstract:In the construction process of radial basis function (RBF) networks, two common crucial issues arise: the selection of RBF centers and the effective utilization of the given source without encountering the overfitting problem. Another important issue is the fault tolerant capability. That is, when noise or faults exist in a trained network, it is crucial that the network's performance does not undergo significant deterioration or decrease. However, without employing a fault tolerant procedure, a trained RBF network may exhibit significantly poor performance. Unfortunately, most existing algorithms are unable to simultaneously address all of the aforementioned issues. This paper proposes fault tolerant training algorithms that can simultaneously select RBF nodes and train RBF output weights. Additionally, our algorithms can directly control the number of RBF nodes in an explicit manner, eliminating the need for a time-consuming procedure to tune the regularization parameter and achieve the target RBF network size. Based on simulation results, our algorithms demonstrate improved test set performance when more RBF nodes are used, effectively utilizing the given source without encountering the overfitting problem. This paper first defines a fault tolerant objective function, which includes a term to suppress the effects of weight faults and weight noise. This term also prevents the issue of overfitting, resulting in better test set performance when more RBF nodes are utilized. With the defined objective function, the training process is designed to solve a generalized M-sparse problem by incorporating an ℓ0-norm constraint. The ℓ0-norm constraint allows us to directly and explicitly control the number of RBF nodes. To address the generalized M-sparse problem, we introduce the noise-resistant iterative hard thresholding (NR-IHT) algorithm. The convergence properties of the NR-IHT algorithm are subsequently discussed theoretically. To further enhance performance, we incorporate the momentum concept into the NR-IHT algorithm, referring to the modified version as "NR-IHT-Mom". Simulation results show that both the NR-IHT algorithm and the NR-IHT-Mom algorithm outperform several state-of-the-art comparison algorithms.

Real-time performance evaluation of the minimal radial basis function network for identification of time varying nonlinear systems

Recurrent context layered radial basis function neural network for the identification of nonlinear dynamical systems

Study on RAN Network and it's Application

Efficient Identification Of Rbf Neural-Net Models For Nonlinear Discrete-Time Multivariable Dynamical-Systems

Selective Recursive Kernel Learning for Online Identification of Nonlinear Systems with NARX Form

Direction of Arrival (DoA) Estimation Under Array Sensor Failures Using a Minimal Resource Allocation Neural Network

Online identification using radial basis function neural network coupled with KPCA

Improving time–frequency resolution in non-stationary signal analysis using a convolutional recurrent neural network

Identification of Nonlinear Discrete-Time Multivariable Dynamical Systems by RBF Neural Networks

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

Evaluation for Sortie Generation Capacity of the Carrier Aircraft Based on the Variable Structure RBF Neural Network with the Fast Learning Rate

A Fuzzy Radial Basis Adaptive Inference Network and Its Application to Time-Varying Signal Classification

Real-Time Haptic Characterisation of Hunt-Crossley Model Based on Radial Basis Function Neural Network for Contact Environment

An RBF-LVQPNN model and its application to time-varying signal classification

Orthogonal least squares learning algorithm for radial basis function networks

Generalized M-sparse algorithms for constructing fault tolerant RBF networks

Cognitive spectrum sensing algorithm based on an RBF neural network and machine learning

Machine Learning Techniques to Evaluate the Approximation of Utilization Power in Circuits

Radial Basis Operator Networks

Efficient Training of RBF Networks Via the BYY Automated Model Selection Learning Algorithms

Comparative study of neural networks for dynamic nonlinear systems identification