Abstract:In the construction process of radial basis function (RBF) networks, two common crucial issues arise: the selection of RBF centers and the effective utilization of the given source without encountering the overfitting problem. Another important issue is the fault tolerant capability. That is, when noise or faults exist in a trained network, it is crucial that the network's performance does not undergo significant deterioration or decrease. However, without employing a fault tolerant procedure, a trained RBF network may exhibit significantly poor performance. Unfortunately, most existing algorithms are unable to simultaneously address all of the aforementioned issues. This paper proposes fault tolerant training algorithms that can simultaneously select RBF nodes and train RBF output weights. Additionally, our algorithms can directly control the number of RBF nodes in an explicit manner, eliminating the need for a time-consuming procedure to tune the regularization parameter and achieve the target RBF network size. Based on simulation results, our algorithms demonstrate improved test set performance when more RBF nodes are used, effectively utilizing the given source without encountering the overfitting problem. This paper first defines a fault tolerant objective function, which includes a term to suppress the effects of weight faults and weight noise. This term also prevents the issue of overfitting, resulting in better test set performance when more RBF nodes are utilized. With the defined objective function, the training process is designed to solve a generalized M-sparse problem by incorporating an ℓ0-norm constraint. The ℓ0-norm constraint allows us to directly and explicitly control the number of RBF nodes. To address the generalized M-sparse problem, we introduce the noise-resistant iterative hard thresholding (NR-IHT) algorithm. The convergence properties of the NR-IHT algorithm are subsequently discussed theoretically. To further enhance performance, we incorporate the momentum concept into the NR-IHT algorithm, referring to the modified version as "NR-IHT-Mom". Simulation results show that both the NR-IHT algorithm and the NR-IHT-Mom algorithm outperform several state-of-the-art comparison algorithms.

Orthogonal Least Squares Based Center Selection for Fault-Tolerant RBF Networks.

l0-norm Based Centers Selection for Training Fault Tolerant RBF Networks and Selecting Centers

Generalized M-sparse algorithms for constructing fault tolerant RBF networks

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

A fault-tolerant regularizer for RBF networks

Orthogonal least squares learning algorithm for radial basis function networks

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Objective Function and Learning Algorithm for the General Node Fault Situation

A Nonlinear Adaptive Controller Based on RBF Networks

Distance Weighted K-Means Algorithm for Center Selection in Training Radial Basis Function Networks

Least-Unavailability Path Selecting Algorithm Based on RBF for Disaster-Survivable Software-Defined Optical Networks.

Output based fault tolerant control of nonlinear systems using RBF neural networks

Hybrid Learning Algorithm of Radial Basis Function Networks for Reliability Analysis

Fault Diagnosis Based On Radial Basis Function Neural Network In Particleboard Glue Mixing & Dosing System

Fault Variables Recognition Using Improved K-Nearest Neighbor Reconstruction

Adaptive Neural Fault-Tolerant Control for Nonlinear System With Multiple Faults and Dead Zone

RBF design method based on center clustering and PSO

Training Radial Basis Function Classifiers with Gaussian Kernel Clustering and Fuzzy Decision Technique

Distributed Fault Section Estimation System Using Radial Basis Function Neural Network and Its Companion Fuzzy System

A Neural Network Adaptive Fault-Tolerant Control Method for Launch Vehicles with the Limited Faults

Pls Algorithm For Radial Basis Function Networks