Abstract:In the construction process of radial basis function (RBF) networks, two common crucial issues arise: the selection of RBF centers and the effective utilization of the given source without encountering the overfitting problem. Another important issue is the fault tolerant capability. That is, when noise or faults exist in a trained network, it is crucial that the network's performance does not undergo significant deterioration or decrease. However, without employing a fault tolerant procedure, a trained RBF network may exhibit significantly poor performance. Unfortunately, most existing algorithms are unable to simultaneously address all of the aforementioned issues. This paper proposes fault tolerant training algorithms that can simultaneously select RBF nodes and train RBF output weights. Additionally, our algorithms can directly control the number of RBF nodes in an explicit manner, eliminating the need for a time-consuming procedure to tune the regularization parameter and achieve the target RBF network size. Based on simulation results, our algorithms demonstrate improved test set performance when more RBF nodes are used, effectively utilizing the given source without encountering the overfitting problem. This paper first defines a fault tolerant objective function, which includes a term to suppress the effects of weight faults and weight noise. This term also prevents the issue of overfitting, resulting in better test set performance when more RBF nodes are utilized. With the defined objective function, the training process is designed to solve a generalized M-sparse problem by incorporating an ℓ0-norm constraint. The ℓ0-norm constraint allows us to directly and explicitly control the number of RBF nodes. To address the generalized M-sparse problem, we introduce the noise-resistant iterative hard thresholding (NR-IHT) algorithm. The convergence properties of the NR-IHT algorithm are subsequently discussed theoretically. To further enhance performance, we incorporate the momentum concept into the NR-IHT algorithm, referring to the modified version as "NR-IHT-Mom". Simulation results show that both the NR-IHT algorithm and the NR-IHT-Mom algorithm outperform several state-of-the-art comparison algorithms.

Objective Function and Learning Algorithm for the General Node Fault Situation

A fault-tolerant regularizer for RBF networks

Generalized M-sparse algorithms for constructing fault tolerant RBF networks

Improving Fault Tolerance for Reliable DNN Using Boundary-Aware Activation

A Neural Network Model For General Minimax Problem

Orthogonal Least Squares Based Center Selection for Fault-Tolerant RBF Networks.

l0-norm Based Centers Selection for Training Fault Tolerant RBF Networks and Selecting Centers

Fault models for artificial neural networks

A Modified Learning Algorithm for Improving the Fault Tolerance of BP Networks

Towards Enhancing Fault Tolerance in Neural Networks

Fault Variables Recognition Using Improved K-Nearest Neighbor Reconstruction

A Neural Network Approach to Fault Diagnosis in Analog Circuits.

Improving Tolerance of Neural Networks Against Multi-Node Open Fault

Fault Diagnosis Based On Radial Basis Function Neural Network In Particleboard Glue Mixing & Dosing System

The superior fault tolerance of artificial neural network training with a fault/noise injection-based genetic algorithm

Adaptive fault-tolerant consensus for a class of leader-following systems using neural network learning strategy

Distributed Fault Section Estimation System Using Radial Basis Function Neural Network and Its Companion Fuzzy System

Fault Prediction for State-Dependent Fault Based on Online Learning Neural Network

Using neural networks for fault diagnosis

LSTM-Based Node-Gated Graph Neural Network for Cross-Condition Few-Shot Bearing Fault Diagnosis

Adaptive Neural Fault-Tolerant Control for Nonlinear System With Multiple Faults and Dead Zone