Abstract:Artificial feedforward neural networks have received researchers’ great interest due to its ability to approximate functions without having a prior knowledge about the true underlying function. The most popular algorithm for training these networks is the backpropagation algorithm that is based on the minimization of the mean square error cost function. However this algorithm is not robust in the presence of outliers that may pollute the training data. In this chapter we present several methods to robustify neural network training algorithms. First, employing a family of robust statistics estimators, commonly known as M-estimators, in the backpropagation algorithm is reviewed and evaluated for the task of function approximation and dynamical model identification. As theseM-estimators sometimes do not have sufficient insensitivity to data outliers, the chapter next resorts to the statistically more robust estimator of the least median of squares, and develops a stochastic algorithm to minimize a related cost function. The reported experimental results have indeed shown the improved robustness of the new algorithm, especially compared to the standard backpropagation algorithm, on datasets with varying degrees of outlying data.

Robustness Analysis of Feedforward Neural Networks Composed of Threshold Neurons

Robust Stochastic Stability of Discrete-Time Markovian Jump Neural Networks with Leakage Delay

Robust stability for delayed neural networks with nonlinear perturbation

Error Feature Analysis of Multilayered Feedforward Neural Networks

Fault-Tolerant Analysis of Feedback Neural Networks with Threshold Neurons.

Robust Dissipativity Analysis of Neural Networks with Time-Varying Delay and Randomly Occurring Uncertainties

A New Robust Training Algorithm for a Class of Single-Hidden Layer Feedforward Neural Networks

Qualitative Analysis for Recurrent Neural Networks with Linear Threshold Transfer Functions

New Approach for Robust Stability Analysis of Delayed Recurrent Neural Networks

Robust Training of Artificial Feedforward Neural Networks

Robust Exponential Stability Analysis of a Larger Class of Discrete-Time Recurrent Neural Networks

Robust Stability and Robust Periodicity of Delayed Recurrent Neural Networks with Noise Disturbance

A Note on the Robust Stability of Neural Networks with Time Delay

New results on robust exponential stability for discrete recurrent neural networks with time-varying delays

Global quantitative robustness of regression feed-forward neural networks

Robust Exponential Stability Analysis for Uncertain Stochastic Neural Networks

Robust H∞ Filtering for Networked Stochastic Systems with Randomly Occurring Sensor Nonlinearities and Packet Dropouts

Improved robust exponential stability criteria for uncertain stochastic neural networks with time-varying delay

Robust Exponential Stability Analysis for Unertain Neural Networks with Time Delay

Optimal Algorithm for a Multilayer Feedforward Net and Its Application