Abstract:1 Introduction Typically, models of neural networks are divided into two categories in terms of signal transmission manner: feed-forward neural networks and recurrent neural networks. They are built up using different frameworks, which give rise to different fields of applications. Feed-forward neural network (FNN), also referred to as multilayer percep-trons (MLPs), has drawn great interests over the last two decades for its distinction as a universal function approximator As an important intelligent computation method, FNN has been applied to a wide range of applications, including curve fitting, pattern classification and nonlinear system identification and so on (Vemuri, 1995). FNN features a supervised training with a highly popular algorithm known as the error back-propagation algorithm. In the standard back-propagation (SBP) algorithm, the learning of a FNN is composed of two passes: in the forward pass, the input signal propagates through the network in a forward direction, on a layer-by-layer basis with the weights fixed; in the backward pass, the error signal is propagated in a backward manner. The weights are adjusted based on an error-correction rule. Although it has been successfully used in many real world applications, SBP suffers from two infamous shortcomings, i.e., slow learning speed and sensitivity to parameters. Many iterations are required to train small networks, even for a simple problem. The sensitivity to learning parameters, initial states and perturbations was analyzed in (Yeung and Sun, 2002). Behind such drawbacks the learning rate plays a key role in affecting the learning performance and it has to be chosen carefully. If the learning rate is large, the network may exhibit chaotic

B-Spline Recurrent Neurall Network and Its Application to Modelling

Splicing System Based Genetic Algorithms for Developing Rbf Networks Models

A neurofuzzy network structure for nonlinear system modeling

An Adaptive Learning Rate for the Training of B-Spline Networks

A New Neural Network Model And Its Application

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Nonlinear Adaptive Observer Design Based on B-spline Neural Network

Neural Networks: Computational Models and Applications - ReadingSample

A robust learning algorithm for feedforward neural networks with adaptive spline activation function

A discrete-time neural network for optimization problems with hybrid constraints.

Standard neural network model and its application

Learning and approximation capabilities of adaptive spline activation function neural networks

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Bifurcation Spiking Neural Network

Multilayer feedforward networks with adaptive spline activation function

Online Modeling for Switched Reluctance Motors Using B-Spline Neural Networks

Best free knot linear spline approximation and its application to neural networks

A Rapid Two-Step Learning Algorithm for Spline Activation Function Neural Networks with the Application on Biped Gait Recognition

BP-SRM: A directly training algorithm for spiking neural network constructed by spike response model

Modeling Nonlinear Dynamic Chemical Process Base on Artificial Neural Networks

Cross Spline Net and a Unified World