Abstract:Conventional back-propagation (BP) neural networks have some inherent weaknesses such as slow convergence and local-minima existence. Based on the polynomial interpolation and approximation theory, a special type of feedforward neural-network is constructed in this paper with hidden-layer neurons activated by Bernoulli polynomials. Different from conventional BP and gradient-based training algorithms, a weights-direct-determination (WDD) method is proposed for the Bernoulli neural network (BNN) as well, which determines the neural-network weights directly (just in one general step), without a lengthy iterative BP-training procedure. Moreover, by analyzing the relationship between BNN performance and its different number of hidden-layer neurons, a structure-automatic-determination (SAD) algorithm is further proposed, which could obtain the optimal number of hidden-layer neurons in a constructed Bernoulli neural network in the sense of achieving the highest learning-accuracy for a specific data problem or target function/system. Computer-simulations further substantiate the efficacy of such a Bernoulli neural network and its deterministic algorithms.

On Weights and Structure Determination of Hermite-interpolation Neural Network

Feed-Forward Neural Network Activated with Hermite Orthogonal Polynomials and Its Weights-Determination Method

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

Padé Rational Neural Network and Its Weights-Direct-Determination Method

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Weights Direct Determination of a Spline Neural Network

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

A Weights-Directly-determined Simple Neural Network for Nonlinear System Identification

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

Weights and Structure Determination of 3-Input Bernoulli Polynomial Neural Net

Weights and Structure Determination of Feed-Forward Two-Input Neural Network Activated by Chebyshev Polynomials of Class 2

Study on Application of Neural Network BP Algorithm in DEM Interpolation

Euler Neural Network with Its Weight-Direct-Determination and Structure-Automatic-Determination Algorithms

On Weights-Direct-determination Method of PID Neurons' Network

Weights and Structure Determination (WASD) of Multiple-Input Hermit Orthogonal Polynomials Neural Network (MIHOPNN)

A Weights-Direct-Determination Method and Structure-Automatic-Determination Algorithm for SIMO Trigonometrically-Activated Fourier Neural Networks

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

MISO Multivariate Generalized Polynomials Neural Network and Its Weights-Direct-Determination