Abstract:Conventional back-propagation (BP) neural networks have some inherent weaknesses such as slow convergence and local-minima existence. Based on the polynomial interpolation and approximation theory, a special type of feedforward neural-network is constructed in this paper with hidden-layer neurons activated by Bernoulli polynomials. Different from conventional BP and gradient-based training algorithms, a weights-direct-determination (WDD) method is proposed for the Bernoulli neural network (BNN) as well, which determines the neural-network weights directly (just in one general step), without a lengthy iterative BP-training procedure. Moreover, by analyzing the relationship between BNN performance and its different number of hidden-layer neurons, a structure-automatic-determination (SAD) algorithm is further proposed, which could obtain the optimal number of hidden-layer neurons in a constructed Bernoulli neural network in the sense of achieving the highest learning-accuracy for a specific data problem or target function/system. Computer-simulations further substantiate the efficacy of such a Bernoulli neural network and its deterministic algorithms.

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

Feed-Forward Neural Network Activated with Hermite Orthogonal Polynomials and Its Weights-Determination Method

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Growing Algorithm of Laguerre Orthogonal Basis Neural Network with Weights Directly Determined

Gegenbauer orthogonal basis neural network and its weights-direct-determination method

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

Padé Rational Neural Network and Its Weights-Direct-Determination Method

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

On Weights and Structure Determination of Hermite-interpolation Neural Network

A Weights-Directly-determined Simple Neural Network for Nonlinear System Identification

Growing-type Weights and Structure Determination of 2-Input Legendre Orthogonal Polynomial Neuronet.

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

Weights Direct Determination of a Spline Neural Network

Weights and Structure Determination of Multi-input Laguerre-orthogonal-polynomial Feed-forward Neural Network

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

Weights and Structure Determination of 3-Input Bernoulli Polynomial Neural Net

Fourier Neural Network Circuit Implementation Based on Direct Weight Determination

Weights-directly-determined and Structure-adaptively-tuned Neural Network Based on Chebyshev Basis Functions

MISO Multivariate Generalized Polynomials Neural Network and Its Weights-Direct-Determination

Weights and Structure Determination (WASD) of Multiple-Input Hermit Orthogonal Polynomials Neural Network (MIHOPNN)