Abstract:Conventional back-propagation (BP) neural networks have some inherent weaknesses such as slow convergence and local-minima existence. Based on the polynomial interpolation and approximation theory, a special type of feedforward neural-network is constructed in this paper with hidden-layer neurons activated by Bernoulli polynomials. Different from conventional BP and gradient-based training algorithms, a weights-direct-determination (WDD) method is proposed for the Bernoulli neural network (BNN) as well, which determines the neural-network weights directly (just in one general step), without a lengthy iterative BP-training procedure. Moreover, by analyzing the relationship between BNN performance and its different number of hidden-layer neurons, a structure-automatic-determination (SAD) algorithm is further proposed, which could obtain the optimal number of hidden-layer neurons in a constructed Bernoulli neural network in the sense of achieving the highest learning-accuracy for a specific data problem or target function/system. Computer-simulations further substantiate the efficacy of such a Bernoulli neural network and its deterministic algorithms.

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Weights-directly-determined and Structure-adaptively-tuned Neural Network Based on Chebyshev Basis Functions

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

Gegenbauer orthogonal basis neural network and its weights-direct-determination method

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

Feed-Forward Neural Network Activated with Hermite Orthogonal Polynomials and Its Weights-Determination Method

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

Weights Direct Determination of a Spline Neural Network

MISO Multivariate Generalized Polynomials Neural Network and Its Weights-Direct-Determination

Padé Rational Neural Network and Its Weights-Direct-Determination Method

On Weights and Structure Determination of Hermite-interpolation Neural Network

An Algorithm for Designing Chebyshev Neural Network

Growing Algorithm of Laguerre Orthogonal Basis Neural Network with Weights Directly Determined

A Weights-Directly-determined Simple Neural Network for Nonlinear System Identification

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

On Weights-Direct-determination Method of PID Neurons' Network

Weights and Structure Determination of Feed-Forward Two-Input Neural Network Activated by Chebyshev Polynomials of Class 2

Fourier Neural Network Circuit Implementation Based on Direct Weight Determination

Euler Neural Network with Its Weight-Direct-Determination and Structure-Automatic-Determination Algorithms

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network