Abstract:Conventional back-propagation (BP) neural networks have some inherent weaknesses such as slow convergence and local-minima existence. Based on the polynomial interpolation and approximation theory, a special type of feedforward neural-network is constructed in this paper with hidden-layer neurons activated by Bernoulli polynomials. Different from conventional BP and gradient-based training algorithms, a weights-direct-determination (WDD) method is proposed for the Bernoulli neural network (BNN) as well, which determines the neural-network weights directly (just in one general step), without a lengthy iterative BP-training procedure. Moreover, by analyzing the relationship between BNN performance and its different number of hidden-layer neurons, a structure-automatic-determination (SAD) algorithm is further proposed, which could obtain the optimal number of hidden-layer neurons in a constructed Bernoulli neural network in the sense of achieving the highest learning-accuracy for a specific data problem or target function/system. Computer-simulations further substantiate the efficacy of such a Bernoulli neural network and its deterministic algorithms.

MISO Multivariate Generalized Polynomials Neural Network and Its Weights-Direct-Determination

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Weights and Structure Determination (WASD) of Multiple-Input Hermit Orthogonal Polynomials Neural Network (MIHOPNN)

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

Weights Direct Determination of a Spline Neural Network

General Polynomial Neural Network and Its Structure Adaptive Determination

A Neural Network Model for General Minimax Problem

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

On Weights and Structure Determination of Hermite-interpolation Neural Network

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

Weights and Structure Determination of Multi-input Laguerre-orthogonal-polynomial Feed-forward Neural Network

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

Feed-Forward Neural Network Activated with Hermite Orthogonal Polynomials and Its Weights-Determination Method

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

Growing-type Weights and Structure Determination of 2-Input Legendre Orthogonal Polynomial Neuronet.

Two-Input Power-Activation Neural Network Weights-Direct-Determination and Structure Optimized by Particle Swarm Optimization

On Weights-Direct-determination Method of PID Neurons' Network

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

Weights and Structure Determination of 3-Input Bernoulli Polynomial Neural Net

A Weights-Directly-determined Simple Neural Network for Nonlinear System Identification