Abstract:Artificial network, with back-propagation (BP) training algorithms, has shown inherent weaknesses in determining weights and optimal network structure. In order to overcome those weaknesses, in this paper, a two-input single-output (TISO) power-activation feed-forward neural network model is investigated and constructed, based on theory of multivariate approximation and power series expansion. Then, the weights-direct-determination (WDD) method for our feed-forward network is studied and proposed. Further, in order to optimize the structure of network, particle swarm optimization (PSO) is applied to search for global optimal solution to the use of neurons in hidden layer. Then, these lead us finally to propose a weights-structure-determination (WSD) methodology by combining WDD and PSO novelly. Finally, computer numerical experiments based on various objective functions substantiate the superiority of our network in terms of approximation and denoising. Further comparison experiments with stochastic gradient-descent (SGD) and previous work substantiate the efficacy of the WSD methodology proposed.

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

Weights and Structure Determination of Feed-Forward Two-Input Neural Network Activated by Chebyshev Polynomials of Class 2

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Weights-directly-determined and Structure-adaptively-tuned Neural Network Based on Chebyshev Basis Functions

Feed-Forward Neural Network Activated with Hermite Orthogonal Polynomials and Its Weights-Determination Method

Weights and Structure Determination of Multiple-Input Feed-Forward Neural Network Activated by Chebyshev Polynomials of Class 2 Via Cross-Validation

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

On Weights and Structure Determination of Hermite-interpolation Neural Network

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

Two-Input Power-Activation Neural Network Weights-Direct-Determination and Structure Optimized by Particle Swarm Optimization

An Algorithm for Designing Chebyshev Neural Network

Growing-type Weights and Structure Determination of 2-Input Legendre Orthogonal Polynomial Neuronet.

Weights and Structure Determination of Multi-input Laguerre-orthogonal-polynomial Feed-forward Neural Network

Padé Rational Neural Network and Its Weights-Direct-Determination Method

Euler Neural Network with Its Weight-Direct-Determination and Structure-Automatic-Determination Algorithms

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

Pruning-included weights and structure determination of 2-input neuronet using Chebyshev polynomials of Class 1

Cross-validation Based Weights and Structure Determination of Chebyshev-polynomial Neural Networks for Pattern Classification

Weights and Structure Determination (WASD) of Multiple-Input Hermit Orthogonal Polynomials Neural Network (MIHOPNN)