Abstract:Single-hidden layer feed forward neural networks (SLFNs) are widely used in pattern classification problems, but a huge bottleneck encountered is the slow speed and poor performance of the traditional iterative gradient-based learning algorithms. Although the famous extreme learning machine (ELM) has successfully addressed the problems of slow convergence, it still has computational robustness problems brought by input weights and biases randomly assigned. Thus, in order to overcome the aforementioned problems, in this paper, a novel type neural network based on Gegenbauer orthogonal polynomials, termed as GNN, is constructed and investigated. This model could overcome the computational robustness problems of ELM, while still has comparable structural simplicity and approximation capability. Based on this, we propose a regularized weights direct determination (R-WDD) based on equality-constrained optimization to determine the optimal output weights. The R-WDD tends to minimize the empirical risks and structural risks of the network, thus to lower the risk of over fitting and improve the generalization ability. This leads us to a the final GNN with R-WDD, which is a unified learning mechanism for binary and multi-class classification problems. Finally, as is verified in the various comparison experiments, GNN with R-WDD tends to have comparable (or even better) generalization performances, computational scalability and efficiency, and classification robustness, compared to least square support vector machine (LS-SVM), ELM with Gaussian kernel.

Gegenbauer orthogonal basis neural network and its weights-direct-determination method

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Growing Algorithm of Laguerre Orthogonal Basis Neural Network with Weights Directly Determined

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

Feed-Forward Neural Network Activated with Hermite Orthogonal Polynomials and Its Weights-Determination Method

Approach for training of Gaussian basis function classifier

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

Padé Rational Neural Network and Its Weights-Direct-Determination Method

A Novel Method to Compute the Weights of Neural Networks

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

Two-Input Gegenbauer Orthogonal Neural Network with Growing-and-Pruning Weights and Structure Determination.

A Gegenbauer Neural Network with Regularized Weights Direct Determination for Classification

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

On Weights and Structure Determination of Hermite-interpolation Neural Network

On Weights-Direct-determination Method of PID Neurons' Network

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

Euler Neural Network with Its Weight-Direct-Determination and Structure-Automatic-Determination Algorithms

Two-Times Training Algorithm of Neural Network Based on GA

Basis Function Neural Network and Its Fast Optimal-structure Determination

WEIGHTS OPTIMIZATION OF NEURAL NETWORK VIA IMPROVED BCO APPROACH