Abstract:Single-hidden layer feed forward neural networks (SLFNs) are widely used in pattern classification problems, but a huge bottleneck encountered is the slow speed and poor performance of the traditional iterative gradient-based learning algorithms. Although the famous extreme learning machine (ELM) has successfully addressed the problems of slow convergence, it still has computational robustness problems brought by input weights and biases randomly assigned. Thus, in order to overcome the aforementioned problems, in this paper, a novel type neural network based on Gegenbauer orthogonal polynomials, termed as GNN, is constructed and investigated. This model could overcome the computational robustness problems of ELM, while still has comparable structural simplicity and approximation capability. Based on this, we propose a regularized weights direct determination (R-WDD) based on equality-constrained optimization to determine the optimal output weights. The R-WDD tends to minimize the empirical risks and structural risks of the network, thus to lower the risk of over fitting and improve the generalization ability. This leads us to a the final GNN with R-WDD, which is a unified learning mechanism for binary and multi-class classification problems. Finally, as is verified in the various comparison experiments, GNN with R-WDD tends to have comparable (or even better) generalization performances, computational scalability and efficiency, and classification robustness, compared to least square support vector machine (LS-SVM), ELM with Gaussian kernel.

A Modified ELM Algorithm for Single-Hidden Layer Feedforward Neural Networks with Linear Nodes

A New Robust Training Algorithm for a Class of Single-Hidden Layer Feedforward Neural Networks

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

A Novel Learning Algorithm of Single-Hidden-layer Feedforward Neural Networks

ELM Feature Mappings Learning: Single-Hidden-Layer Feedforward Network without Output Weight

A Modified Fast Recursive Hidden Nodes Selection Algorithm For Elm

Generalized Single-Hidden Layer Feedforward Networks

A Novel Reformulated Radial Basis Function Neural Network

Pulling back error to the hidden-node parameter technology: Single-hidden-layer feedforward network without output weight

Self-adaptive Extreme Learning Machine Optimized by Rough Set Theory and Affinity Propagation Clustering

Distributed Extreme Learning Machine for Nonlinear Learning over Network

Reduced extreme learning machine employing SVM technique

A Gegenbauer Neural Network with Regularized Weights Direct Determination for Classification

An Enhanced Online Sequential Extreme Learning Machine algorithm

A Novel Biologically Inspired ELM-based Network for Image Recognition

A Novel Extreme Learning Machine Based on Hybrid Kernel Function.

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Research on Extreme Learning of Neural Networks

A study on effectiveness of extreme learning machine

A Fast Constructive Learning Algorithm For Single-Hidden-Layer Neural Networks