Abstract:The connections of the alternative model for mixture of experts (ME) to the normalized radial basis function (NRBF) nets and extended normalized RBF (ENRBF) nets are established, and the well-known expectation-maximization (EM) algorithm for maximum likelihood learning is suggested to the two types of RBF nets. This new learning technique determines the parameters of the input layer (including the covariance matrices or so-called receptive fields) and the parameters of the output layer in the RBF nets globally, instead of separately training the input layer by the K-means algorithm and the output layer by the least-squares learning as done in most of the existing RBF learning methods. In addition, coordinated competitive learning (CCL) and adaptive algorithms are proposed to approximate the EM algorithm for considerably speeding up the learning of the original and alternative ME models as well as the NRBF and ENRBF nets. Furthermore, the two ME models are linked to the recent proposed Bayesian Ying–Yang (BYY) learning system and theory such that not only the architecture of ME and RBF nets is shown to be more preferred than multilayer architecture, but also a new model selection criterion has been obtained to determine the number of experts and basis functions. A number of experiments are made on the prediction of foreign exchange rate and trading investment as well as piecewise nonlinear regression and piecewise line fitting. As shown in these experiments, the EM algorithm for NRBF nets and ENRBF nets obviously outperforms the conventional RBF learning technique, CCL speeds up the learning considerably with only a slight sacrifice on performance accuracy, the adaptive algorithm gives significant improvements on financial predication and trading investment, as well as that the proposed criterion can select the number of basis functions successfully. In addition, the ENRBF net and the alternative ME model are also shown to be able to implement curve fitting and detection.

Learning Algorithms for RBF Functions and Subspace Based Functions

A Nonlinear Adaptive Controller Based on RBF Networks

Pls Algorithm For Radial Basis Function Networks

Adaptive RBF Net Algorithms for Nonlinear Signal Learning with Applications to Financial Prediction and Investment.

A Single-Layer Radial Basis Function Network Classifier and Its Applications

Radial basis function neural networks: a topical state-of-the-art survey

On Radial Basis Function Net and Kernel Regression: Approximation Ability, Convergence Rate and Receptive Field Size

Training Radial Basis Function Classifiers with Gaussian Kernel Clustering and Fuzzy Decision Technique

Orthogonal least squares learning algorithm for radial basis function networks

Kernel Regression and Radial Basis Function Net: Some Theoretical Studies

Learning in Deep Radial Basis Function Networks

Efficient Training of RBF Networks Via the BYY Automated Model Selection Learning Algorithms

Radial Basis Function Networks for Convolutional Neural Networks to Learn Similarity Distance Metric and Improve Interpretability

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

A survey of the initialization of centers and widths in radial basis function network for classification.

Functional Modelling of Large Scattered Data Sets Using Neural Networks

A Novel Radial Basis Function Neural Network For Approximation

Rbf Nets, Mixture Experts, and Bayesian Ying-Yang Learning

An efficient multilayer RBF neural network and its application to regression problems

A two-level learning hierarchy for the radial basis function networks

Adaptive RBF Neural Networks for Pattern Classifications