Abstract:This paperproposes arecursively adapted radial basis function networkandprovides additional insights into several well-known techniques suchasradial basis function networks, resource allocating networks andstochastic gradient descent inreproducing kernel Hilbert spaces. Throughthis perspective, resource allocating networks areinvestigated ina moreprincipled way so thatissues ofconvergence and generalization canbemathematically analyzed intheleast meansquare framework. I.INTRODUCTION RESOURCE allocating networks (RAN)areanintuitive, veryappealing ideaintroduced byPlatt (1)butits convergence andgeneralization havenotbeenfully addressed mathematically. Recently, Kivinen, SmolaandWilliamson (2)introduced anonline kernel learning method(OKL)whichcanbe simply viewedasa stochastic gradient descent method applied ontheregularized costfunction ofaradial basis function network (RBFN). Interestingly, OKL bears much resemblance withRAN intermsoflearning strategy and network architecture. However, there isonefundamental difference. OKL employs aforgetting factor initstraining, whichisthelegacy oftheregularization termintheRBFN costfunction, toimpose stability inlearning andthus ensure generalization. Further statistical analysis concludes that this forgetting factor appears essential forits well-posedness (3). Therefore, this reasoning raises thequestion ifRAN iswell- posed. Generalization hasbeensubstantially studied inthe framework ofregularization theories (4), (5). Regularization asaremedy forill-posedness became widely knowndueto theworkofTikhonov (6). Insolving RBFN like problems, theTikhonov regularization isessentially a trade-off between fitting training dataandreducing solution norms. Consequently itreduces thesensitivity ofthesolution to small changes inthetraining dataandimposes stability on theill-posed problem. Ourworkimproves onrelated research inseveral ways: 1.We propose arecursively adapted RBFNandprovide the convergence conditions.

Radial Basis Function Networks Based on Adaptive Projective Learning Algorithm and Its Applications

A Nonlinear Adaptive Controller Based on RBF Networks

Pls Algorithm For Radial Basis Function Networks

Study and implement of radial basis function neural network

Orthogonal least squares learning algorithm for radial basis function networks

Constructing radial basis function networks based on partial least squares modeling method

RADIAL BASIS FUNCTION NETWORKS BASED ON WAVELET FRAMES

Radial basis perceptron network and its applications for pattern recognition

Adaptive equalizer based on complex radial basis functions networks

Adaptive radial basis function networks with kernel shape parameters

An Art-Like Algorithm for Constructing Rbf Neural Networks

A Novel Radial Basis Function Neural Network For Approximation

Recursively AdaptedRadial Basis Function Networks Andits Relationship Toresource Allocating Networks Andonline Kernel Learning

A Novel Radial Basis Function Network On Ant Colony Clustering

Radial Basis Function Neural Network Algorithm and Its Application

A two-level learning hierarchy for the radial basis function networks

Two-stage Partial Least Squares Regression for Constructing Radial Basis Function Networks

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

Approximation of Function by Adaptively Growing Radial Basis Function Neural Networks.

A sequential learning algorithm based on adaptive particle filtering for RBF networks

Experience-Consistent Modeling For Radial Basis Function Neural Networks