Abstract:This paperproposes arecursively adapted radial basis function networkandprovides additional insights into several well-known techniques suchasradial basis function networks, resource allocating networks andstochastic gradient descent inreproducing kernel Hilbert spaces. Throughthis perspective, resource allocating networks areinvestigated ina moreprincipled way so thatissues ofconvergence and generalization canbemathematically analyzed intheleast meansquare framework. I.INTRODUCTION RESOURCE allocating networks (RAN)areanintuitive, veryappealing ideaintroduced byPlatt (1)butits convergence andgeneralization havenotbeenfully addressed mathematically. Recently, Kivinen, SmolaandWilliamson (2)introduced anonline kernel learning method(OKL)whichcanbe simply viewedasa stochastic gradient descent method applied ontheregularized costfunction ofaradial basis function network (RBFN). Interestingly, OKL bears much resemblance withRAN intermsoflearning strategy and network architecture. However, there isonefundamental difference. OKL employs aforgetting factor initstraining, whichisthelegacy oftheregularization termintheRBFN costfunction, toimpose stability inlearning andthus ensure generalization. Further statistical analysis concludes that this forgetting factor appears essential forits well-posedness (3). Therefore, this reasoning raises thequestion ifRAN iswell- posed. Generalization hasbeensubstantially studied inthe framework ofregularization theories (4), (5). Regularization asaremedy forill-posedness became widely knowndueto theworkofTikhonov (6). Insolving RBFN like problems, theTikhonov regularization isessentially a trade-off between fitting training dataandreducing solution norms. Consequently itreduces thesensitivity ofthesolution to small changes inthetraining dataandimposes stability on theill-posed problem. Ourworkimproves onrelated research inseveral ways: 1.We propose arecursively adapted RBFNandprovide the convergence conditions.

Recursively AdaptedRadial Basis Function Networks Andits Relationship Toresource Allocating Networks Andonline Kernel Learning

Study on RAN Network and it's Application

On Radial Basis Function Net and Kernel Regression: Approximation Ability, Convergence Rate and Receptive Field Size

A Novel Rbf Neural Network With Fast Training And Accurate Generalization

Radial Basis Function Networks Based on Adaptive Projective Learning Algorithm and Its Applications

Adaptive radial basis function networks with kernel shape parameters

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

Kernel Regression and Radial Basis Function Net: Some Theoretical Studies

Radial Basis Function Networks with Adjustable Kernel Shape Parameters

On L/sub 2/ Convergence Rates of Radial Basis Function Networks and Kernel Regression Estimators

An improved conjugate gradient algorithm for radial basis function (RBF) networks modelling

Kernelized LARS–LASSO for Constructing Radial Basis Function Neural Networks

Training algorithm of RBFNN similar with RAN

A Dual Structural Radial Basis Function Network For Recursive Function Estimation

An Adaptive Learning Algorithm Aimed at Improving RBF Network Generalization Ability

Optimizing Radial Basis Function Neural Network Based on Rough Sets and Affinity Propagation Clustering Algorithm

A new sequential learning algorithm for RBF neural networks

A two-level learning hierarchy for the radial basis function networks

A Novel Two Stage Algorithm for Construction of RBF Neural Models Based on A-optimality Criterion

A Brand-New Simple, Fast, and Effective Residual-Based Method for Radial Basis Function Neural Networks Training

A Modified RBF Neural Network in Pattern Recognition