Abstract:Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we study the approximation of functionals on reproducing kernel Hilbert spaces (RKHS's) using neural networks. We establish the universality of the approximation of functionals on the RKHS's. Specifically, we derive explicit error bounds for those induced by inverse multiquadric, Gaussian, and Sobolev kernels. Moreover, we apply our findings to functional regression, proving that neural networks can accurately approximate the regression maps in generalized functional linear models. Existing works on functional learning require integration-type basis function expansions with a set of pre-specified basis functions. By leveraging the interpolating orthogonal projections in RKHS's, our proposed network is much simpler in that we use point evaluations to replace basis function expansions.

Approximation Capability to Functions of Several Variables, Nonlinear Functionals and Operators by Radial Basis Function Neural Networks

L P Approximation Capability of RBF Neural Networks

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Denseness Of Radial-Basis Functions In L(2)(R(N)) And Its Applications In Neural Networks

Fuzzy RBF Neural Network Based Function Approximation

A Nonlinear Adaptive Controller Based on RBF Networks

Function Approximation by Neural Networks

Universal Approximation Using Radial-Basis-Function Networks

A MATLAB-Based Study on the Realization and Approximation Performance of RBF Neural Networks

Approximation of RKHS Functionals by Neural Networks

Simulation Study of Function Approximation Performance Based on Gaussian-RBF Neural Networks

Frequency Domain Analysis Based Rbf Networks And Their Applications To Function Approximations

Investigation of Neural Networks for Function Approximation

A Novel Radial Basis Function Neural Network For Approximation

Universal Approximation to Nonlinear Operators by Neural Networks with Arbitrary Activation Functions and Its Application to Dynamical Systems

On Radial Basis Function Net and Kernel Regression: Approximation Ability, Convergence Rate and Receptive Field Size

Approximation of Function by Adaptively Growing Radial Basis Function Neural Networks.

Pls Algorithm For Radial Basis Function Networks

Approximations of Continuous Functionals by Neural Networks with Application to Dynamic Systems

On the universal approximation property of radial basis function neural networks

Almost optimal estimates for approximation and learning by radial basis function networks