Abstract:Conventional kernel adaptive filtering (KAF) uses a prescribed, positive definite, nonlinear function to define the Reproducing Kernel Hilbert Space (RKHS), where the optimal solution for mean square error estimation is approximated using search techniques. Instead, this paper proposes to embed the full statistics of the input data in the kernel definition, obtaining the first analytical solution for nonlinear regression and nonlinear adaptive filtering applications. We call this solution the Functional Wiener Filter (FWF). Conceptually, the methodology is an extension of Parzen's work on the autocorrelation RKHS to nonlinear functional spaces. We provide an extended functional Wiener equation, and present a solution to this equation in an explicit, finite dimensional, data-dependent RKHS. We further explain the necessary requirements to compute the analytical solution in RKHS, which is beyond traditional methodologies based on the kernel trick. The FWF analytic solution to the nonlinear minimum mean square error problem has better accuracy than other kernel-based algorithms in synthetic, stationary data. In real world time series, it has comparable accuracy to KAF but displays constant complexity with respect to number of training samples. For evaluation, it is as computationally efficient as the Wiener solution (with a larger number of dimensions than the linear case). We also show how the difference equation learned by the FWF from data can be extracted leading to system identification applications, which extend the possible applications of the FWF beyond optimal nonlinear filtering.

A Novel Kernel Functions Algorithm for Solving Impulsive Boundary Value Problems.

Boundary Knot Method for Some Inverse Problems Associated with the Helmholtz Equation

A Sixth Order Kernel Functions Approach for Nonlinear Fourth Order Boundary Value Problems

Convergence Order of the Reproducing Kernel Method for Solving Boundary Value Problems

A reproducing kernel based collocation method for arbitrary m-order BVPs

New RBF collocation methods and kernel RBF with applications

Reproducing Kernel-Based Piecewise Methods for Efficiently Solving Oscillatory Systems of Second-Order Initial Value Problems

Collocation methods based on barycentric rational interpolation for Volterra integro‐differential equations with weakly singular kernels

Application of the Reproducing Kernel Method for Solving Linear Volterra Integral Equations with Variable Coefficients

A Fractional Spectral Collocation for Solving Second Kind Nonlinear Volterra Integral Equations with Weakly Singular Kernels

A modified kernel-based collocation method for interface boundary value problems

A correction function-based kernel-free boundary integral method for elliptic PDEs with implicitly defined interfaces

Reproducing Kernel Functions Based Univariate Spline Interpolation.

An efficient numerical algorithm for solving nonlinear fractional Volterra integro-differential equation

Toward Efficient Kernel-Based Solvers for Nonlinear PDEs

A High-Order Kernel Method for Diffusion and Reaction-Diffusion Equations on Surfaces

An Analytic Solution for Kernel Adaptive Filtering

Two Numerical Schemes Via an Auxiliary Function for Nonlocal Problems With Integrable Kernels

A new application of the reproducing kernel method for solving linear systems of fractional order Volterra integro-differential equations

Nontrivial Solutions for a First-order Impulsive Integral Boundary Value Problem on Time Scales

Integral BVPs for a Class of First-Order Impulsive Functional Differential Equations