Abstract:From a kernel-based modeling point of view, one can consider the given differential equations together with its initial or boundary conditions as prior knowledge and seek the solution by means of Least Squares Support Vector Machines (LSSVMs) whose parameters are adjusted to minimize an appropriate error function. In particular, here we introduce a LS-SVM based framework for learning the solutions of dynamical systems governed by Ordinary Differential Equations, Differential Algebraic Equations (DAEs) as well as Partial Differential Equations (PDEs) [1, 2, 3]. The problem is formulated as an optimization problem in the primal-dual setting. The approximate solution in the primal is expressed in terms of the feature map and is forced to satisfy the system dynamics, initial/boundary conditions using a constrained optimization problem. The optimal representation of the solution is then obtained in the dual. For the linear and nonlinear cases, the model parameters are obtained by solving a system of linear and nonlinear equations, respectively. The proposed model utilizes few training points to learn a closed form approximate solution. Furthermore, it does not require index reduction techniques and can directly be applied to learn the state trajectories of the underlying implicit systems. The experimental results on different ODE systems, DEA systems with index from 0 to 3, as well as PDEs are presented and compared with analytic solutions to confirm the validity and applicability of the proposed method. Similarly, analogous approaches based on the introduced LS-SVM framework can be used to address inverse problems where given the observational data one in particular aims at estimating the unknown parameters of the system [4, 5]. Here we present an extended formulation using LS-SVM core model to estimate the unknown constant or time-varying parameters of the given dynamical system described by ordinary (delay) differential equations. Finally, some possibilities and future directions for considering deeper architectures will be discussed.

A novel approach for solving linear Fredholm integro-differential equations via LS-SVM algorithm

Numerical solutions to one dimensional linear Volterra-Fredholm integral equations based on LS-SVM model

Optimization of Approximate Solution of Integral Equations of Several Variables

Solving higher order nonlinear ordinary differential equations with least squares support vector machines

Learning solutions to partial differential equations using LS-SVM

LS-SVM based solutions to differential equations

Using Svm To Model And Control Nonlinear Dynamical Systems

Efficient numerical solution of linear Fredholm integro-differential equations via backward finite difference and Nyström methods

Analytically Embedding Differential Equation Constraints into Least Squares Support Vector Machines using the Theory of Functional Connections

Support Vector Machines Α Th-Order Inverse Control——nonlinear Continuous Systems

A Fast Numerical Solution Method for Two Dimensional Fredholm Integral Equations of the Second Kind

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

An efficient numerical algorithm for solving nonlinear fractional Volterra integro-differential equation

One Research of Numerical Solution Methods of Fredholm Integral Equation of the Second Kind in L1 Space

Thin plate spline Galerkin scheme for numerically solving nonlinear weakly singular Fredholm integral equations

Solving singularly perturbed fredholm integro-differential equation using exact finite difference method

Numerical solution for initial and boundary value problems of high-order ordinary differential equations using Hermite neural network algorithm with improved extreme learning machine

A fitted operator numerical method for singularly perturbed Fredholm integro-differential equation with integral initial condition

Solving Fredholm Integral Equations Using Deep Learning

Piecewise linear approximate solution of fractional order non-stiff and stiff differential-algebraic equations by orthogonal hybrid functions

Utilizing Cubic B-Spline Collocation Technique for Solving Linear and Nonlinear Fractional Integro-Differential Equations of Volterra and Fredholm Types