Abstract:From a kernel-based modeling point of view, one can consider the given differential equations together with its initial or boundary conditions as prior knowledge and seek the solution by means of Least Squares Support Vector Machines (LSSVMs) whose parameters are adjusted to minimize an appropriate error function. In particular, here we introduce a LS-SVM based framework for learning the solutions of dynamical systems governed by Ordinary Differential Equations, Differential Algebraic Equations (DAEs) as well as Partial Differential Equations (PDEs) [1, 2, 3]. The problem is formulated as an optimization problem in the primal-dual setting. The approximate solution in the primal is expressed in terms of the feature map and is forced to satisfy the system dynamics, initial/boundary conditions using a constrained optimization problem. The optimal representation of the solution is then obtained in the dual. For the linear and nonlinear cases, the model parameters are obtained by solving a system of linear and nonlinear equations, respectively. The proposed model utilizes few training points to learn a closed form approximate solution. Furthermore, it does not require index reduction techniques and can directly be applied to learn the state trajectories of the underlying implicit systems. The experimental results on different ODE systems, DEA systems with index from 0 to 3, as well as PDEs are presented and compared with analytic solutions to confirm the validity and applicability of the proposed method. Similarly, analogous approaches based on the introduced LS-SVM framework can be used to address inverse problems where given the observational data one in particular aims at estimating the unknown parameters of the system [4, 5]. Here we present an extended formulation using LS-SVM core model to estimate the unknown constant or time-varying parameters of the given dynamical system described by ordinary (delay) differential equations. Finally, some possibilities and future directions for considering deeper architectures will be discussed.

Solving higher order nonlinear ordinary differential equations with least squares support vector machines

Least Squares Support Vector Machines Based on Support Vector Degrees

New Predictive Control Algorithms Based on Least Squares Support Vector Machines

Using Svm To Model And Control Nonlinear Dynamical Systems

Numerical solutions to one dimensional linear Volterra-Fredholm integral equations based on LS-SVM model

Learning solutions to partial differential equations using LS-SVM

A novel approach for solving linear Fredholm integro-differential equations via LS-SVM algorithm

LS-SVM based solutions to differential equations

Numerical solution for high-order ordinary differential equations using H-ELM algorithm

High accuracy least-squares solutions of nonlinear differential equations

Numerical solution for initial and boundary value problems of high-order ordinary differential equations using Hermite neural network algorithm with improved extreme learning machine

Sparse Least Squares Support Vector Machine for Function Estimation

Support Vector Machines Α Th-Order Inverse Control——nonlinear Continuous Systems

Analytically Embedding Differential Equation Constraints into Least Squares Support Vector Machines using the Theory of Functional Connections

Dynamic least squares support vector machine

Least Square Generalized Support Vector Machines for Regression

Numerical Solution of Higher-Order Linear and Nonlinear Ordinary Differential Equations with Orthogonal Rational Legendre Functions

Some numerical algorithms for solving the highly oscillatory second-order initial value problems.

Solving nonlinear ODEs with the ultraspherical spectral method

Least-squares Solutions of Linear Differential Equations

Least Squares Support Vector Machine on Morlet Wavelet Kernel Function and Its Application to Nonlinear System Identification