Abstract:We propose a Deep Operator Network~(DeepONet) framework to learn the dynamic response of continuous-time nonlinear control systems from data. To this end, we first construct and train a DeepONet that approximates the control system's local solution operator. Then, we design a numerical scheme that recursively uses the trained DeepONet to simulate the control system's long/medium-term dynamic response for given control inputs and initial conditions. We accompany the proposed scheme with an estimate for the error bound of the associated cumulative error. Furthermore, we design a data-driven Runge-Kutta~(RK) explicit scheme that uses the DeepONet forward pass and automatic differentiation to better approximate the system's response when the numerical scheme's step size is sufficiently small. Numerical experiments on the predator-prey, pendulum, and cart pole systems confirm that our DeepONet framework learns to approximate the dynamic response of nonlinear control systems effectively.
What problem does this paper attempt to address?
This paper aims to solve the problem of predicting the dynamic responses of non - autonomous systems (i.e., systems whose inputs change over time) over a long - time range. Specifically, the paper proposes to use the Deep Operator Neural Network (DeepONet) to approximate the solution operators of these systems. Traditional methods often require a large amount of computing resources when dealing with such problems and may be too expensive for control, optimization, and uncertainty quantification tasks. Therefore, by introducing the data - driven DeepONet framework, this research aims to accelerate the numerical simulation of complex non - autonomous systems while maintaining high accuracy.
### Main Objectives
1. **Approximation of Local Solution Operators**: Construct a neural - operator - based framework that can learn the mapping relationship from the current state and local input to the next state.
2. **Medium - and Long - Term Simulation**: Design an efficient scheme to use the above operator - learning framework to simulate the dynamic responses of the system for a long or medium - term under a given input.
### Main Contributions
1. **Model and Algorithm**: Model non - autonomous/control dynamical systems into the deep - operator - learning framework and propose a DeepONet - based numerical scheme to effectively and recursively simulate the solutions of the system.
2. **Improved Data - Driven Runge - Kutta (RK) Method**: Propose a new data - driven RK method based on the forward pass and automatic differentiation of DeepONet, which reduces the accumulated error and improves the recursive prediction accuracy in long - term simulations.
3. **Error Estimation**: Provide the accumulated error estimate of the DeepONet - based numerical scheme, and its estimated error bound is tighter than that of existing methods. In addition, it is proved that the newly proposed RK method has better stability.
4. **Experimental Verification**: Test the proposed framework on multiple standard models, including predator - prey systems, pendulum systems, inverted pendulum systems, and power engineering tasks, and the experimental results show the effectiveness of the method.
### Mathematical Model
Consider the following continuous - time non - autonomous system:
\[
\frac{dx(t)}{dt}=f(x(t), u(t)), \quad t\in [a, b]
\]
The initial condition is:
\[
x(a) = x_0
\]
where \(x(t)\in X\subseteq\mathbb{R}^n\) is the state vector, \(u(t)\in U\subseteq\mathbb{R}^p\) is the input vector, and \(f:X\times U\rightarrow X\) is an unknown function.
### Solution Operator
The solution operator \(F\) is defined as:
\[
F(x_0, u[a, t))(t)\equiv x(t)=x_0+\int_a^t f(x(s), u(s))ds
\]
### Approximate System
In practical applications, we can usually only obtain the discrete representation \(u_m\) of the input function \(u(t)\), thus obtaining the approximate system:
\[
\frac{d\tilde{x}(t)}{dt}=f(\tilde{x}(t), u_m), \quad t\in [a, b]
\]
Its solution operator is:
\[
F(x_0, u_m)(t)\equiv\tilde{x}(t)=x_0+\int_a^t f(\tilde{x}(s), u_m)ds
\]
### Deep Operator Network (DeepONet)
To learn the solution operator \(F\), the paper proposes to use the DeepONet framework. DeepONet consists of two neural networks: the Branch Net and the Trunk Net. The Branch Net maps the current state \(\tilde{x}(t_n)\) and local input \(u_m^n\) to the feature vector \(\beta\), and the Trunk Net maps the step size \(h_n\) to the feature vector \(\tau\). The final DeepONet output is:
\[
F_\theta(\tilde{