Abstract:This paper deals with the state prediction of nonlinear stochastic dynamic systems. The emphasis is laid on a solution to the integral Chapman-Kolmogorov equation by a deterministic-integration-rule-based point-mass method. A novel concept of reliable data-augmented, i.e., mathematics- and data-informed, integration rule is developed to enhance the point-mass state predictor, where the trained neural network (representing data contribution) is used for the selection of the best integration rule from a set of available rules (representing mathematics contribution). The proposed approach combining the best properties of the standard mathematics-informed and novel data-informed rules is thoroughly discussed.

What problem does this paper attempt to address?

This paper attempts to solve the problem of solving the integral Chapman - Kolmogorov equation (CKE) in the state prediction of nonlinear stochastic dynamic systems. Specifically, the paper focuses on solving the CKE by the point mass method (PMM) of the deterministic integral rule (IR), and proposes an innovative concept based on data augmentation, namely, a method for selecting integral rules driven by mathematics and data. ### Main problem description in the paper 1. **State prediction of nonlinear stochastic dynamic systems**: - The research object is a nonlinear discrete - time stochastic dynamic system. - It is necessary to estimate the future state of the system from noisy or incomplete measurements. 2. **Solution of the Chapman - Kolmogorov equation (CKE)**: - The CKE is used to calculate the predicted probability density function (PDF), but for most nonlinear or non - Gaussian models, the CKE has no analytical solution. - Therefore, it is necessary to use the numerical integration method for approximate solution. 3. **Limitations of existing methods**: - Math - driven methods (such as linearization, Monte Carlo, etc.) have limited accuracy in some cases. - Data - driven methods (such as neural networks) are flexible, but may not guarantee stability or convergence in specific tasks. ### Core contributions of the paper - **Integral rule selection with data augmentation**: - A method for selecting integral rules combining mathematics and data - driven is proposed, which uses a pre - trained neural network (NN) to select the best integral rule according to the current working conditions. - This method aims to reduce the intervention of users or designers, while improving the accuracy of state prediction and having little impact on computational complexity. - **Error estimation and optimization**: - The error of the integral rule is estimated by the NN, so as to select the rule with the smallest error. - The cross - entropy is used as the loss function to train the NN classifier to ensure the accuracy of the classification task. ### Experimental verification - **Experimental setup**: - Linear dynamic models and Gaussian sum initial PDFs are used for experiments. - The performance of different integral rules is verified by a large number of Monte Carlo simulations. - **Result analysis**: - The data - augmented integral rule selection method significantly improves the prediction accuracy, especially when dealing with non - Gaussian distributions. - The experimental results show that, compared with the traditional midpoint rule and Richardson extrapolation method, the new method performs better in many cases. ### Summary This paper proposes an innovative data - augmented integral rule selection method, which combines the advantages of mathematical theory and data - driven, and effectively improves the accuracy of state prediction of nonlinear stochastic dynamic systems. This method not only reduces user intervention, but also provides more accurate error estimation, and is suitable for a variety of numerical integration problems.

Data-Augmented Numerical Integration in State Prediction: Rule Selection

Beyond Predictions in Neural ODEs: Identification and Interventions.

Data-driven learning of non-autonomous systems

Bayesian Numerical Integration with Neural Networks

Iterated INLA for State and Parameter Estimation in Nonlinear Dynamical Systems

Neural integration for constitutive equations using small data

Stochastic Integration Based Estimator: Robust Design and Stone Soup Implementation

Online Joint State Inference and Learning of Partially Unknown State-Space Models

Neural Incremental Data Assimilation

Adaptive sampling-based quadrature rules for efficient Bayesian prediction

Integrating Physics-Informed Deep Learning and Numerical Methods for Robust Dynamics Discovery and Parameter Estimation

Deep learning based numerical approximation algorithms for stochastic partial differential equations and high-dimensional nonlinear filtering problems

Learning to Assimilate in Chaotic Dynamical Systems

Physics-informed nonlinear vector autoregressive models for the prediction of dynamical systems

Stochastic Data-Driven Predictive Control: Chance-Constraint Satisfaction with Identified Multi-step Predictors

Learning Dynamics from Noisy Measurements using Deep Learning with a Runge-Kutta Constraint

Neural Integration of Continuous Dynamics

A structurally informed data assimilation approach for nonlinear partial differential equations

Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networks

Stochastic Model Predictive Control Utilizing Bayesian Neural Networks

On quadrature rules for solving Partial Differential Equations using Neural Networks