CP-PINNs: Data-Driven Changepoints Detection in PDEs Using Online Optimized Physics-Informed Neural Networks

Zhikang Dong,Pawel Polak

2024-04-02

Abstract:We investigate the inverse problem for Partial Differential Equations (PDEs) in scenarios where the parameters of the given PDE dynamics may exhibit changepoints at random time. We employ Physics-Informed Neural Networks (PINNs) - universal approximators capable of estimating the solution of any physical law described by a system of PDEs, which serves as a regularization during neural network training, restricting the space of admissible solutions and enhancing function approximation accuracy. We demonstrate that when the system exhibits sudden changes in the PDE dynamics, this regularization is either insufficient to accurately estimate the true dynamics, or it may result in model miscalibration and failure. Consequently, we propose a PINNs extension using a Total-Variation penalty, which allows to accommodate multiple changepoints in the PDE dynamics and significantly improves function approximation. These changepoints can occur at random locations over time and are estimated concurrently with the solutions. Additionally, we introduce an online learning method for re-weighting loss function terms dynamically. Through empirical analysis using examples of various equations with parameter changes, we showcase the advantages of our proposed model. In the absence of changepoints, the model reverts to the original PINNs model. However, when changepoints are present, our approach yields superior parameter estimation, improved model fitting, and reduced training error compared to the original PINNs model.

Machine Learning,Artificial Intelligence,Dynamical Systems,Numerical Analysis

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively detect these changepoints when the parameters in the partial differential equations (PDEs) dynamics may have abrupt changes at random time points. The traditional Physics - Informed Neural Networks (PINNs) method assumes that the dynamics parameters of PDEs are constant throughout the time domain, which may lead to model calibration failure or inaccurate estimation when dealing with actual systems containing abrupt changes. Therefore, this paper proposes an extended PINNs method. By introducing the Total Variation (TV) penalty term, it can adapt to multiple changepoints in PDE dynamics and significantly improve the accuracy of function approximation. In addition, the author also introduces an online learning method for dynamically re - weighting the loss function terms to balance the priorities among changepoint detection, model fitting and PDE discovery. Through empirical analysis using various equation examples with parameter changes, the advantages of the proposed model are demonstrated. When there are no changepoints, this model degenerates into the original PINNs model; but when there are changepoints, this method is superior to the original PINNs model in terms of parameter estimation, model fitting and reducing training error.