Achieving robustness in hybrid models: A physics-informed regularization approach for spatiotemporal parameter estimation in PDEs

Silabrata Pahari,Parth Shah,Joseph Sang-Il Kwon
DOI: https://doi.org/10.1016/j.cherd.2024.01.067
IF: 4.119
2024-04-01
Chemical Engineering Research and Design
Abstract:Recent advancements in computational modeling have led to the development of hybrid models, combining Machine Learning’s data-driven adaptability with the insights of complex models based on partial differential equations (PDEs). These models face challenges in estimating latent chemical mechanisms. The study explores integrating regularization terms into the loss function of hybrid models during training to ensure that learned spatiotemporal parameters are statistically and physically grounded. This approach includes penalty terms reflecting gradients and patterns in chemical systems, reducing the risk of overfitting to non-physical data trends. A novel aspect of this research is the introduction of a two-phased training methodology, beginning with a physics-informed ‘warm-start’ phase. This initial phase guides the model towards a specific loss value, setting a foundation for accurate convergence. Subsequently, regularization is deactivated, allowing for standard model training to proceed. This two-step approach addresses the longstanding issue of pre-training in hybrid models. The effectiveness of this approach is demonstrated through a case study focusing on the reaction–diffusion system. Here, the model is tasked with estimating spatiotemporally varying diffusivity. The results show that our approach handles the intricacies of pre-training and accurately estimates the true nature of diffusivity. This approach effectively overcomes the challenge of solution multiplicity.
engineering, chemical
What problem does this paper attempt to address?