On the Preprocessing of Physics-informed Neural Networks: How to Better Utilize Data in Fluid Mechanics

Shengfeng Xu,Chang Yan,Zhenxu Sun,Renfang Huang,Dilong Guo,Guowei Yang
2024-07-11
Abstract:Physics-Informed Neural Networks (PINNs) serve as a flexible alternative for tackling forward and inverse problems in differential equations, displaying impressive advancements in diverse areas of applied mathematics. Despite integrating both data and underlying physics to enrich the neural network's understanding, concerns regarding the effectiveness and practicality of PINNs persist. Over the past few years, extensive efforts in the current literature have been made to enhance this evolving method, by drawing inspiration from both machine learning algorithms and numerical methods. Despite notable progressions in PINNs algorithms, the important and fundamental field of data preprocessing remain unexplored, limiting the applications of PINNs especially in solving inverse problems. Therefore in this paper, a concise yet potent data preprocessing method focusing on data normalization was proposed. By applying a linear transformation to both the data and corresponding equations concurrently, the normalized PINNs approach was evaluated on the task of reconstructing flow fields in three turbulent cases. The results illustrate that by adhering to the data preprocessing procedure, PINNs can robustly achieve higher prediction accuracy for all flow quantities under different hyperparameter setups, without incurring extra computational cost, distinctly improving the utilization of limited training data. Though only verified in Navier-Stokes (NS) equations, this method holds potential for application to various other equations.
Fluid Dynamics
What problem does this paper attempt to address?
This paper mainly discusses the importance of data preprocessing in handling Physics-Informed Neural Networks (PINNs), especially in the context of data normalization methods for fluid dynamics. PINNs are a flexible framework that utilizes data and fundamental physical laws to solve forward and inverse problems of differential equations, and they have been widely applied in various mathematical applications. Despite some progress made in the forward and inverse problems of fluid dynamics using PINNs, their effectiveness and practicality are still questioned. The paper points out that although much work has been done to improve PINNs algorithms, the critical area of data preprocessing has not been fully explored, which limits the application of PINNs in solving inverse problems. Therefore, the authors propose a simple yet powerful data preprocessing method that focuses on data normalization. By simultaneously performing linear transformations on both the data and the relevant equations, this method is evaluated for the task of reconstructing flow fields in three turbulence cases. The results show that PINNs following the preprocessing steps can achieve higher prediction accuracy under different hyperparameter settings without increasing additional computational cost, thus effectively utilizing limited training data. Although this method is only validated in the Navier-Stokes (NS) equations, the authors believe that it has broad applicability and can be applied to various other equations. The structure of the paper includes a detailed description of PINNs and the proposed normalization method, the introduction of three sparse datasets used for evaluation, presentation of results, analysis, and conclusion. The research findings demonstrate that data preprocessing is crucial for improving the prediction accuracy and efficiency of PINNs.