Physics-Informed Neural Networks and Extensions

Maziar Raissi,Paris Perdikaris,Nazanin Ahmadi,George Em Karniadakis
2024-08-30
Abstract:In this paper, we review the new method Physics-Informed Neural Networks (PINNs) that has become the main pillar in scientific machine learning, we present recent practical extensions, and provide a specific example in data-driven discovery of governing differential equations.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The paper primarily explores Physics-Informed Neural Networks (PINNs) and their applications and extensions in the field of scientific machine learning. Specifically: 1. **Problem Background**: Traditional numerical methods have achieved great success in solving partial differential equations (PDEs), but they still face challenges in seamlessly integrating data into existing algorithms, handling complex industrial problems, and solving inverse problems. Additionally, existing engineering software codes are large and difficult to maintain. 2. **Core Idea of PINNs**: By integrating data and mathematical models, PINNs define a new paradigm for scientific machine learning. This approach can handle data of different scales and combine partially known physical laws to infer unknown parameters or missing function terms, thereby simultaneously recovering solutions. 3. **Applications of PINNs**: PINNs can solve both forward and inverse problems and handle issues such as uncertainty quantification. Through automatic differentiation, PINNs can approximate the exact solutions of PDEs without using any regular grids. 4. **Extensions of PINNs**: - **Adaptive Weights**: A new gradient descent algorithm is proposed, which uses the Neural Tangent Kernel (NTK) to adaptively adjust the loss weights. - **Domain Decomposition**: Combining PINNs with domain decomposition methods to handle multi-scale problems, improving parallel speed in large-scale computational domains. - **Long-Time Integration**: By improving the loss function to explicitly consider physical causality, the problem of long-time dynamic system integration is addressed. - **Other Types of PDEs**: PINNs are also applied in fields such as stochastic partial differential equations and fractional partial differential equations. 5. **Theoretical Foundation**: Preliminary studies indicate that for certain types of PDEs, as the number of sampling points increases, PINNs converge to the true solution of the equations. In summary, this paper aims to demonstrate the potential and advantages of PINNs as a novel scientific machine learning tool in modeling complex physical systems and data analysis.