Abstract:Physics-informed neural networks (PINNs) have emerged as a versatile and widely applicable concept across various science and engineering domains over the past decade. This article offers a comprehensive overview of the fundamentals of PINNs, tracing their evolution, modifications, and various variants. It explores the impact of different parameters on PINNs and the optimization algorithms involved. The review also delves into the theoretical advancements related to the convergence, consistency, and stability of numerical solutions using PINNs, while highlighting the current state of the art. Given their ability to address equations involving complex physics, the article discusses various applications of PINNs, with a particular focus on their utility in computational fluid dynamics problems. Additionally, it identifies current gaps in the research and outlines future directions for the continued development of PINNs.

What problem does this paper attempt to address?

This paper aims to explore the basic theory of Physics - Informed Neural Networks (PINNs) and their applications in complex systems. Specifically, the paper attempts to solve the following problems: 1. **Basic Theory and Evolution** - **Basic Concepts**: PINNs transform the problem of solving differential equations into the problem of minimizing the loss function by embedding physical laws into the neural network framework. The loss function is defined as the sum of the initial conditions, boundary conditions and the differential equation residuals. - **Development History**: The paper traces the development history of PINNs, from the initial proposal to the emergence of various improvement methods, such as Variational PINNs (VPINNs), Conservative PINNs (cPINNs), etc. 2. **Theoretical Progress** - **Convergence**: The paper discusses the challenges encountered by PINNs in the optimization process, such as the local minimum problem and non - convex loss functions. - **Consistency and Stability**: Analyzes the theoretical progress of PINNs in the consistency and stability of numerical solutions. 3. **Applications of Complex Physical Equations** - **Computational Fluid Dynamics**: The paper pays special attention to the application of PINNs in computational fluid dynamics, especially their performance in dealing with complex fluid dynamics and heat and mass transfer problems. - **High - Dimensional Problems**: Discusses the advantages of PINNs in dealing with high - dimensional differential equations, especially in applications in engineering and finance fields. 4. **Research Gaps and Future Directions** - **Current Shortcomings**: The paper points out the shortcomings of PINNs in theoretical basis, error analysis tools, etc. - **Future Directions**: Proposes the directions for future research, such as improving optimization algorithms, increasing training efficiency, and expanding application areas. ### Examples of Mathematical Formulas Some key formulas involved in the paper are as follows: - **Loss Function of PINNs**: \[ L = L_f + L_b \] where \[ L_f=\frac{1}{N_f}\sum_{x\in\Omega_f}\left\|L[f(x)] - \phi(x)\right\|^2 \] \[ L_b = \frac{1}{N_b}\sum_{x\in\partial\Omega_b}\left\|B[f(x)]-\psi(x)\right\|^2 \] - **Loss Function of Variational PINNs (VPINNs)**: \[ L_{\text{var}}=\int_{\Omega}(\mathcal{R}(x)\cdot v(x))\,dx \] where \(\mathcal{R}(x)\) is the residual of the PDE and \(v(x)\) is the test function. Through these formulas, the paper elaborates in detail on the advantages and limitations of PINNs in dealing with complex physical problems, providing a valuable reference for future research.

Exploring Physics-Informed Neural Networks: From Fundamentals to Applications in Complex Systems

Understanding Physics-Informed Neural Networks: Techniques, Applications, Trends, and Challenges

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges

From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning

Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What's Next

Physics-Informed Neural Network (PINN) Evolution and Beyond: A Systematic Literature Review and Bibliometric Analysis

Physics-informed neural networks (PINNs) for fluid mechanics: A review

Physics-Informed Neural Networks and Extensions

A Review of Physics Informed Neural Networks for Multiscale Analysis and Inverse Problems

Physics-Informed Neural Networks for Solving 2-D Magnetostatic Fields

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Physics-informed Neural Networks (PINN) for computational solid mechanics: Numerical frameworks and applications

Investigations on Physics-Informed Neural Networks for Aerodynamics

Convergence and error analysis of PINNs

Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning

Physics-informed neural nets for control of dynamical systems

Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?

An Expert's Guide to Training Physics-informed Neural Networks

PINNfluence: Influence Functions for Physics-Informed Neural Networks

Physics-Informed Neural Networks for Heat Transfer Problems

Physics-informed Neural Networks for Encoding Dynamics in Real Physical Systems