Abstract:Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed Neural Networks (MINNs), a class of architectures specifically tailored to handle mesh based functional data, and thus of particular interest for reduced order modeling of parametrized Partial Differential Equations (PDEs). The driving idea behind MINNs is to embed hidden layers into discrete functional spaces of increasing complexity, obtained through a sequence of meshes defined over the underlying spatial domain. The approach leads to a natural pruning strategy which enables the design of sparse architectures that are able to learn general nonlinear operators. We assess this strategy through an extensive set of numerical experiments, ranging from nonlocal operators to nonlinear diffusion PDEs, where MINNs are compared against more traditional architectures, such as classical fully connected Deep Neural Networks, but also more recent ones, such as DeepONets and Fourier Neural Operators. Our results show that MINNs can handle functional data defined on general domains of any shape, while ensuring reduced training times, lower computational costs, and better generalization capabilities, thus making MINNs very well-suited for demanding applications such as Reduced Order Modeling and Uncertainty Quantification for PDEs.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to develop a new neural network architecture - Mesh - Informed Neural Networks (MINNs) to efficiently process grid - based functional data, especially for reduced - order modeling of parameterized partial differential equations (PDEs). Specifically, the paper aims to solve the problem through the following points: 1. **Handling nonlinear operators in high - dimensional spaces**: Traditional fully - connected deep neural networks have problems such as long training time, high computational cost, and easy over - fitting when handling nonlinear operators in high - dimensional spaces. MINNs overcome these problems by introducing a sparse architecture, enabling them to learn these operators more effectively. 2. **Adapting to domains of arbitrary shapes**: MINNs can process functional data on domains of arbitrary shapes, not just hypercubes or graph structures. This makes MINNs more flexible and effective in dealing with problems of complex geometric shapes. 3. **Improving generalization ability**: By embedding hidden layers into discrete functional spaces, MINNs can learn general nonlinear operators and have better generalization ability. This is especially important in multi - query applications (such as optimal control and statistical inference), because these applications require frequent calls to expensive numerical solvers. 4. **Reducing training time and computational cost**: MINNs reduce the degrees of freedom of the model by using a prior pruning strategy, thereby reducing training time and computational cost. This strategy utilizes the geometric knowledge from the underlying space to make the model more efficient. 5. **Comparison with existing methods**: Through extensive numerical experiments, the paper compares MINNs with traditional fully - connected deep neural networks and some recent methods (such as DeepONets and Fourier Neural Operators), showing the advantages of MINNs in handling non - local operators and nonlinear diffusion PDEs, etc. In summary, the main objective of this paper is to solve the problems existing in traditional deep neural networks when handling nonlinear operators in high - dimensional spaces by proposing MINNs, and to provide a more efficient, more flexible, and more generalization - capable solution.

Mesh-Informed Neural Networks for Operator Learning in Finite Element Spaces

Nonlinear model order reduction for problems with microstructure using mesh informed neural networks

Interfacing finite elements with deep neural operators for fast multiscale modeling of mechanics problems

Neural Operator: Learning Maps Between Function Spaces

Finite Operator Learning: Bridging Neural Operators and Numerical Methods for Efficient Parametric Solution and Optimization of PDEs

Advanced Deep Operator Networks to Predict Multiphysics Solution Fields in Materials Processing and Additive Manufacturing

Physics-informed MeshGraphNets (PI-MGNs): Neural finite element solvers for non-stationary and nonlinear simulations on arbitrary meshes

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations

Separable Operator Networks

Data-driven and physics-informed deep learning operators for solution of heat conduction equation with parametric heat source

MeshingNet: A New Mesh Generation Method based on Deep Learning

Operator Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations Characterized by Sharp Solutions

BelNet: basis enhanced learning, a mesh-free neural operator

Improved architectures and training algorithms for deep operator networks

R-adaptive DeepONet: Learning Solution Operators for PDEs with Discontinuous Solutions Using an R-adaptive Strategy

Operator Learning with Neural Fields: Tackling PDEs on General Geometries

Improved generalization with deep neural operators for engineering systems: Path towards digital twin

Derivative-Informed Neural Operator: An Efficient Framework for High-Dimensional Parametric Derivative Learning

D2NO: Efficient Handling of Heterogeneous Input Function Spaces with Distributed Deep Neural Operators

Solving Partial Differential Equations Using Point-Based Neural Networks.