Abstract:Nearly all model-reduction techniques project the governing equations onto a linear subspace of the original state space. Such subspaces are typically computed using methods such as balanced truncation, rational interpolation, the reduced-basis method, and (balanced) proper orthogonal decomposition (POD). Unfortunately, restricting the state to evolve in a linear subspace imposes a fundamental limitation to the accuracy of the resulting reduced-order model (ROM). In particular, linear-subspace ROMs can be expected to produce low-dimensional models with high accuracy only if the problem admits a fast decaying Kolmogorov n-width (e.g., diffusion-dominated problems). Unfortunately, many problems of interest exhibit a slowly decaying Kolmogorov n-width (e.g., advection-dominated problems). To address this, we propose a novel framework for projecting dynamical systems onto nonlinear manifolds using minimum-residual formulations at the time-continuous and time-discrete levels; the former leads to manifold Galerkin projection, while the latter leads to manifold least-squares Petrov–Galerkin (LSPG) projection. We perform analyses that provide insight into the relationship between these proposed approaches and classical linear-subspace reduced-order models; we also derive a posteriori discrete-time error bounds for the proposed approaches. In addition, we propose a computationally practical approach for computing the nonlinear manifold, which is based on convolutional autoencoders from deep learning. Finally, we demonstrate the ability of the method to significantly outperform even the optimal linear-subspace ROM on benchmark advection-dominated problems, thereby demonstrating the method's ability to overcome the intrinsic n-width limitations of linear subspaces.

The Neural Network shifted-proper orthogonal decomposition: A machine learning approach for non-linear reduction of hyperbolic equations

Neural Network Emulation of Spatio-temporal Data Using Linear and Nonlinear Dimensionality Reduction

Non-intrusive model reduction of advection-dominated hyperbolic problems using neural network shift augmented manifold transformations

Explicable hyper-reduced order models on nonlinearly approximated solution manifolds of compressible and incompressible Navier-Stokes equations

Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning

Hyper-Reduced Autoencoders for Efficient and Accurate Nonlinear Model Reductions

Deep orthogonal decomposition: a continuously adaptive data-driven approach to model order reduction

Towards a machine learning pipeline in reduced order modelling for inverse problems: neural networks for boundary parametrization, dimensionality reduction and solution manifold approximation

A Deep Learning approach to Reduced Order Modelling of Parameter Dependent Partial Differential Equations

Nonlinear model order reduction for problems with microstructure using mesh informed neural networks

Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders

Nonlinear model reduction with Neural Galerkin schemes on quadratic manifolds

Non-linear Manifold Reduced-Order Models with Convolutional Autoencoders and Reduced Over-Collocation Method

Nonlinear model reduction for operator learning

Accelerating Neural ODEs Using Model Order Reduction

Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders

Neural Ordinary Differential Equations for Data-Driven Reduced Order Modeling of Environmental Hydrodynamics

A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder

Balanced Neural ODEs: nonlinear model order reduction and Koopman operator approximations

Neural Ordinary Differential Equations for Model Order Reduction of Stiff Systems

Data-driven reduced order modeling of environmental hydrodynamics using deep autoencoders and neural ODEs