Abstract:We analyze a novel multi-level version of a recently introduced compressed sensing (CS) Petrov-Galerkin (PG) method from [H. Rauhut and Ch. Schwab: Compressive Sensing Petrov-Galerkin approximation of high-dimensional parametric operator equations, Math. Comp. 304(2017) 661-700] for the solution of many-parametric partial differential equations. We propose to use multi-level PG discretizations, based on a hierarchy of nested finite dimensional subspaces, and to reconstruct parametric solutions at each level from level-dependent random samples of the high-dimensional parameter space via CS methods such as weighted l1-minimization. For affine parametric, linear operator equations, we prove that our approach allows to approximate the parametric solution with (almost) optimal convergence order as specified by certain summability properties of the coefficient sequence in a general polynomial chaos expansion of the parametric solution and by the convergence order of the PG discretization in the physical variables. The computations of the parameter samples of the PDE solution is "embarrassingly parallel", as in Monte-Carlo Methods. Contrary to other recent approaches, and as already noted in [A. Doostan and H. Owhadi: A non-adapted sparse approximation of PDEs with stochastic inputs. JCP 230(2011) 3015-3034] the optimality of the computed approximations does not require a-priori assumptions on ordering and structure of the index sets of the largest gpc coefficients (such as the "downward closed" property). We prove that under certain assumptions work versus accuracy of the new algorithms is asymptotically equal to that of one PG solve for the corresponding nominal problem on the finest discretization level up to a constant.

What problem does this paper attempt to address?

This paper attempts to solve the problem of numerical solutions of high - dimensional parameterized partial differential equations (PDEs), especially when the dimension of the parameter space is high or infinite, traditional methods will encounter the curse of dimensionality problem. The author proposes a multi - layer compressed sensing Petrov - Galerkin discretization method to overcome this challenge. ### Specific problem description 1. **Numerical solutions of high - dimensional parameterized PDEs**: - Traditional numerical methods are inefficient in dealing with high - dimensional parameter spaces because as the parameter dimension increases, the computational complexity grows exponentially (i.e., the curse of dimensionality). This makes it very difficult to accurately solve high - dimensional parameterized PDEs. 2. **Accelerate convergence and mitigate the curse of dimensionality**: - The goal of the paper is to develop a method that can significantly reduce the computational cost while maintaining high precision and can effectively handle high - dimensional parameter spaces. Specifically, the author hopes to achieve a faster convergence rate than the Monte Carlo method while avoiding the impact of the curse of dimensionality. 3. **Non - invasiveness and parallelism**: - The author also hopes that the proposed method is non - invasive, that is, it can utilize existing fixed - parameter PDE solvers without the need to re - implement these solvers. In addition, this method should support parallel computing, similar to parallel sampling in the Monte Carlo method. ### Proposed solution To achieve the above goals, the author introduces the multi - layer compressed sensing Petrov - Galerkin (CS - PG) discretization method. The main features of this method include: - **Multi - layer discretization**: Based on a series of nested finite - dimensional subspaces, approximate the parameter solution through multi - layer discretization. - **Random sampling and compressed sensing**: Use level - dependent random samples at each layer and reconstruct the coefficients of the generalized polynomial chaos expansion through compressed sensing techniques (such as weighted \(\ell_1\) minimization). - **Parallel computing**: The calculation of parameter samples can be carried out in parallel, similar to the Monte Carlo method. - **Optimal convergence rate**: Under certain sparsity assumptions, this method can provide the same asymptotic workload as a single PG solution but with a higher convergence rate. ### Mathematical model Consider the linear parameterized operator equation: \[ A(y)u(y)=f \] where the parameter vector \( y\in U \) is located in the high - dimensional space \( U \), and \( A(y):X\rightarrow Y' \) is a mapping from a reflexive Banach space \( X \) to the dual space of another reflexive Banach space \( Y \). Specific examples include the affine - parameter diffusion equation: \[ a(x,y)=\bar{a}(x)+\sum_{j\geq1}y_j\psi_j(x),\quad x\in D \] The corresponding second - order divergence - form elliptic Dirichlet problem is: \[ A(y)u := -\nabla\cdot(a(\cdot,y)\nabla u)=f\quad\text{in }D,\quad u|_{\partial D} = 0 \] ### Conclusion By introducing the multi - layer compressed sensing Petrov - Galerkin discretization method, this paper aims to solve the problem of numerical solutions of high - dimensional parameterized PDEs. This method can not only effectively handle high - dimensional parameter spaces but also provide a faster convergence rate than traditional methods and support parallel computing, thereby significantly improving computational efficiency.

Multi-level Compressed Sensing Petrov-Galerkin discretization of high-dimensional parametric PDEs

On Multiscale Methods in Petrov-Galerkin formulation

Multilevel higher order Quasi-Monte Carlo Bayesian Estimation

Sparse Gaussian processes for solving nonlinear PDEs

Parametric PDEs: Sparse or Low-Rank Approximations?

Multilevel CNNs for Parametric PDEs

Hierarchical Super-Localized Orthogonal Decomposition Method

On full history recursive multilevel Picard approximations and numerical approximations for high-dimensional nonlinear parabolic partial differential equations and high-dimensional nonlinear backward stochastic differential equations

Multilevel Picard algorithm for general semilinear parabolic PDEs with gradient-dependent nonlinearities

Nonlinear discontinuous Petrov-Galerkin methods

Nonlinear compressive reduced basis approximation for multi-parameter elliptic problem

Multistage DPG time-marching scheme for nonlinear problems

Chebyshev HOPGD with sparse grid sampling for parameterized linear systems

A One-level Additive Schwarz Preconditioner for a Discontinuous Petrov-Galerkin Method

On Multilevel Picard Numerical Approximations for High-Dimensional Nonlinear Parabolic Partial Differential Equations and High-Dimensional Nonlinear Backward Stochastic Differential Equations

Randomized neural network with Petrov–Galerkin methods for solving linear and nonlinear partial differential equations

Encapsulated PGD Algebraic Toolbox Operating with High-Dimensional Data

Local surrogate models with reduced dimensionality via overlapping domain decomposition and proper generalized decomposition

Analysis of the SUPG Method for the Solution of Optimal Control Problems

Eliminating the pollution effect in Helmholtz problems by local subscale correction

Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems