Abstract:We present a method for computing the inverse parameters and the solution field to inverse parametric PDEs based on randomized neural networks. This extends the local extreme learning machine technique originally developed for forward PDEs to inverse problems. We develop three algorithms for training the neural network to solve the inverse PDE problem. The first algorithm (NLLSQ) determines the inverse parameters and the trainable network parameters all together by the nonlinear least squares method with perturbations (NLLSQ-perturb). The second algorithm (VarPro-F1) eliminates the inverse parameters from the overall problem by variable projection to attain a reduced problem about the trainable network parameters only. It solves the reduced problem first by the NLLSQ-perturb algorithm for the trainable network parameters, and then computes the inverse parameters by the linear least squares method. The third algorithm (VarPro-F2) eliminates the trainable network parameters from the overall problem by variable projection to attain a reduced problem about the inverse parameters only. It solves the reduced problem for the inverse parameters first, and then computes the trainable network parameters afterwards. VarPro-F1 and VarPro-F2 are reciprocal to each other in a sense. The presented method produces accurate results for inverse PDE problems, as shown by the numerical examples herein. For noise-free data, the errors for the inverse parameters and the solution field decrease exponentially as the number of collocation points or the number of trainable network parameters increases, and can reach a level close to the machine accuracy. For noisy data, the accuracy degrades compared with the case of noise-free data, but the method remains quite accurate. The presented method has been compared with the physics-informed neural network method.

Feasibility-based fixed point networks

A Fast Regularized Iterative Algorithm for Fan-Beam CT Reconstruction.

Positive Competitive Networks for Sparse Reconstruction

Wasserstein-based Projections with Applications to Inverse Problems

FiRe: Fixed-points of Restoration Priors for Solving Inverse Problems

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Inverse Feasibility in Over-the-Air Federated Learning

Per-Tensor Fixed-Point Quantization of the Back-Propagation Algorithm

Learning to Warm-Start Fixed-Point Optimization Algorithms

Fidelity imposed network edit (FINE) for solving ill-posed image reconstruction

Fixed-Time Stable Neurodynamic Flow to Sparse Signal Recovery via Nonconvex L1-β2-Norm

Fast Sparse Recovery Via Non-Convex Optimization

A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks

Robust Sparse Recovery Via Non-Convex Optimization

A Primal–dual Fixed Point Algorithm for Convex Separable Minimization with Applications to Image Restoration

NESTANets: stable, accurate and efficient neural networks for analysis-sparse inverse problems

What's in a Prior? Learned Proximal Networks for Inverse Problems

Data-proximal null-space networks for inverse problems

Efficient and Robust Recovery of Sparse Signal and Image Using Generalized Nonconvex Regularization

Recovering Sparse Nonnegative Signals via Non-convex Fraction Function Penalty