Abstract:We present a method for computing the inverse parameters and the solution field to inverse parametric PDEs based on randomized neural networks. This extends the local extreme learning machine technique originally developed for forward PDEs to inverse problems. We develop three algorithms for training the neural network to solve the inverse PDE problem. The first algorithm (NLLSQ) determines the inverse parameters and the trainable network parameters all together by the nonlinear least squares method with perturbations (NLLSQ-perturb). The second algorithm (VarPro-F1) eliminates the inverse parameters from the overall problem by variable projection to attain a reduced problem about the trainable network parameters only. It solves the reduced problem first by the NLLSQ-perturb algorithm for the trainable network parameters, and then computes the inverse parameters by the linear least squares method. The third algorithm (VarPro-F2) eliminates the trainable network parameters from the overall problem by variable projection to attain a reduced problem about the inverse parameters only. It solves the reduced problem for the inverse parameters first, and then computes the trainable network parameters afterwards. VarPro-F1 and VarPro-F2 are reciprocal to each other in a sense. The presented method produces accurate results for inverse PDE problems, as shown by the numerical examples herein. For noise-free data, the errors for the inverse parameters and the solution field decrease exponentially as the number of collocation points or the number of trainable network parameters increases, and can reach a level close to the machine accuracy. For noisy data, the accuracy degrades compared with the case of noise-free data, but the method remains quite accurate. The presented method has been compared with the physics-informed neural network method.

Recurrent neural networks for computing weighted Moore-Penrose inverse1This project is supported by the National Nature Science Foundation of China, Doctoral Point Foundation of China and Youth Science Foundation of Universities in Shanghai of China.1

Recurrent Neural Networks For Computing Weighted Moore-Penrose Inverse

Recurrent Neural Network for Computing Outer Inverse.

Multimodal Moore-Penrose Inverse-Based Recomputation Framework for Big Data Analysis

Recurrent Neural Network for Computing the Drazin Inverse.

Fast Computation of Moore-Penrose Inverse Matrices

A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks

Noise-tolerant neural algorithm for online solving time-varying full-rank matrix Moore–Penrose inverse problems: A control-theoretic approach

Inverse and Moore–Penrose inverse of conditional matrices via convolution

Convergence of Rump’s Method for Computing the Moore-Penrose Inverse

Recurrent Neural Network Approach Based On The Integral Representation Of The Drazin Inverse

From Zhang Neural Network to Newton Iteration for Matrix Inversion

Computing Time-Varying ML-Weighted Pseudoinverse by the Zhang Neural Networks

On Level-2 Condition Number for the Weighted Moore–Penrose Inverse

Expression For The Perturbation Of The Weighted Moore-Penrose Inverse

Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks

Multi-Model Least Squares-Based Recomputation Framework for Large Data Analysis

Alternating optimization method based on nonnegative matrix factorizations for deep neural networks

Interval iterative methods for computing Moore-Penrose inverse

Interpretable Deep Recurrent Neural Networks via Unfolding Reweighted $\ell_1$-$\ell_1$ Minimization: Architecture Design and Generalization Analysis

Revising the Structure of Recurrent Neural Networks to Eliminate Numerical Derivatives in Forming Physics Informed Loss Terms with Respect to Time