Abstract:We present a method for computing the inverse parameters and the solution field to inverse parametric PDEs based on randomized neural networks. This extends the local extreme learning machine technique originally developed for forward PDEs to inverse problems. We develop three algorithms for training the neural network to solve the inverse PDE problem. The first algorithm (NLLSQ) determines the inverse parameters and the trainable network parameters all together by the nonlinear least squares method with perturbations (NLLSQ-perturb). The second algorithm (VarPro-F1) eliminates the inverse parameters from the overall problem by variable projection to attain a reduced problem about the trainable network parameters only. It solves the reduced problem first by the NLLSQ-perturb algorithm for the trainable network parameters, and then computes the inverse parameters by the linear least squares method. The third algorithm (VarPro-F2) eliminates the trainable network parameters from the overall problem by variable projection to attain a reduced problem about the inverse parameters only. It solves the reduced problem for the inverse parameters first, and then computes the trainable network parameters afterwards. VarPro-F1 and VarPro-F2 are reciprocal to each other in a sense. The presented method produces accurate results for inverse PDE problems, as shown by the numerical examples herein. For noise-free data, the errors for the inverse parameters and the solution field decrease exponentially as the number of collocation points or the number of trainable network parameters increases, and can reach a level close to the machine accuracy. For noisy data, the accuracy degrades compared with the case of noise-free data, but the method remains quite accurate. The presented method has been compared with the physics-informed neural network method.

An adaptive sequential Monte Carlo approach to neural network training

Non-linear Model Predictive Control Based on Neural Network Model with Modified Differential Evolution Adapting Weights

Differentiable Interacting Multiple Model Particle Filtering

Adaptive sequential Monte Carlo by means of mixture of experts

Real-time Monte Carlo Denoising with Weight Sharing Kernel Prediction Network

A sequential learning algorithm based on adaptive particle filtering for RBF networks

An efficient likelihood-free Bayesian inference method based on sequential neural posterior estimation

An Enhanced Particle Filter for Uncertainty Quantification in Neural Networks

Neural Particle Smoothing for Sampling from Conditional Sequence Models

The Alive Particle Filter and Its Use in Particle Markov Chain Monte Carlo

Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation

Multisensor Sequential Particle Filter

Leveraging Nested MLMC for Sequential Neural Posterior Estimation with Intractable Likelihoods

Interacting multiple model algorithm based on convolution particle filter

A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks

Sequential Monte Carlo Methods for Moving Target Tracking

A Mixed Residual Hybrid Method for Failure Probability Estimation

A machine learning approach for filtering Monte Carlo noise

Efficient Sequential Monte Carlo With Multiple Proposals and Control Variates

An Adaptive Particle Filter Based on the Mixing Probability

Adaptive Bayesian signal processing - a sequential Monte Carlo paradigm