Abstract:We present a numerical method based on random projections with Gaussian kernels and physics-informed neural networks for the numerical solution of initial value problems (IVPs) of nonlinear stiff ordinary differential equations (ODEs) and index-1 differential algebraic equations (DAEs), which may also arise from spatial discretization of partial differential equations (PDEs). The internal weights are fixed to ones while the unknown weights between the hidden and output layer are computed with Newton's iterations using the Moore-Penrose pseudo-inverse for low to medium scale and sparse QR decomposition with L 2 regularization for medium- to large-scale systems. Building on previous works on random projections, we also prove its approximation accuracy. To deal with stiffness and sharp gradients, we propose an adaptive step-size scheme and address a continuation method for providing good initial guesses for Newton iterations. The "optimal" bounds of the uniform distribution from which the values of the shape parameters of the Gaussian kernels are sampled and the number of basis functions are "parsimoniously" chosen based on bias-variance trade-off decomposition. To assess the performance of the scheme in terms of both numerical approximation accuracy and computational cost, we used eight benchmark problems (three index-1 DAEs problems, and five stiff ODEs problems including the Hindmarsh-Rose neuronal model of chaotic dynamics and the Allen-Cahn phase-field PDE). The efficiency of the scheme was compared against two stiff ODEs/DAEs solvers, namely, ode15s and ode23t solvers of the MATLAB ODE suite as well as against deep learning as implemented in the DeepXDE library for scientific machine learning and physics-informed learning for the solution of the Lotka-Volterra ODEs included in the demos of the library. A software/toolbox in Matlab (that we call RanDiffNet) with demos is also provided.

Random neural networks for rough volatility

Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionality

From Stochastic to Rough Volatility: A New Deep Learning Perspective on Hedging

A Priori Estimation of the Approximation, Optimization and Generalization Errors of Random Neural Networks for Solving Partial Differential Equations

Neural variance reduction for stochastic differential equations

Optimal Stopping via Randomized Neural Networks

Neural network stochastic differential equation models with applications to financial data forecasting

Neural networks-based algorithms for stochastic control and PDEs in finance

Deep learning interpretability for rough volatility

Parsimonious physics-informed random projection neural networks for initial value problems of ODEs and index-1 DAEs

A deep learning approach to the probabilistic numerical solution of path-dependent partial differential equations

Statistical Solution to SDEs with $$\alpha $$-Stable Lévy Noise Via Deep Neural Network

Neural network approaches for variance reduction in fluctuation formulas

Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

Rough volatility, path-dependent PDEs and weak rates of convergence

Deep calibration with random grids

Deep Learning Volatility

A deep learning solution approach for high-dimensional random differential equations

Quantum-inspired variational algorithms for partial differential equations: application to financial derivative pricing

Solving stochastic partial differential equations using neural networks in the Wiener chaos expansion

Deep Smoothing of the Implied Volatility Surface