Abstract:High-dimensional partial differential equations (PDEs) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment models, or portfolio optimization models. The PDEs in such applications are high-dimensional as the dimension corresponds to the number of financial assets in a portfolio. Moreover, such PDEs are often fully nonlinear due to the need to incorporate certain nonlinear phenomena in the model such as default risks, transaction costs, volatility uncertainty (Knightian uncertainty), or trading constraints in the model. Such high-dimensional fully nonlinear PDEs are exceedingly difficult to solve as the computational effort for standard approximation methods grows exponentially with the dimension. In this work, we propose a new method for solving high-dimensional fully nonlinear second-order PDEs. Our method can in particular be used to sample from high-dimensional nonlinear expectations. The method is based on (1) a connection between fully nonlinear second-order PDEs and second-order backward stochastic differential equations (2BSDEs), (2) a merged formulation of the PDE and the 2BSDE problem, (3) a temporal forward discretization of the 2BSDE and a spatial approximation via deep neural nets, and (4) a stochastic gradient descent-type optimization procedure. Numerical results obtained using TensorFlow in Python illustrate the efficiency and the accuracy of the method in the cases of a 100-dimensional Black–Scholes–Barenblatt equation, a 100-dimensional Hamilton–Jacobi–Bellman equation, and a nonlinear expectation of a 100-dimensional G -Brownian motion.

Nondegenerate Piecewise Linear Systems: A Finite Newton Algorithm and Applications in Machine Learning

A Finite Newton Algorithm for Non-degenerate Piecewise Linear Systems.

Parallel Coordinate Descent Newton Method for Efficient L1 -Regularized Loss Minimization.

Newton Informed Neural Operator for Computing Multiple Solutions of Nonlinear Partials Differential Equations

Piecewise Linear Neural Networks and Deep Learning

A Semismooth Newton Algorithm for High-Dimensional Nonconvex Sparse Learning

Nonlinear Recursive Partial Least Squares and Its Applications

Learning of Linear Dynamical Systems as a Non-Commutative Polynomial Optimization Problem

Parallel Coordinate Descent Newton for Large-scale L1-Regularized Minimization.

Coderivative-Based Newton Methods with Wolfe Linesearch for Nonsmooth Optimization

Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations

Efficient continuous piecewise linear regression for linearising univariate non-linear functions

Multilinear and Nonlinear Generalizations of Partial Least Squares: an Overview of Recent Advances

Learning to optimize with convergence guarantees using nonlinear system theory

Revisiting Sub-sampled Newton Methods

Nonlinear Projection to Latent Structures Method and Its Applications

A Bregman-Kaczmarz method for nonlinear systems of equations

Robust Numerical Methods for Nonlinear Regression

A Multilevel Low-Rank Newton Method with Super-linear Convergence Rate and its Application to Non-convex Problems

The Existence the Solution of Nonlinear Discrete Schemes and Convergence of a Linearized Iterative Method for time-dependent PNP Equations

Penalized Partial Least Squares Based on B-Splines Transformations