Abstract:Overparameterized stochastic differential equation (SDE) models have achieved remarkable success in various complex environments, such as PDE-constrained optimization, stochastic control and reinforcement learning, financial engineering, and neural SDEs. These models often feature system evolution coefficients that are parameterized by a high-dimensional vector $\theta \in \mathbb{R}^n$, aiming to optimize expectations of the SDE, such as a value function, through stochastic gradient ascent. Consequently, designing efficient gradient estimators for which the computational complexity scales well with $n$ is of significant interest. This paper introduces a novel unbiased stochastic gradient estimator--the generator gradient estimator--for which the computation time remains stable in $n$. In addition to establishing the validity of our methodology for general SDEs with jumps, we also perform numerical experiments that test our estimator in linear-quadratic control problems parameterized by high-dimensional neural networks. The results show a significant improvement in efficiency compared to the widely used pathwise differentiation method: Our estimator achieves near-constant computation times, increasingly outperforms its counterpart as $n$ increases, and does so without compromising estimation variance. These empirical findings highlight the potential of our proposed methodology for optimizing SDEs in contemporary applications.

Semi-Parametric Estimation for Forward-Backward Stochastic Differential Equations

Nonparametric Estimation for FBSDEs Models with Applications in Finance

A Convolution Method for Numerical Solution of Backward Stochastic Differential Equations Based on the Fractional FFT

Terminal-Dependent Statistical Inferences for Fbsde

Forward–backward SDEs with Distributional Coefficients

Nonparametric estimation of FBSDEs with random terminal time

On Well-Posedness of Forward-Backward Sdes-A Unified Approach

Numerical Method for Multi-Dimensional Coupled Forward-Backward Stochastic Differential Equations Based on Fractional Fourier Fast Transform

A discretization scheme for path-dependent FBSDEs

Terminal-Dependent Statistical Inference for the FBSDEs Models

Semi-linear degenerate backward stochastic partial differential equations and associated forward-backward stochastic differential equations

Second-order numerical schemes for decoupled forward-backward stochastic differential equations with jumps

An Efficient Numerical Method for Forward-Backward Stochastic Differential Equations Driven by G-Brownian Motion

Forward-Backward Doubly Stochastic Differential Equations with Random Jumps and Stochastic Partial Differential-Integral Equations

Solution to Forward-Backward Stochastic Differential Equations with Random Coefficients and Application to Deterministic Optimal Control

Solving Coupled Nonlinear Forward-backward Stochastic Differential Equations: an Optimization Perspective with Backward Measurability Loss

Forward Backward SDEs in Weak Formulation

An Efficient High-Dimensional Gradient Estimator for Stochastic Differential Equations

Towards Robust and Stable Deep Learning Algorithms for Forward Backward Stochastic Differential Equations

A New Kind of Accurate Numerical Method for Backward Stochastic Differential Equations

SEMI-LINEAR SYSTEMS OF BACKWARD STOCHASTIC PARTIAL DIFFERENTIAL EQUATIONS IN ℝn