Abstract:Overparameterized stochastic differential equation (SDE) models have achieved remarkable success in various complex environments, such as PDE-constrained optimization, stochastic control and reinforcement learning, financial engineering, and neural SDEs. These models often feature system evolution coefficients that are parameterized by a high-dimensional vector $\theta \in \mathbb{R}^n$, aiming to optimize expectations of the SDE, such as a value function, through stochastic gradient ascent. Consequently, designing efficient gradient estimators for which the computational complexity scales well with $n$ is of significant interest. This paper introduces a novel unbiased stochastic gradient estimator--the generator gradient estimator--for which the computation time remains stable in $n$. In addition to establishing the validity of our methodology for general SDEs with jumps, we also perform numerical experiments that test our estimator in linear-quadratic control problems parameterized by high-dimensional neural networks. The results show a significant improvement in efficiency compared to the widely used pathwise differentiation method: Our estimator achieves near-constant computation times, increasingly outperforms its counterpart as $n$ increases, and does so without compromising estimation variance. These empirical findings highlight the potential of our proposed methodology for optimizing SDEs in contemporary applications.

Modified stochastic gradient parameter estimation algorithms for a nonlinear two-variable difference system

Parameter estimation for nonlinear time-delay systems with noisy output measurements

Identification Methods for Two-Variable Difference Systems

A modified stochastic gradient based parameter estimation algorithm for dual-rate sampled-data systems

Novel parameter identification algorithm for nonstationary stochastic system

Least-Squares Based and Gradient Based Iterative Parameter Estimation Algorithms for a Class of Linear-in-Parameters Multiple-Input Single-Output Output Error Systems

Two‐stage auxiliary model gradient‐based iterative algorithm for the input nonlinear controlled autoregressive system with variable‐gain nonlinearity

Hierarchical Stochastic Gradient Algorithm and its Performance Analysis for a Class of Bilinear-in-Parameter Systems

Non-linear Gradient Algorithm for Parameter Estimation: Extended version

Parameter Estimation for Multivariate Nonlinear Stochastic Differential Equation Models: A Comparison Study

Partially‐coupled Gradient‐based Iterative Algorithms for Multivariable Output‐error‐like Systems with Autoregressive Moving Average Noises

Two‐stage gradient‐based iterative algorithms for the fractional‐order nonlinear systems by using the hierarchical identification principle

The projection algorithm for estimation of nonlinear system parameter

Aitken Based Modified Kalman Filtering Stochastic Gradient Algorithm for Dual-Rate Nonlinear Models

Stochastic Gradient Based Iterative Identification Algorithm for a Class of Dual-Rate Wiener Systems

Decomposition‐based over‐parameterization forgetting factor stochastic gradient algorithm for Hammerstein‐Wiener nonlinear systems with non‐uniform sampling

Stochastic Gradient with Changing Forgetting Factor-Based Parameter Identification for Wiener Systems.

Two-stage Gradient-Based Iterative Algorithm for Bilinear Stochastic Systems over the Moving Data Window

A Gradient-Based Parameter Identification Method for Time-Delay Chaotic Systems

On Difference‐based Gradient Estimation in Nonparametric Regression

An Efficient High-Dimensional Gradient Estimator for Stochastic Differential Equations