Abstract:The rise of artificial intelligence (AI) hinges on the efficient training of modern deep neural networks (DNNs) for non-convex optimization and uncertainty quantification, which boils down to a non-convex Bayesian learning problem. A standard tool to handle the problem is Langevin Monte Carlo, which proposes to approximate the posterior distribution with theoretical guarantees. In this thesis, we start with the replica exchange Langevin Monte Carlo (also known as parallel tempering), which proposes appropriate swaps between exploration and exploitation to achieve accelerations. However, the naïve extension of swaps to big data problems leads to a large bias, and bias-corrected swaps are required. Such a mechanism leads to few effective swaps and insignificant accelerations. To alleviate this issue, we first propose a control variates method to reduce the variance of noisy energy estimators and show a potential to accelerate the exponential convergence. We also present the population-chain replica exchange based on non-reversibility and obtain an optimal round-trip rate for deep learning. In the second part of the thesis, we study scalable dynamic importance sampling algorithms based on stochastic approximation. Traditional dynamic importance sampling algorithms have achieved success, however, the lack of scalability has greatly limited their extensions to big data. To handle this scalability issue, we resolve the vanishing gradient problem and propose two dynamic importance sampling algorithms. Theoretically, we establish the stability condition for the underlying ordinary differential equation (ODE) system and guarantee the asymptotic convergence of the latent variable to the desired fixed point. Interestingly, such a result still holds given non-convex energy landscapes.

Neural variance reduction for stochastic differential equations

Neural Control Variates for Variance Reduction

Stochastic Sub-Sampled Newton Method with Variance Reduction

Neural network approaches for variance reduction in fluctuation formulas

Stochastic Gradient Hamiltonian Monte Carlo with Variance Reduction for Bayesian Inference.

Neural networks-based algorithms for stochastic control and PDEs in finance

Variance reduction for dependent sequences with applications to Stochastic Gradient MCMC

Neural Control Variates

Random neural networks for rough volatility

The CV Makes the Difference – Control Variates for Neural Networks

Variational Inference for SDEs Driven by Fractional Noise

Stochastic Differential Equations with Variational Wishart Diffusions

Stochastic viscosity approximations of Hamilton-Jacobi equations and variance reduction

Importance sampling for option pricing with feedforward neural networks

Neural network stochastic differential equation models with applications to financial data forecasting

Non-convex Bayesian Learning via Stochastic Gradient Markov Chain Monte Carlo

Learning stochastic dynamical systems with neural networks mimicking the Euler-Maruyama scheme

Theoretical guarantees for neural control variates in MCMC

Quantum-inspired variational algorithms for partial differential equations: application to financial derivative pricing