Abstract:The goal of this thesis is to provide efficient and provably convergent numerical methods for solving partial differential equations (PDEs) coming from impulse control problems motivated by finance. Impulses, which are controlled jumps in a stochastic process, are used to model realistic features in financial problems which cannot be captured by ordinary stochastic controls. The dynamic programming equations associated with impulse control problems are Hamilton-Jacobi-Bellman quasi-variational inequalities (HJBQVIs) Other than in certain special cases, the numerical schemes that come from the discretization of HJBQVIs take the form of complicated nonlinear matrix equations also known as Bellman problems. We prove that a policy iteration algorithm can be used to compute their solutions. In order to do so, we employ the theory of weakly chained diagonally dominant (w.c.d.d.) matrices. As a byproduct of our analysis, we obtain some new results regarding a particular family of Markov decision processes which can be thought of as impulse control problems on a discrete state space and the relationship between w.c.d.d. matrices and M-matrices. Since HJBQVIs are nonlocal PDEs, we are unable to directly use the seminal result of Barles and Souganidis (concerning the convergence of monotone, stable, and consistent numerical schemes to the viscosity solution) to prove the convergence of our schemes. We address this issue by extending the work of Barles and Souganidis to nonlocal PDEs in a manner general enough to apply to HJBQVIs. We apply our schemes to compute the solutions of various classical problems from finance concerning optimal control of the exchange rate, optimal consumption with fixed and proportional transaction costs, and guaranteed minimum withdrawal benefits in variable annuities.

Deep impulse control: application to interest rate intervention

Nonparametric learning for impulse control problems

Deciding Bank Interest Rates -- A Major-Minor Impulse Control Mean-Field Game Perspective

Impulse Control in Finance: Numerical Methods and Viscosity Solutions

Impulse control problem on finite horizon with execution delay

Reinforcement Learning for Intra-and-Inter-Bank Borrowing and Lending Mean Field Control Game

Optimal intervention in the foreign exchange market when interventions affect market dynamics

A bank salvage model by impulse stochastic controls

Impulse Control of Multi-dimensional Jump Diffusions in Finite Time Horizon

Deep treasury management for banks

Inference of Utilities and Time Preference in Sequential Decision-Making

Stochastic impulse control of non-smooth dynamics with partial observation and execution delay: application to an environmental restoration problem

Impulse Control of Conditional McKean–Vlasov Jump Diffusions

On the Modeling of Impulse Control with Random Effects for Continuous Markov Processes

NON-ROBUSTNESS OF SOME IMPULSE CONTROL PROBLEMS WITH RESPECT TO INTERVENTION COSTS

A Machine Learning Algorithm for Finite-Horizon Stochastic Control Problems in Economics

On the Modelling of Impulse Control with Random Effects for Continuous Markov Processes

Optimal cash management using impulse control

On Deep Learning for computing the Dynamic Initial Margin and Margin Value Adjustment

Stochastic Intervention for Causal Inference via Reinforcement Learning

A Continuous-time Tractable Model for Present-biased Agents